News | Nuclear Imaging | March 21, 2019

Improving Molecular Imaging Using a Deep Learning Approach

New technique has the potential to improve the quality and speed of imaging

Improving Molecular Imaging Using a Deep Learning Approach

March 21, 2019  — Generating comprehensive molecular images of organs and tumors in living organisms can be performed at ultra-fast speed using a new deep learning approach to image reconstruction developed by researchers at Rensselaer Polytechnic Institute.

The research team’s new technique has the potential to vastly improve the quality and speed of imaging in live subjects and was the focus of an article recently published in Light: Science and Applications, a Nature journal.1

Compressed sensing-based imaging is a signal processing technique that can be used to create images based on a limited set of point measurements. Recently, a Rensselaer research team proposed a novel instrumental approach to leverage this methodology to acquire comprehensive molecular data sets, as reported in Nature Photonics.2 While that approach produced more complete images, processing the data and forming an image could take hours.

This latest methodology developed at Rensselaer builds on the previous advancement and has the potential to produce real-time images, while also improving the quality and usefulness of the images produced. This could facilitate the development of personalized drugs, improve clinical diagnostics or identify tissue to be excised.

In addition to providing an overall snapshot of the subject being examined, including the organs or tumors that researchers have visually targeted with the help of fluorescence, this imaging process can reveal information about the successful intracellular delivery of drugs by measuring the decay rate of the fluorescence.

To enable almost real-time visualization of molecular events, the research team has leveraged the latest developments in artificial intelligence. The vastly improved image reconstruction is accomplished using a deep learning approach. Deep learning is a complex set of algorithms designed to teach a computer to recognize and classify data. Specifically, this team developed a convolutional neural network architecture that the Rensselaer researchers call Net-FLICS (fluorescence lifetime imaging with compressed sensing).

“This technique is very promising in getting a more accurate diagnosis and treatment,” said Pingkun Yan, co-director of the Biomedical Imaging Center at Rensselaer. “This technology can help a doctor better visualize where a tumor is and its exact size. They can then precisely cut off the tumor instead of cutting a larger part and spare the healthy, normal tissue.”

Yan developed this approach with corresponding author Xavier Intes, the other co-director of the Biomedical Imaging Center at Rensselaer, which is part of the Rensselaer Center for Biotechnology and Interdisciplinary Studies. Doctoral students Marien Ochoa and Ruoyang Yao supported the research.

“At the end, the goal is to translate these to a clinical setting. Usually when you have clinical systems you want to be as fast as possible,” said Ochoa, as she reflected on the speed with which this new technique allows researchers to capture these images.

Further development is required before this new technology can be used in a clinical setting. However, its progress has been accelerated by incorporating simulated data based on modeling, a particular specialty for Intes and his lab.

“For deep learning usually you need a very large amount of data for training, but for this system we don’t have that luxury yet because it’s a very new system,” said Yan.

He said that the team’s research also shows that modeling can innovatively be used in imaging, accurately extending the model to the real experimental data.

For more information: www.nature.com/lsa

 

References

1. Yao R., Ochoa M., Yan P., Intes X. Net-FLICS: fast quantitative wide-field fluorescence lifetime imaging with compressed sensing – a deep learning approach. Light: Science and Applications, March 6, 2019. https://doi.org/10.1038/s41377-019-0138-x

2. Pian Q., Yao R., Sinsuebphon N., Intes X. Compressive hyperspectral time-resolved wide-field fluorescence lifetime imaging. Nature Photonics, June 5, 2017.

Related Content

CoronaCare is designed to help healthcare providers track COVID-19 (coronavirus) related symptoms of potentially infected patients. The platform enables communication with patients outside of facility walls and the ability to request the return of high-risk patients for more in-depth care. #COVID19 #Coronavirus #2019nCoV #Wuhanvirus #SARScov2
News | Coronavirus (COVID-19) | March 27, 2020
March 27, 2020 — PaxeraHealth has spent years building and be
AI vendor Infervision's InferRead CT Pneumonia software uses artificial intelligence-assisted diagnosis to improve the overall efficiency of the radiology department. It is being developed in China as a high sensitivity detection aid for novel coronavirus pneumonia (COVID-19). #COVID19 #coronavirus #SARScov2

AI vendor Infervision's InferRead CT Pneumonia software uses artificial intelligence-assisted diagnosis to improve the overall efficiency of the radiology department. It is being developed in China as a high sensitivity detection aid for novel coronavirus pneumonia (COVID-19).

Feature | Coronavirus (COVID-19) | March 27, 2020 | Jilian Liu, M.D., HIMSS Greater China
An older couple walked into the Hubei Provincial Hospital of Integrated Chinese and Western Medicine near their neigh
Novel scanners may open door for prognostic assessment in patients receiving cochlear implants

Iva Speck, MD, explains research showing that novel, fully digital, high-resolution positron emission tomography/computed tomography imaging of small brain stem nuclei can provide clinicians with valuable information concerning the auditory pathway in patients with hearing impairment. The research is featured in The Journal of Nuclear Medicine (read more at http://jnm.snmjournals.org/content/current). Video courtesy of Iva Speck, University Hospital Freiburg, Germany.

News | PET-CT | March 26, 2020
March 26, 2020 — Novel, fully digital, high-resolution...
#COVID19 #Coronavirus #2019nCoV #Wuhanvirus #SARScov2
News | Artificial Intelligence | March 24, 2020
March 24, 2020 — Qure.ai, a leading healthcare...
Instant triage capability could potentially speed up diagnosis of COVID-19 individuals and ensure resources allocated properly.
News | Artificial Intelligence | March 23, 2020
March 23, 2020 — behold.ai announced that its artificial intellige
#COVID19 #Coronavirus #2019nCoV #Wuhanvirus #SARScov2

Representative examples of the attention heatmaps generated using Grad-CAM method for (a) COVID-19, (b) CAP, and (c) Non-Pneumonia. The heatmaps are standard Jet colormap and overlapped on the original image, the red color highlights the activation region associated with the predicted class. COVID-19 = coronavirus disease 2019, CAP = community acquired pneumonia. Image courtesy of the journal Radiology

News | Coronavirus (COVID-19) | March 20, 2020
March 20, 2020 — An arti...
Varian received FDA clearance for its Ethos therapy in February 2020. It is an adaptive intelligence solution that uses onboard AI in the treatment system to take the cone beam CT imaging on the system, compare it to the treatment plan and deliver an entire adaptive treatment plan in a typical 15-minute treatment time slot, from patient setup through treatment delivery.

Varian received FDA clearance for its Ethos therapy in February 2020, shown here displayed for the first time at ASTRO 2019. It is an adaptive intelligence solution that uses onboard AI in the treatment system to take the cone beam CT imaging on the system, compare it to the treatment plan and deliver an entire adaptive treatment plan in a typical 15-minute treatment time slot, from patient setup through treatment delivery.

Feature | Treatment Planning | March 19, 2020 | Dave Fornell, Editor
The traditional treatment planning process takes days to create an optimized radiation therapy delivery plan, but new