Large multimodal foundation model for radiation oncology

Large multimodal foundation model for radiation oncology. Image courtesy of Chenbin Liu


December 20, 2023 — An estimated 600,000 people in the United States succumb to cancer every year. Beyond surgery, chemotherapy, and immunotherapy, radiotherapy has shown to be a  standard and effective treatment option for nearly 50-70 percent of cancer patients.

Radiotherapy treatment involves six basic stages: initial consultation, simulation, treatment planning, treatment delivery, treatment verification and patient follow-up. With the emergence of Artificial intelligence (AI), radiotherapy is undergoing substantial transformation. AI achieves human-level accuracy in the auto-segmentation, tumor staging, image registration, automatic treatment planning, quality assurance and outcomes prediction, which greatly improves the accuracy, precision, and efficiency of radiation therapy.

According to a recent review published in the KeAi journal Meta-Radiology, pioneering AGI models, such as GPT-4 and PaLM 2, along with large vision models (LVMs) like the Segment Anything Model (SAM), are capable of processing extensive texts and imaging data, respectively. AGI, distinguished by its advanced capabilities in few-shot and zero-shot learning, offers a pathway towards developing highly robust and generalizable AI models. These models are imperative for seamless and effective integration into the various facets of radiation oncology.

They found that the fusion of vision data with LLMs also creates powerful multimodal models that elucidate nuanced clinical patterns. Together, AGI has the potential to catalyze a shift towards data-driven, personalized radiation therapy. The authors stressed that these models should complement human expertise and care.

The findings provide an overview of how AGI can transform radiation oncology to elevate the standard of patient care, with the key insight being AGI’s ability to exploit multimodal clinical data at scale. In addition, the researchers explore the future directions of AGI in radiation oncology and discuss potential developments and bottlenecks in this field. These advancements in clinical applications will further enhance the effectiveness of radiation therapy, bringing more positive outcomes for cancer patients.

For more information: https://www.mayoclinic.org/


Related Content

News | Radiation Therapy

July 22, 2024 — RefleXion Medical, an external-beam theranostic oncology company, today announced that researchers from ...

Time July 22, 2024
arrow
News | ASTRO

July 18, 2024 — The members of the American Society for Radiation Oncology (ASTRO) recently elected five new officers to ...

Time July 18, 2024
arrow
News | PET-CT

July 16, 2024 — A new research paper was published in Oncotarget's Volume 15 on June 20, 2024, titled, “Comparison of ...

Time July 16, 2024
arrow
News | Digital Pathology

July 12, 2024 — AGFA HealthCare, a global leader in healthcare imaging management solutions, announced that Enterprise ...

Time July 12, 2024
arrow
News | Digital Pathology

July 12, 2024 — Diagnosing cancer and providing the personalized therapy it often requires, is a collaborative effort ...

Time July 12, 2024
arrow
Feature | Imaging Technology News - ITN

Be sure to check out the latest digital edition of Imaging Technology News (ITN), featuring the Mobile C-arm Systems ...

Time July 11, 2024
arrow
News | Radiation Oncology

July 11, 2024 — The American Society for Radiation Oncology (ASTRO) issued the following statement from Jeff M ...

Time July 11, 2024
arrow
News | Prostate Cancer

July 11, 2024 — GE HealthCare’s MIM Software, a global provider of medical imaging analysis and artificial intelligence ...

Time July 11, 2024
arrow
Feature | Radiation Oncology | By Christine Book

News emerging from several leading organizations and vendors in the radiation therapy arena came in at a fast pace in ...

Time July 09, 2024
arrow
News | Radiation Oncology

July 9, 2024 — Insights from the latest Mordor Intelligence report, “Radiotherapy Market Size & Share Analysis - Growth ...

Time July 09, 2024
arrow
Subscribe Now