News | Artificial Intelligence | March 19, 2024

Researchers at Mass General Brigham has designed two of the largest CPath foundation models to date: UNI and CONCH. The foundation models were adapted to over 30 clinical, diagnostic needs, including disease detection, disease diagnosis, organ transplant assessment, and rare disease analysis. Papers on each were published today in Nature Medicine.

Researchers at Mass General Brigham has designed two of the largest CPath foundation models to date: UNI and CONCH. Papers on each were published today in Nature Medicine.

Researchers at Mass General Brigham has designed two of the largest CPath foundation models to date: UNI and CONCH. The foundation models were adapted to over 30 clinical, diagnostic needs, including disease detection, disease diagnosis, organ transplant assessment, and rare disease analysis. Papers on each were published today in Nature Medicine. Image courtesy: Mass General Brigham


March 19, 2024 — Researchers at Mass General Brigham have announced that its research teams have designed two of the largest CPath foundation models to date: UNI and CONCH. These foundation models were adapted to over 30 clinical, diagnostic needs, including disease detection, disease diagnosis, organ transplant assessment, and rare disease analysis. Papers on UNI, “Towards a general-purpose foundation model for computational pathology,” and CONCH, “A visual-language foundation model for computational pathology,” respectively, were published today in Nature Medicine. Both models hold great promise for the field based on these proof-of-concept studies, according to the authors.

Foundation models, advanced artificial intelligence systems trained on large-scale datasets, hold the potential to provide unprecedented advancements for the medical field. In computational pathology (CPath), these models may excel in diagnostic accuracy, prognostic insights, and predicting therapeutic responses, offered a written statement summarizing the model designs issued by Mass Gen Brigham.  

The new models overcame limitations posed by current models, performing well not only for the clinical tasks the researchers tested but also showing promise for identifying new, rare and challenging diseases, according to the announcement. It further noted that the research team is making the code publicly available for other academic groups to use in addressing clinically relevant problems.

UNI is a foundation model for understanding pathology images, from recognizing disease in histology region-of-interests to gigapixel whole slide imaging. Trained using a database of over 100 million tissue patches and over 100,000 whole slide images, it stands out as having universal AI applications in anatomic pathology. Notably, UNI employs transfer learning, applying previously acquired knowledge to new tasks with remarkable accuracy. Across 34 tasks, including cancer classification and organ transplant assessment, UNI outperformed established pathology models, highlighting its versatility and potential applications as a CPath tool. 

CONCH is a foundation model for understanding both pathology images and language. Trained on a database of over 1.17 million histopathology image-text pairs, CONCH excels in tasks like identifying rare diseases, tumor segmentation, and understanding gigapixel images. Because CONCH is trained on text, pathologists can interact with the model to search for morphologies of interest. In a comprehensive evaluation across 14 clinically relevant tasks, CONCH outperformed standard models and demonstrated its effectiveness and versatility.    

“Foundation models represent a new paradigm in medical artificial intelligence,” said corresponding author Faisal Mahmood, PhD, of the MGH Division of Computational Pathology in the Department of Pathology at Mass General Brigham, and Associate Professor of Pathology, Harvard Division of Medical Sciences. “These models are AI systems that can be adapted to many downstream, clinically relevant tasks. We hope that the proof-of-concept presented in these studies will set the stage for such self-supervised models to be trained on larger and more diverse datasets.” 

Mass General Brigham co-authors of the UNI paper include: Richard J. Chen; Tong Ding; Ming Y. Lu; Drew F. K. Williamson; Guillaume Jaume; Andrew H. Song; Bowen Chen; Andrew Zhang; Daniel Shao; Muhammad Shaban; Mane Williams; Lukas Oldenburg; Luca L. Weishaupt; Judy J. Wang; Anurag Vaidya; Long Phi Le; Georg Gerber; Sharifa Sahai; and Walt Williams. 

Mass General Brigham co-authors of the CONCH paper include: Ming Y. Lu; Bowen Chen; Drew F. K. Williamson; Richard J. Chen; Ivy Liang; Tong Ding; Guillaume Jaume; Igor Odintsov; Long Phi Le; Georg Gerber; and Andrew Zhang. Additional co-authors include Anil V. Parwani. 

This work was supported in part by the BWH President’s Fund, BWH and MGH Pathology, NIH NIGMS R35GM138216 and the Massachusetts Life Sciences Center. 

Reference/Papers cited:  

1.      Lu MY et al. “A visual-language foundation model for computational pathology” Nature Medicine DOI: 10.1038/s41591-024-02856-4 

2.      Chen, RJ et al. “Towards a general-purpose foundation model for computational pathology” Nature Medicine DOI: 10.1038/s41591-024-02857-3 

More information: www.massgeneralbrigham.org


Related Content

News | Radiology Business

April 17, 2024 — VISTA.AI announced the appointment of Daniel Hawkins as President and CEO. The company is pioneering AI ...

Time April 17, 2024
arrow
Videos | Breast Imaging

Don't miss ITN's latest "One on One" video interview with AAWR Past President and American College of Radiology (ACR) ...

Time April 15, 2024
arrow
News | Mammography

April 12, 2024 — GE HealthCare, a leader in breast health technology and diagnostics, will feature its latest breast ...

Time April 12, 2024
arrow
News | PACS

April 11, 2024 — Mach7 Technologies, a company specializing in innovative medical imaging and data management solutions ...

Time April 11, 2024
arrow
News | Radiation Dose Management

April 11, 2024 — Prelude Corporation (PreludeDx), a leader in precision diagnostics for early-stage breast cancer ...

Time April 11, 2024
arrow
News | Mammography

April 11, 2024 — Volpara Health Technologies Ltd., a global leader in software for the early detection and prevention of ...

Time April 11, 2024
arrow
News | Society of Breast Imaging (SBI)

April 11, 2024 — iCAD, Inc., a global leader in clinically proven AI-powered cancer detection solutions, announced today ...

Time April 11, 2024
arrow
News | Cybersecurity

April 10, 2024 — The American Medical Association (AMA) released informal survey findings (PDF) showing the ongoing ...

Time April 10, 2024
arrow
News | Breast Imaging

April 8, 2024 — iCAD, Inc., a global leader in clinically proven AI-powered cancer detection solutions, is proud to ...

Time April 08, 2024
arrow
News | Ultrasound Imaging

April 5, 2024 — EchoNous, a leading innovator in ultrasound technology, announced the upcoming Kosmos 2.2 release on ...

Time April 05, 2024
arrow
Subscribe Now