News | Artificial Intelligence | January 15, 2019

Algorithm achieves 94 percent agreement with radiologist interpretation

Artificial Intelligence Used in Clinical Practice to Measure Breast Density

January 15, 2019 — An artificial intelligence (AI) algorithm measures breast density at the level of an experienced mammographer, according to a new study published in the journal Radiology.1 The researchers said the study, the result of a collaboration between breast imagers and AI experts, represents a groundbreaking implementation of AI into routine clinical practice.

Breast density can mask cancers on mammography and is an independent risk factor for the disease. The masking effect and cancer risk are significant enough that many states have laws mandating women be notified if they have mammographically dense breasts. Despite its importance, breast density assessment is an imperfect science, and research has shown much discrepancy among radiologists in making density determinations.

“We’re dependent on human qualitative assessment of breast density, and that approach has significant flaws,” said study lead author Constance D. Lehman, M.D., Ph.D., from Massachusetts General Hospital (MGH) in Boston. “We need a more accurate tool.”

Lehman and colleagues collaborated with AI expert Regina Barzilay, Ph.D., professor of computer science and electrical engineering at the Massachusetts Institute of Technology in Cambridge, Mass., and her team to develop an algorithm that can automatically measure breast density. They used tens of thousands of high-quality digital mammograms from MGH to train and test the algorithm before implementing it in routine clinical practice. Eight radiologists then reviewed 10,763 mammograms that the model had determined were either dense or non-dense tissue.

The interpreting radiologist accepted the algorithm’s assessment in 10,149 of the mammograms, or 94 percent. Lehman noted that the 94 percent agreement rate between the radiologists and the algorithm does not necessarily mean the machine was wrong in 6 percent of the cases. Reader variability could affect the disagreement because radiologists visually assess breast density, which is subjective and qualitative.

“We were thrilled with the results,” Lehman said. “Now at Mass General, the deep learning algorithm processes all our screening mammograms and provides density, which is either accepted or rejected by the radiologists.”

“The study results show that the algorithm worked remarkably well,” Barzilay added. “But what’s more important is that it is being used every day to measure breast density in mammograms at a major hospital.”

The system has been in continuous operation at MGH since January and has processed approximately 16,000 images, according to Barzilay.

Lehman attributed the successful clinical implementation of the AI model to two components: the availability of high-quality, annotated data evaluated by expert radiologists, and the collaborative efforts of experienced, accomplished medical and computer science professionals.

“We have to have radiologists and other physicians who understand the pressing needs of our patients and can partner with computer scientists who are experts in AI,” she said. “That is the collaboration that is going to move the field forward.”

The algorithm has the potential to standardize and automate routine breast density assessment, the researchers said. On a broader scale, they see AI as central to the development of personalized breast cancer risk assessment for each woman who undergoes mammography. AI is uniquely suited to breast imaging because it can draw upon a large, mature database with advanced, structured reporting that links images with outcomes. This predictive power is a potential boon to all women, including groups who have been inadequately served by current prediction models. For instance, research has shown that current predictive models tend to underestimate risk in African-American women.

“We’re teaching the machine to directly predict cancer risk even before the radiologist will see any cancer,” Barzilay said. “The best time to control the disease is when it starts.”

“With AI, we now have the ability to leverage vast amounts of information into more personalized, more targeted care for our patients,” Lehman added. “In the case of breast cancer, we can better predict how likely a woman will have cancer in her future and improve the chances that it will be treated successfully.”

For more information: www.pubs.rsna.org/journal/radiology

 

Reference

1. Lehman C.D., Yala A., Schuster T., et al. Mammographic Breast Density Assessment Using Deep Learning: Clinical Implementation. Radiology, Oct. 16, 2018. https://doi.org/10.1148/radiol.2018180694


Related Content

News | Radiology Imaging

Feb. 12, 2026 — Siemens Healthineers and Mayo Clinic are expanding their strategic collaboration to enhance patient care ...

Time February 13, 2026
arrow
Feature | Cardiac Imaging | Kyle Hardner

Advances in coronary CT angiography (CCTA) have reached the point where image quality and AI capabilities are creating ...

Time February 06, 2026
arrow
News | Magnetic Resonance Imaging (MRI)

Feb. 5, 2026 — Eyas Medical Imaging, Inc. has received U.S. Food and Drug Administration (FDA) 510(k) clearance for its ...

Time February 06, 2026
arrow
News | Ultrasound Women's Health

Feb. 5, 2026 — BrightHeart, a global provider of AI-driven prenatal ultrasound, has announced the availability of its B ...

Time February 05, 2026
arrow
News | Lung Imaging

Feb. 3, 2026 — RevealDx, a leader in the characterization of lung nodules, recently announced FDA clearance of RevealAI ...

Time February 04, 2026
arrow
News | Radiation Therapy

Feb. 4, 2026 — On World Cancer Day (02.04.26), the American Society for Radiation Oncology (ASTRO) and the European ...

Time February 04, 2026
arrow
News | Radiology Imaging

Feb. 4, 2026 — The Royal College of Radiologists (RCR) has issued its initial reaction to the British government's ...

Time February 04, 2026
arrow
News | FDA

Jan. 29, 2026 — GE HealthCare has received 510(k) clearance from the U.S. Food and Drug Administration (FDA) for MIM ...

Time February 03, 2026
arrow
News | FDA

Feb. 2, 2026 — Imagion Biosystems, Ltd. has submitted an Investigational New Drug (IND) application with the U.S. Food ...

Time February 02, 2026
arrow
News | Breast Imaging | Washington University

Jan. 22, 2026 — In breast cancer, a biopsy is the only diagnostic procedure that can determine if a suspicious lump or ...

Time January 29, 2026
arrow
Subscribe Now