RSNA Announces Screening Mammography AI Challenge Results

May 11, 2023 — The Radiological Society of North America (RSNA) has announced the results of the RSNA Screening Mammography Breast Cancer Detection AI Challenge. The latest in a series of such research competitions that RSNA has conducted since 2015, this challenge tasked participants with developing artificial intelligence (AI) models that can accurately detect breast cancer from mammography images, potentially assisting radiologists in making more accurate and timely diagnoses. 

Breast cancer is the most commonly occurring cancer worldwide, according to the World Health Organization. In 2020 alone, there were 2.3 million new breast cancer diagnoses and 685,000 deaths. 

Breast cancer screening has been shown to reduce cancer fatalities. AI tools have the potential to make screening more efficient and effective. 

“Although there is a worldwide shortage of radiologists to interpret screening mammograms, radiologists remain concerned about how well the AI systems will work in their patient population,” said Dr. Linda Moy, a professor of radiology at the NYU Grossman School of Medicine and editor of the journal Radiology. “This diverse well-curated dataset may be used to assess the generalizability to diverse patient populations. This RSNA Mammography AI Challenge will catalyze collaboration to improve the diagnostic accuracy of screening mammography and save patients’ lives.” 

The challenge, hosted on a platform provided by Kaggle, Inc. (an Alphabet company), attracted nearly 1,700 teams from around the world. The competition was launched November 28, 2022, and ran through February 2023. The prize-winning solutions were then reviewed by a team of volunteer AI experts to confirm the results. The eight teams submitting the highest-scoring algorithms shared in $50,000 total prize money.   

The winning teams in the RSNA Screening Mammography Breast Cancer Detection AI Challenge are: 

mr.robot 

cancerdetectman 

H.B.M.F. 

CDI 

Racers 

Chiral Mistrals 

luddite&MT 

BCC 

The review committee also awarded the Educational Merit Award to the mr.robot team for the clarity of their solution and accompanying presentation materials. 

The dataset used in the challenge was contributed by mammography screening programs in Australia and the United States. It includes detailed labels with radiologists’ evaluations and follow-up pathology results for suspected malignancies. The dataset will remain available for use in further research. 

This challenge is part of a broader research project that will examine how models generated in the competition perform against previously unseen data and compare their performance to that of expert human observers. These questions are critical in determining how AI tools will perform in clinical settings. 

“The number of participants we had in this competition was amazing and reflects the high levels of interest in using large, high-quality datasets to advance the state of the art in mammographic diagnosis,” said Dr. John Mongan, a professor of radiology at the University of California, San Francisco and chair of the RSNA Machine Learning Steering Committee. “We expect that the dataset and the work of the contestants will provide an ideal foundation for rapid advance in breast imaging AI.” 

For more information on the challenge, visit RSNA.org/AI-image-challenge 

Related Breast Imaging Content: 

VIDEO: Research and Advancements in Breast Imaging Technology 

VIDEO: FDA Update on the US National Density Reporting Standard - A Discussion on the Final Rule 

One on One … with Wendie Berg, MD, PhD, FACR, FSBI 

Creating Patient Equity: A Breast Density Legislative Update 

FDA Needs to Ensure that Information on Dense Breast Notifications are Clear and Understandable to all Members of the Public 

AI Provides Accurate Breast Density Classification 

VIDEO: The Impact of Breast Density Technology and Legislation 

VIDEO: Personalized Breast Screening and Breast Density 

VIDEO: Breast Cancer Awareness - Highlights of the NCoBC 2016 Conference 

Fake News: Having Dense Breast Tissue is No Big Deal 

The Manic World of Social Media and Breast Cancer: Gratitude and Grief 

Single vs. Multiple Architectural Distortion on Digital Breast Tomosynthesis 

Today's Mammography Advancements  

Digital Breast Tomosynthesis Spot Compression Clarifies Ambiguous Findings  

AI DBT Impact on Mammography Post-breast Therapy  

ImageCare Centers Unveils PINK Better Mammo Service Featuring Profound AI  

Radiologist Fatigue, Experience Affect Breast Imaging Call Backs  

Fewer Breast Cancer Cases Between Screening Rounds with 3-D Mammography 

Study Finds Racial Disparities in Access to New Mammography Technology 

American College of Radiology (ACR) Launches Contrast-Enhanced Mammography Imaging Screening Trial (CMIST) in Collaboration With GE Healthcare and the Breast Cancer Research Foundation