May 11, 2023 — The Radiological Society of North America (RSNA) has announced the results of the RSNA Screening Mammography Breast Cancer Detection AI Challenge. The latest in a series of such research competitions that RSNA has conducted since 2015, this challenge tasked participants with developing artificial intelligence (AI) models that can accurately detect breast cancer from mammography images, potentially assisting radiologists in making more accurate and timely diagnoses.
Breast cancer is the most commonly occurring cancer worldwide, according to the World Health Organization. In 2020 alone, there were 2.3 million new breast cancer diagnoses and 685,000 deaths.
Breast cancer screening has been shown to reduce cancer fatalities. AI tools have the potential to make screening more efficient and effective.
“Although there is a worldwide shortage of radiologists to interpret screening mammograms, radiologists remain concerned about how well the AI systems will work in their patient population,” said Dr. Linda Moy, a professor of radiology at the NYU Grossman School of Medicine and editor of the journal Radiology. “This diverse well-curated dataset may be used to assess the generalizability to diverse patient populations. This RSNA Mammography AI Challenge will catalyze collaboration to improve the diagnostic accuracy of screening mammography and save patients’ lives.”
The challenge, hosted on a platform provided by Kaggle, Inc. (an Alphabet company), attracted nearly 1,700 teams from around the world. The competition was launched November 28, 2022, and ran through February 2023. The prize-winning solutions were then reviewed by a team of volunteer AI experts to confirm the results. The eight teams submitting the highest-scoring algorithms shared in $50,000 total prize money.
The winning teams in the RSNA Screening Mammography Breast Cancer Detection AI Challenge are:
The review committee also awarded the Educational Merit Award to the mr.robot team for the clarity of their solution and accompanying presentation materials.
The dataset used in the challenge was contributed by mammography screening programs in Australia and the United States. It includes detailed labels with radiologists’ evaluations and follow-up pathology results for suspected malignancies. The dataset will remain available for use in further research.
This challenge is part of a broader research project that will examine how models generated in the competition perform against previously unseen data and compare their performance to that of expert human observers. These questions are critical in determining how AI tools will perform in clinical settings.
“The number of participants we had in this competition was amazing and reflects the high levels of interest in using large, high-quality datasets to advance the state of the art in mammographic diagnosis,” said Dr. John Mongan, a professor of radiology at the University of California, San Francisco and chair of the RSNA Machine Learning Steering Committee. “We expect that the dataset and the work of the contestants will provide an ideal foundation for rapid advance in breast imaging AI.”
For more information on the challenge, visit RSNA.org/AI-image-challenge
Related Breast Imaging Content:
VIDEO: Research and Advancements in Breast Imaging Technology
VIDEO: FDA Update on the US National Density Reporting Standard - A Discussion on the Final Rule
One on One … with Wendie Berg, MD, PhD, FACR, FSBI
Creating Patient Equity: A Breast Density Legislative Update
FDA Needs to Ensure that Information on Dense Breast Notifications are Clear and Understandable to all Members of the Public
AI Provides Accurate Breast Density Classification
VIDEO: The Impact of Breast Density Technology and Legislation
VIDEO: Personalized Breast Screening and Breast Density
VIDEO: Breast Cancer Awareness - Highlights of the NCoBC 2016 Conference
Fake News: Having Dense Breast Tissue is No Big Deal
The Manic World of Social Media and Breast Cancer: Gratitude and Grief
Single vs. Multiple Architectural Distortion on Digital Breast Tomosynthesis
Today's Mammography Advancements
Digital Breast Tomosynthesis Spot Compression Clarifies Ambiguous Findings
AI DBT Impact on Mammography Post-breast Therapy
ImageCare Centers Unveils PINK Better Mammo Service Featuring Profound AI
Radiologist Fatigue, Experience Affect Breast Imaging Call Backs
Fewer Breast Cancer Cases Between Screening Rounds with 3-D Mammography
Study Finds Racial Disparities in Access to New Mammography Technology
American College of Radiology (ACR) Launches Contrast-Enhanced Mammography Imaging Screening Trial (CMIST) in Collaboration With GE Healthcare and the Breast Cancer Research Foundation