News | Mammography | September 15, 2016

$1M Digital Mammography Challenge Aims to Improve Accuracy of Mammograms

Contest aims to crowd-source machine learning algorithms to help reduce the false positive mammography rate

Digital Mammography DREAM Challenge, open-source competition, accuracy

September 15, 2016 — A coalition of oncology and technology partners led by Sage Bionetworks and DREAM Challenges last week announced the opening of the training phase for the Digital Mammography DREAM Challenge. The challenge is an open-science data competition designed to improve the accuracy of mammography screening.

With funding from Laura and John Arnold Foundation (LJAF), the challenge will award up to $1.2 million to data scientists, researchers and coding experts who develop predictive algorithms that achieve milestone goals related to reducing the recall rate of mammography screening.

The coalition supporting the challenge as organizers, sponsors, partners and advisors from the health, tech, regulatory and for-profit competition sectors includes: Amazon Web Services (AWS), the U.S. Food and Drug Administration (FDA), Group Health Cooperative, IBM, Icahn School of Medicine at Mount Sinai, Innocentive, the National Cancer Institute (NCI), Radish Medical and Seattle Cancer Care Alliance.

Each year, more than 40 million women in the United States undergo routine mammogram testing to screen for breast cancer. Mammograms are widely considered to be the most accessible and cost-effective breast cancer screening method. However, the United States Preventive Services Task Force and the American Cancer Society recently issued changes to recommendations regarding start age and frequency of screening. These changes are due, in part, to the large number of false-positive mammograms. One in 10 women undergoing screening mammography are recalled for diagnostic workup, of which fewer than 5 percent will eventually be found to have cancer. Recalled patients often experience stress and additional medical costs, and some require interventions including unnecessary biopsies.

The Digital Mammography DREAM Challenge, running from June 2016 through mid-2017, will seek to attract data experts from both inside and outside the medical field to develop predictive algorithms that will reduce false-positive mammograms while maintaining or improving cancer detection. Participants will be asked to create algorithms that will help doctors determine whether a patient’s mammogram has a high or low likelihood of harboring a breast cancer, and whether or not a patient should undergo additional testing. New algorithms may allow doctors to customize screening regimens for patients and identify women who would benefit from more or less frequent screening.

“Our goal is for the challenge to demonstrate that we can extract more information from mammograms than what meets the eye. Now that we are in an age where machines can train and learn how to recognize images, there is the possibility that machines can learn to recognize cancer-specific pixelated patterns in a digital mammogram that humans cannot detect. If highly accurate algorithms can help provide women with more clinically relevant and accurate information, then we can dramatically change the field of breast cancer screening,” explained Christoph Lee, M.D., of the Seattle Cancer Care Alliance and clinical advisor to the challenge.

To create the algorithms, participants will use anonymous patient data including nearly 650,000 digitized mammograms provided by the Group Health Cooperative through the NCI-funded Breast Cancer Surveillance Consortium and by the Icahn School of Medicine at Mount Sinai. Solvers’ algorithms will be evaluated against corresponding data on known patient outcomes, and scores will be assigned based on measures of accuracy. Algorithms that identify the fewest false positives while maintaining high rates of cancer detection will receive the highest ranking on the publicly accessible Challenge leaderboard. These medical images will be securely stored in the Amazon and IBM clouds.

“This Challenge holds great promise to improve breast cancer screening,” Group Health Cooperative Senior Investigator Diana Buist, Ph.D., said. “It is only possible through the long-term investment the National Cancer Institute has made in the Breast Cancer Surveillance Consortium, which provides real clinical data harmonized with gold standard cancer ascertainment.”

Challenge organizers are working to maximize the level of solver participation through a targeted marketing campaign and by directly engaging the combined solver communities of DREAM and Innocentive that together include more than 370,000 registered individuals from over 200 countries.

The challenge is also part of the Coding4Cancer initiative that was featured at Vice President Biden’s June 2016 National Cancer Moonshot Summit. Coding4Cancer seeks to drive improvements in cancer detection methods through the development of better algorithms for imaging tools.

Coding4Cancer will hold a second Challenge in 2017 to improve lung cancer screening techniques.

“The Digital Mammography DREAM Challenge is the start of a larger movement focused on using prizes and challenges to improve early cancer diagnosis,” LJAF Vice President of Science and Technology Michael Stebbins explained. “We are eager to hear more exciting ideas that will help to improve the use of medical imaging techniques to support early diagnosis.”

Due to the massive volume of data (more than 10 terabytes) and sensitivity of the challenge’s digitized mammograms, solvers will not have direct access to the data. Rather than the usual approach of bringing the data to the algorithm, in this challenge, organizers will bring solvers’ algorithms to the data for training and scoring. Generous sponsorships from both AWS and IBM are providing cloud computing for data hosting as well as the computational firepower needed to support solvers’ deep learning approaches for model training.

For more information: www.synapse.org

Related Content

RSNA Study Shows Real-Time Indicator Improves Mammographic Compression
News | Mammography | December 12, 2018
Sigmascreening recently announced that more than 100,000 women have had mammography exams with the Sensitive Sigma...
Massachusetts Superior Court Grants Hologic Preliminary Injunction in Trade Secrets Lawsuits
News | Mammography | December 12, 2018
December 12, 2018 — A Massachusetts Superior Court granted a preliminary injunction in lawsuits by Hologic against Ch
Videos | Mammography | December 10, 2018
Stamatia Destounis, M.D., FACR, associate professor, University of Rochester School of Medicine, and attending radiol
FDA Clears iCAD's ProFound AI for Digital Breast Tomosynthesis
Technology | Mammography | December 07, 2018
iCAD Inc. announced clearance by the U.S. Food and Drug Administration (FDA) for their latest, deep-learning, cancer...
Fujifilm Collaborates With Lunit on AI Pilot Project
News | Artificial Intelligence | December 05, 2018
Fujifilm Medical Systems USA Inc. announced a joint collaboration with Korean-based medical artificial intelligence (AI...
ScreenPoint Medical and Volpara Partner to Bring AI to Breast Imaging Clinics
News | Computer-Aided Detection Software | December 04, 2018
ScreenPoint Medical has signed a memorandum of understanding (MOU) with Volpara Health Technologies. Volpara will...
GE Healthcare Introduces Invenia ABUS 2.0
Technology | Ultrasound Women's Health | December 03, 2018
GE Healthcare recently launched the Invenia automated breast ultrasound (ABUS) 2.0 system in the United States. This...
Snoring Poses Greater Cardiac Risk to Women
News | Women's Health | November 29, 2018
Obstructive sleep apnea (OSA) and snoring may lead to earlier impairment of cardiac function in women than in men,...
ScreenPoint Medical Receives FDA Clearance for Transpara Mammography AI Solution
Technology | Computer-Aided Detection Software | November 28, 2018
November 28, 2018 — ScreenPoint Medical announced it has received 510(k) clearance from the U.S.
Women Benefit From Mammography Screening Beyond Age 75
News | Mammography | November 26, 2018
Women age 75 years and older should continue to get screening mammograms because of the comparatively high incidence of...