News | Artificial Intelligence | December 03, 2019

AI Improves Chest X-ray Interpretation

#RSNA19 A sophisticated type of artificial intelligence (AI) can detect clinically meaningful chest X-ray findings as effectively as experienced radiologists, according to a study published in the journal Radiology.

Image courtesy of GE Healthcare

December 3, 2019 — A sophisticated type of artificial intelligence (AI) can detect clinically meaningful chest X-ray findings as effectively as experienced radiologists, according to a study published in the journal Radiology. Researchers said their findings, based on a type of AI called deep learning, could provide a valuable resource for the future development of AI chest radiography models.

Chest radiography, or X-ray, one of the most common imaging exams worldwide, is performed to help diagnose the source of symptoms like cough, fever and pain. Despite its popularity, the exam has limitations.

“We’ve found that there is a lot of subjectivity in chest X-ray interpretation,” said study co-author Shravya Shetty, an engineering lead at Google Health in Palo Alto, Calif. “Significant inter-reader variability and suboptimal sensitivity for the detection of important clinical findings can limit its effectiveness.”

Deep learning, a sophisticated type of AI in which the computer can be trained to recognize subtle patterns, has the potential to improve chest X-ray interpretation, but it too has limitations. For instance, results derived from one group of patients cannot always be generalized to the population at large.

Researchers at Google Health developed deep learning models for chest X-ray interpretation that overcome some of these limitations. They used two large datasets to develop, train and test the models. The first dataset consisted of more than 750,000 images from five hospitals in India, while the second set included 112,120 images made publicly available by the National Institutes of Health (NIH).

A panel of radiologists convened to create the reference standards for certain abnormalities visible on chest X-rays used to train the models.

“Chest X-ray interpretation is often a qualitative assessment, which is problematic from deep learning standpoint,” said Daniel Tse, M.D., product manager at Google Health. “By using a large, diverse set of chest X-ray data and panel-based adjudication, we were able to produce more reliable evaluation for the models.”

Tests of the deep learning models showed that they performed on par with radiologists in detecting four findings on frontal chest X-rays, including fractures, nodules or masses, opacity (an abnormal appearance on X-rays often indicative of disease) and pneumothorax (the presence of air or gas in the cavity between the lungs and the chest wall).

Radiologist adjudication led to increased expert consensus of the labels used for model tuning and performance evaluation. The overall consensus increased from just over 41 percent after the initial read to more than almost 97 percent after adjudication.

The rigorous model evaluation techniques have advantages over existing methods, researchers said. By beginning with a broad, hospital-based clinical image set, and then sampling a diverse set of cases and reporting population adjusted metrics, the results are more representative and comparable. Additionally, radiologist adjudication provides a reference standard that can be both more sensitive and more consistent than other methods.

“We believe the data sampling used in this work helps to more accurately represent the incidence for these conditions,” Tse said. “Moving forward, deep learning can provide a useful resource to facilitate the continued development of clinically useful AI models for chest radiography.”

“The NIH database is a very important resource, but the current labels are noisy, and this makes it hard to interpret the results published on this data,” Shetty said. “We hope that the release of our labels will help further research in this field.”

For more information: www.rsna.org

Related Content

Developed by medical AI company Lunit, Software detects breast cancer with 97% accuracy; Study in Lancet Digital Health shows that Lunit INSIGHT MMG-aided radiologists showed an increase in sensitivity

Lunit INSIGHT MMG

News | Artificial Intelligence | June 02, 2020
June 2, 2020 — Lunit announced that its artificia...
AIR Recon DL delivers shorter scans and better image quality (Photo: Business Wire)

AIR Recon DL delivers shorter scans and better image quality (Photo: Business Wire).

News | Artificial Intelligence | May 29, 2020
May 29, 2020 — GE Healthcare announced U.S.
Largest case series (n=30) to date yields high frequency (77%) of negative chest CT findings among pediatric patients (10 months-18 years) with COVID-19, while also suggesting common findings in subset of children with positive CT findings

A and B, Unenhanced chest CT scans show minimal GGOs (right lower and left upper lobes) (arrows) and no consolidation. Only two lobes were affected, and CT findings were assigned CT severity score of 2. Image courtesy of American Journal of Roentgenology (AJR)

News | Coronavirus (COVID-19) | May 29, 2020
May 29, 2020 — An investigation published open-access in the ...
AI has the potential to help radiologists improve the efficiency and effectiveness of breast cancer imaging

Getty Images

Feature | Breast Imaging | May 28, 2020 | By January Lopez, M.D.
Headlines around the world the past several months declared that...
United Imaging's uMR OMEGA is designed to provide greater access to magnetic resonance imaging (MRI) with the world’s first ultra-wide 75-cm bore 3T MRI.
News | Magnetic Resonance Imaging (MRI) | May 27, 2020
May 27, 2020 — United Imaging's...
There were several new developments in digital radiography (DR) technology at the 2019 Radiological Society of North America (RSNA) annual meeting. These trends included integration of artificial intelligence (AI) auto detection technologies, more durable glassless detector plates, and technologies to pull more diagnostic data out of X-ray imaging. Some vendors also have redesigned their DR systems to make them more user-friendly and ergonomic. 
Feature | Digital Radiography (DR) | May 26, 2020 | By Dave Fornell
There were several new developments in digital rad...
An example of DiA'a automated ejection fraction AI software on the GE vScan POCUS system at RSNA 2019.

An example of DiA'a automated ejection fraction AI software on the GE vScan POCUS system at RSNA 2019. Photo by Dave Fornell.

News | Ultrasound Imaging | May 26, 2020
May 12, 2020 — DiA Imaging Analysis, a provider of AI based ultrasound analysis solutions, said it received a governm