Feature | Artificial Intelligence | July 03, 2019 | By Greg Freiherr

Artificial Intelligence Boosts Radiologist Skills

AI should complement people, says SIIM presenter

AI should complement people, says SIIM presenter

Jeffrey D. Rudie, M.D., Ph.D., a radiology resident at the University of Pennsylvania, presenting at SIIM19.

Greg Freiherr

Greg Freiherr

Smart software improved the performance of resident radiologists to the level of academic experts in neuroradiology, according to research presented at the 2019 meeting of the Society of Imaging Informatics in Medicine (SIIM). Even on its own, the automated system, called ARIES (Adaptive Radiology Interpretive Education System), outperformed groups of radiologists who are not experts in neurology.

The presenter of data indicating the clinical power of this software advised against using artificial intelligence in place of radiologists. ARIES or similar technology could, however, improve the efficiency and accuracy of radiological decision-making, according to Jeffrey D. Rudie, M.D., Ph.D., a radiology resident at the University of Pennsylvania. This kind of technology, he said, has the potential to help radiologists meet the rising complexity and volume of medical imaging.

The ARIES automated system, which quantitatively characterizes brain MRIs, was designed to support diagnosis, prognosis and scientific discovery, according to Rudie and colleagues. According to data that Rudie presented June 28 during a SIIM session focused on machine learning technologies, ARIES performed at the level of academic neuroradiologists in diagnosing complex MRIs for 35 rare and common brain diseases.

 

Test Results Demonstrate Clinical Power

Test data, presented as part of Rudie’s talk, titled “Deep Learning and Bayesian Inference System for Automated Brain MR Diagnosis Performs at Level of Academic Neuroradiologists and Augments Resident Performance,” showed that, when used as an interactive clinical decision support tool, the system augmented the performance of radiology residents to the level of academic neuroradiologists.

When its results were compared to those of different groups of radiologists, ARIES achieved the same accuracy (84 percent) as academic neuro attendings. The system substantially outperformed community radiologists who were right only 52 percent of the time and radiology residents who — on their own — achieved 55 percent accuracy. (With ARIES help, the accuracy of a subgroup of radiology residents soared to 87 percent.)

Based on these tests, the greatest impact from this type of technology, Rudie concluded, may be to augment the diagnostic skills of radiologists with limited experience.

 

How ARIES Works

The automated system, which Rudie framed as a “proof of concept system,” mirrors the perceptual and cognitive steps of image interpretation. He described these as the “two fundamental steps” that people are trained to take when interpreting medical images.

The logic of the automated system comes from a combination of convolutional neural networks, image processing, and Bayesian networks, Rudie said. Abnormal signal features and spatial and anatomic subregion features derived from atlas-based images were combined with clinical information such as patient age, gender and immune status.

Despite ARIES’ stellar solo performance, Rudie insisted at the SIIM meeting that the system not be viewed as better than radiologists. Instead, it should be seen as an aide — its machine intelligence complementing that of people.

To support this contention, Rudie cited the results achieved by pairing ARIES with a subset of radiology residents. In the test, ARIES boosted the decision-making of radiology residents to 87 percent accuracy (compared to 53 percent when the subgroup of radiology residents were separately tested.)

Rudie and colleagues concluded that AI-based clinical decision support technology, such as ARIES, could significantly improve the accuracy and efficiency of image interpretation.

 

Greg Freiherr is a contributing editor to Imaging Technology News (ITN). Over the past three decades, he has served as business and technology editor for publications in medical imaging, as well as consulted for vendors, professional organizations, academia, and financial institutions.

 

Editor’s note: This article is the tenth and final piece in a content series by Greg Freiherr covering the Society for Imaging Informatics in Medicine (SIIM) conference in June.

 

Related content:

Are Shallow Networks Better Than Deep Ones?

How AI Might Provide a Safety Net for Patients and Providers 

Smart Algorithm Extracts Data from Radiology Reports 

PODCAST: Why Blockchain Matters In Medical Imaging

PODCAST: How to Fix Your Enterprise Imaging Network

PODCAST: 5 Low-Cost Ways To Slow Hackers

Cinebot: Efficient Creation of Movies and Animated Gifs for Presentation and Education Directly from PACS

DeepAAA Uses AI to Look Automatically For Aneurysms

Making AI Safe, Effective and Humane for Imaging

Related Content

Sponsored Content | Videos | Artificial Intelligence | February 21, 2020
In Artificial Intelligence at RSNA 2019, ITN Contributing Editor Greg Freiherr offers an overview of artificial intel
An example of the MRI scans showing long-term and short-term survival indications. #MRI

An example of the MRI scans showing long-term and short-term survival indications. Image courtesy of Case Western Reserve University

News | Magnetic Resonance Imaging (MRI) | February 21, 2020
February 21, 2020 — ...
Altamont’s zero-footprint solution, CaptureWare, allows Mach7’s Enterprise Imaging Platform (EIP) to ingest more DICOM and/or non-DICOM data from various sources in a facility
News | PACS | February 20, 2020
February 20, 2020 — Mach7 announced its partnership with Altamont
Sponsored Content | Videos | Enterprise Imaging | February 19, 2020
Bill Lacy, vice president, Medical Informatics at FUJIFILM Medic...
The Caption Guidance software uses artificial intelligence to guide users to get optimal cardiac ultrasound images in a point of care ultrasound (POCUS) setting.

The Caption Guidance software uses artificial intelligence to guide users to get optimal cardiac ultrasound images in a point of care ultrasound (POCUS) setting.

News | Artificial Intelligence | February 13, 2020
February 13, 2020 — The U.S.
The Candelis ImageGrid Plus PACS Server is an ultra-high-performance platform that can support high volume healthcare environments of 1,000 plus modalities
News | PACS | February 12, 2020
February 12, 2020 — The Candelis ImageGrid Plus...
Varian announced it has received FDA 510(k) clearance for its Ethos therapy, an Adaptive Intelligence solution. Ethos therapy is an artificial intelligence (AI)-driven holistic solution that provides an opportunity to transform cancer care.
News | Image Guided Radiation Therapy (IGRT) | February 11, 2020
February 11, 2020 — Varian announced it has received FDA 510(k) c
PaxeraHealth enterprise imaging, PACS, VNA solutions
News | Enterprise Imaging | February 11, 2020
February 11, 2020 — Enterprise Imaging developer PaxeraHealth
Mammograms of a 49-year-old woman with invasive lobular carcinoma on the right-side breast

Mammograms of a 49-year-old woman with invasive lobular carcinoma on the right-side breast. A small mass with micro-calcifications on the right-side breast was detected correctly by AI with an abnormality score of 96%. This case was recalled by 7 out of 14 radiologists (4 breast radiologists and 3 general radiologists) initially (without AI) and all 14 radiologists recalled this case correctly with the assistance of AI.

News | Artificial Intelligence | February 11, 2020
February 11, 2020 — A new study, published in...