Feature | Artificial Intelligence | July 03, 2019 | By Greg Freiherr

Artificial Intelligence Boosts Radiologist Skills

AI should complement people, says SIIM presenter

AI should complement people, says SIIM presenter

Jeffrey D. Rudie, M.D., Ph.D., a radiology resident at the University of Pennsylvania, presenting at SIIM19.

Greg Freiherr

Greg Freiherr

Smart software improved the performance of resident radiologists to the level of academic experts in neuroradiology, according to research presented at the 2019 meeting of the Society of Imaging Informatics in Medicine (SIIM). Even on its own, the automated system, called ARIES (Adaptive Radiology Interpretive Education System), outperformed groups of radiologists who are not experts in neurology.

The presenter of data indicating the clinical power of this software advised against using artificial intelligence in place of radiologists. ARIES or similar technology could, however, improve the efficiency and accuracy of radiological decision-making, according to Jeffrey D. Rudie, M.D., Ph.D., a radiology resident at the University of Pennsylvania. This kind of technology, he said, has the potential to help radiologists meet the rising complexity and volume of medical imaging.

The ARIES automated system, which quantitatively characterizes brain MRIs, was designed to support diagnosis, prognosis and scientific discovery, according to Rudie and colleagues. According to data that Rudie presented June 28 during a SIIM session focused on machine learning technologies, ARIES performed at the level of academic neuroradiologists in diagnosing complex MRIs for 35 rare and common brain diseases.

 

Test Results Demonstrate Clinical Power

Test data, presented as part of Rudie’s talk, titled “Deep Learning and Bayesian Inference System for Automated Brain MR Diagnosis Performs at Level of Academic Neuroradiologists and Augments Resident Performance,” showed that, when used as an interactive clinical decision support tool, the system augmented the performance of radiology residents to the level of academic neuroradiologists.

When its results were compared to those of different groups of radiologists, ARIES achieved the same accuracy (84 percent) as academic neuro attendings. The system substantially outperformed community radiologists who were right only 52 percent of the time and radiology residents who — on their own — achieved 55 percent accuracy. (With ARIES help, the accuracy of a subgroup of radiology residents soared to 87 percent.)

Based on these tests, the greatest impact from this type of technology, Rudie concluded, may be to augment the diagnostic skills of radiologists with limited experience.

 

How ARIES Works

The automated system, which Rudie framed as a “proof of concept system,” mirrors the perceptual and cognitive steps of image interpretation. He described these as the “two fundamental steps” that people are trained to take when interpreting medical images.

The logic of the automated system comes from a combination of convolutional neural networks, image processing, and Bayesian networks, Rudie said. Abnormal signal features and spatial and anatomic subregion features derived from atlas-based images were combined with clinical information such as patient age, gender and immune status.

Despite ARIES’ stellar solo performance, Rudie insisted at the SIIM meeting that the system not be viewed as better than radiologists. Instead, it should be seen as an aide — its machine intelligence complementing that of people.

To support this contention, Rudie cited the results achieved by pairing ARIES with a subset of radiology residents. In the test, ARIES boosted the decision-making of radiology residents to 87 percent accuracy (compared to 53 percent when the subgroup of radiology residents were separately tested.)

Rudie and colleagues concluded that AI-based clinical decision support technology, such as ARIES, could significantly improve the accuracy and efficiency of image interpretation.

 

Greg Freiherr is a contributing editor to Imaging Technology News (ITN). Over the past three decades, he has served as business and technology editor for publications in medical imaging, as well as consulted for vendors, professional organizations, academia, and financial institutions.

 

Editor’s note: This article is the tenth and final piece in a content series by Greg Freiherr covering the Society for Imaging Informatics in Medicine (SIIM) conference in June.

 

Related content:

Are Shallow Networks Better Than Deep Ones?

How AI Might Provide a Safety Net for Patients and Providers 

Smart Algorithm Extracts Data from Radiology Reports 

PODCAST: Why Blockchain Matters In Medical Imaging

PODCAST: How to Fix Your Enterprise Imaging Network

PODCAST: 5 Low-Cost Ways To Slow Hackers

Cinebot: Efficient Creation of Movies and Animated Gifs for Presentation and Education Directly from PACS

DeepAAA Uses AI to Look Automatically For Aneurysms

Making AI Safe, Effective and Humane for Imaging

Related Content

The key trends Clinicians reviewing a COVID-19 patient's lung CT that reveals the severity of COVID-caused pneumonia. The impact of COVID on radiology was a major, over arching trend at  the 2020 Radiological Society of North America (RSNA) meeting. Getty Imagesbserved at 2020 Radiological Society of North America (RSNA) meeting all focused around COVID-19 (SARS-CoV-2) and the impact it has had on radiology. #RSNA #RSNA20 #RSNA2020

Clinicians reviewing a COVID-19 patient's lung CT that reveals the severity of COVID-caused pneumonia. The impact of COVID on radiology was a major, over arching trend at  the 2020 Radiological Society of North America (RSNA) meeting. Getty Images

Feature | RSNA | January 20, 2021 | By Melinda Taschetta-Millane and Dave Fornell
Vendor neutral archives enable a single, central location to store large volumes of radiology data, but now need to be able to house data from dozens of other departments with a wide array of data formats. This article originally ran as an introduction to the Vendor Neutral Archives comparison chart.
Feature | Vendor Neutral Archive (VNA) | January 20, 2021 | By Dave Fornell
Most radiologists and clinicians are not trained as...
AI Metrics, LLC, a medical imaging startup focused on augmented intelligence to improve patient care, announced today that the U.S. Food and Drug Administration (FDA) has granted 510(k) clearance for the company’s flagship image analysis platform.
News | Artificial Intelligence | January 18, 2021
January 18, 2021 — AI Metrics, LLC, a medical imaging startup focused on augmented intelligence to improve patient ca
This cutting-edge technology assists radiologists in the interpretation of screening mammograms and allows them to diagnose breast cancer earlier and more accurately
News | Mammography | January 12, 2021
January 12, 2021 — Therapixel announced that...
The U.S. Food and Drug Administration released the agency's first Artificial Intelligence/Machine Learning (AI/ML)-Based Software as a Medical Device (SaMD) Action Plan. This action plan describes a multi-pronged approach to advance the Agency's oversight of AI/ML-based medical software.
News | Artificial Intelligence | January 12, 2021
January 12, 2021 — The U.S.
Ultromics will offer its artificial intelligence driven EchoGo Pro as a stress-echo module in the EchoGo suite alongside EchoGo Core, its AI solution for automated systolic function and strain analysis. The EchoGo suite is a cloud-based service that uses artificial intelligence to fully automate the pathway to diagnosis, providing near-instant reports for clinicians without any need for physical software on site. #AI #AIhealthcare #AIecho

Ultromics will offer its artificial intelligence driven EchoGo Pro as a stress-echo module in the EchoGo suite alongside EchoGo Core, its AI solution for automated systolic function and strain analysis. The EchoGo suite is a cloud-based service that uses artificial intelligence to fully automate the pathway to diagnosis, providing near-instant reports for clinicians without any need for physical software on site.

News | Artificial Intelligence | January 06, 2021
January 6, 2021 — The U.S.
OptumInsight and Change Healthcare combine to advance a more modern, information and technology-enabled healthcare platform

Getty Images

News | Information Technology | January 06, 2021
January 6, 2020 — Optum, a diversified health services company and
#coronavirus #COVID19 #pandemic

Getty Images

News | Radiology Imaging | January 01, 2021
The Imaging Technology News (ITN) team wishes you a Happy and Healthy New Year!
Volpara Health announced two new research studies using AI-powered software to score breast density objectively and consistently to evaluate its impact in mammography and breast cancer risk assessment.
News | Breast Density | December 30, 2020
December 30, 2020 — Volpara Health announced two new research studies using...