Feature | Information Technology | June 27, 2019 | By Greg Freiherr

Smart Algorithm Extracts Data from Radiology Reports

SIIM talk details early experience with data mining

Smart Algorithm Extracts Data from Radiology Reports
Greg Freiherr

Greg Freiherr

Radiology reports may contain information essential to figuring out a patient’s condition. But this information is often locked in free text, which can make it difficult to search, analyze and summarize report data.  That’s where natural language processing (NLP) might come in.

On June 26, 2019, IBM researcher Ashutosh Jadhav, Ph.D., described at the annual meeting of the Society for Imaging Informatics in Medicine (SIIM) in Denver an algorithm that uses artificial intelligence to extract information from the free text of radiology reports.

 “There is a lot of information hidden in these reports,” Jadhav told ITN after his presentation during the Natural Language Processing session. Included in that information are things like the physician’s findings. The extracted data might be used to automatically populate data fields in PACS.

Automatic structuring of radiology reports could unleash the power of information otherwise locked in these reports, he told an audience attending his presentation titled “Automatic Extraction of Structured Radiology Reports.” Jadhav and his colleagues are working to further improve the prototype, he said, noting that he cannot predict if or when the algorithm will be productized. “Our work is majorly focused on the research aspect,” he told ITN after his presentation. Jadhav is a research staff member at IBM Research Almaden, IBM's Silicon Valley innovation lab.


Extensive Research

In developing the NLP algorithm, Jadhav and colleagues had to overcome challenges including missing section labels, inconsistent section ordering, and inconsistent section formatting. Differences among institutions and individual radiologists should not be issues, he told ITN, because “we have a really big sample size and we are processing reports from multiple institutes.”

Radiology reports from more than 200,000 chest X-rays were used to develop the algorithm. These reports were randomly split into training and testing data sets. The training data set, comprised of about 80 percent of these reports, was used to develop NLP rules. The remaining 20 percent comprised the data set used for testing. Some 200 reports, randomly selected from the testing set, were used to determine how well the algorithm identified sections and corresponding section texts.


Greg Freiherr is a contributing editor to Imaging Technology News (ITN). Over the past three decades, he has served as business and technology editor for publications in medical imaging, as well as consulted for vendors, professional organizations, academia, and financial institutions.


Editor’s note: This article is the seventh piece in a content series by Greg Freiherr covering the Society for Imaging Informatics in Medicine (SIIM) conference in June.


Related content:

Why Blockchain Matters In Medical Imaging

DeepAAA Uses AI to Look Automatically For Aneurysms

Making AI Safe, Effective and Humane for Imaging

Cinebot: Efficient Creation of Movies and Animated Gifs for Presentation and Education Directly from PACS

5 Low-Cost Ways To Slow Hackers

Imaging on Verge of Game-changing Transformation

How to Fix Your Enterprise Imaging Network

Imaging on Verge of Game-changing Transformation

VIDEO: AI That Second Reads Radiology Reports and Deals With Incidental Findings

AI Detects Unsuspected Lung Cancer in Radiology Reports, Augments Clinical Follow-up 

Related Content

Varian Unveils Ethos Solution for Adaptive Radiation Therapy
News | Image Guided Radiation Therapy (IGRT) | September 16, 2019
At the 2019 American Society for Radiation Oncology (ASTRO) annual meeting, being held Sept. 15-18 in Chicago, Varian...
FDA Clears GE Healthcare's Critical Care Suite Chest X-ray AI
Technology | X-Ray | September 12, 2019
GE Healthcare announced the U.S. Food and Drug Administration’s (FDA) 510(k) clearance of Critical Care Suite, a...
Richardson Healthcare Receives CE Mark Approval for ALTA750 Canon/Toshiba CT Replacement Tube
News | Computed Tomography (CT) | September 11, 2019
Richardson Healthcare, a Division of Richardson Electronics Ltd., announced it has received CE Mark approval for the...
iCAD's ProFound AI Wins Best New Radiology Solution in 2019 MedTech Breakthrough Awards
News | Computer-Aided Detection Software | September 09, 2019
iCAD Inc. announced MedTech Breakthrough, an independent organization that recognizes the top companies and solutions...
Imaging Biometrics and Medical College of Wisconsin Awarded NIH Grant
News | Neuro Imaging | September 09, 2019
Imaging Biometrics LLC (IB), in collaboration with the Medical College of Wisconsin (MCW), has received a $2.75 million...
A smart algorithm has been trained on a neural network to recognize the appearance of breast cancer in MR images

A smart algorithm has been trained on a neural network to recognize the appearance of breast cancer in MR images. The algorithm, described at the SBI/ACR Breast Imaging Symposium, used deep learning, a form of machine learning, which is a type of artificial intelligence. Image courtesy of Sarah Eskreis-Winkler, M.D.

Feature | Society of Breast Imaging (SBI) | September 06, 2019 | By Greg Freiherr
The use of smart algorithms has the potential to make healthcare more efficient.
Philips and Fujifilm booths at SIIM 2019.

Philips and Fujifilm booths at SIIM 2019.

Feature | SIIM | September 06, 2019 | By Greg Freiherr
Pragmatism from cybersecurity to enterprise imaging was in vogue at the 2019 meeting of the Society of Imaging Inform
Sudhen Desai, M.D.

Sudhen Desai, M.D.

Feature | Pediatric Imaging | September 04, 2019 | By Jeff Zagoudis
Burnout has become a popular buzzword in today’s business world, meant to describe prolonged periods of stress in the
Heath information technology diagram showing use of cloud storage.
Feature | Archive Cloud Storage | September 04, 2019 | Tyna Callahan
In healthcare, critical systems are being used to deliver vital information and services 24x7x365.
OSF HealthCare Expands Portfolio of Carestream Imaging Solutions
News | Digital Radiography (DR) | September 04, 2019
OSF HealthCare in Peoria, Ill., recently added a new Carestream DRX-Evolution Plus System to its portfolio of...