Feature | Information Technology | July 01, 2019 | By Greg Freiherr

Are Shallow Networks Better Than Deep Ones?

“Shallow” learning promises better artificial intelligence, say SIIM presenters

David Anderson at SIIM

David Anderson presents information about the development of artificial Intelligence (AI) at SIIM 2019 as his father, Charles, looks on from a front row seat. The father-son team presented information at the SIIM annual meeting about their use of relatively shallow Deep Learning networks to analyze chest radiographs with AI.

Greg Freiherr

Greg Freiherr

Two simple neural networks are better than one complex one, according to a father-son team of entrepreneurs. On June 27 the two described “A Two-Stage Deep Learning Approach to Chest X-Ray Analysis” during the 2019 meeting of the Society of Imaging Informatics in Medicine in Denver.

 

Diagnostic decisions coming from models built using two “shallow” neural networks can lead to faster, more accurate and more interpretable artificial intelligence for radiography and other imaging modalities, according to David Anderson.

“When you have a literal deep (learning) network you have lots and lots of computational nodes and lots of layers of those nodes. A shallower network means that there are fewer computations so it is less math going on, which means you can look inside of it and see what it is doing — you can pull it apart,” Anderson told Imaging Technology News after the SIIM presentation.

He and his father, Charles, described their work at SIIM 2019 as a tag team — David presenting technical information first; Charles Anderson following with broader perspectives. Both men work at privately held Pattern Exploration, where Charles Anderson, Ph.D., is CEO; David is the machine learning developer.

David cited research1 & 2 into the automated analysis of chest X-ray images as the basis for the work done at Pattern Exploration. The use of “shallow” networks allows training with unlabelled data, which makes training less difficult and more efficient, he said. The use of these networks can also make the logic underlying AI less opaque.

 

Making the “Box” Transparent

Many have described deep learning as leading to algorithms that are “black boxes.” If shallower networks are used, however, the result “is not black at all — if you have the right tools,” David Anderson told ITN. “You can say, ‘Here is what this network is doing.’”

The two, five-layer networks that the Andersons developed to model X-ray analysis represent deep learning despite their relatively shallow depth. (Deep learning is a subset of machine learning, which is a type of artificial intelligence.) These two networks have separate tasks. One aligns the images into a standard orientation so the patient spine, for example, is presented vertically. The other does the classification.

Charles, who also serves as a professor of computer science at Colorado State University, focused on the potential impact of the research. He also raised the potential utility of a verbal interface. The computer science professor described during his presentation how such a verbal interface might be used. “It would allow you to ask a quick question — like you do with Siri — and come back with an answer in a spoken language,” he summarized later for ITN.

Supporting verbal Q & A would allow the radiologist to focus on the screen, rather than intermittently shifting attention to input devices. Radiologists have told Charles that their priorities are speed and confidence that their decisions are correct.

 

Greg Freiherr is a contributing editor to Imaging Technology News (ITN). Over the past three decades, he has served as business and technology editor for publications in medical imaging, as well as consulted for vendors, professional organizations, academia, and financial institutions.

 

Related content and references:

1. P. Rajpurkar, et al. (2017) CheXNet: Radiologist-Level Pneumonia Detection on Chest X-Rays with Deep Learning. https://arxiv.org/abs/1711.05225v3

2 I. M. Baltruschat, et al. (2018) Comparison of Deep Learning Approaches for Multi-Label Chest X-Ray Classification. https://arxiv.org/abs/1803.02315v1

How AI Might Provide a Safety Net for Patients and Providers

Editor’s note: This article is the ninth piece in a content series by Greg Freiherr covering the Society for Imaging Informatics in Medicine (SIIM) conference in June.

 

Related content:

How AI Might Provide a Safety Net for Patients and Providers 

Smart Algorithm Extracts Data from Radiology Reports 

PODCAST: Why Blockchain Matters In Medical Imaging

PODCAST: How to Fix Your Enterprise Imaging Network

PODCAST: 5 Low-Cost Ways To Slow Hackers

Cinebot: Efficient Creation of Movies and Animated Gifs for Presentation and Education Directly from PACS

DeepAAA Uses AI to Look Automatically For Aneurysms

Making AI Safe, Effective and Humane for Imaging

Related Content

iCAD's ProFound AI Wins Best New Radiology Solution in 2019 MedTech Breakthrough Awards
News | Computer-Aided Detection Software | September 09, 2019
iCAD Inc. announced MedTech Breakthrough, an independent organization that recognizes the top companies and solutions...
A smart algorithm has been trained on a neural network to recognize the appearance of breast cancer in MR images

A smart algorithm has been trained on a neural network to recognize the appearance of breast cancer in MR images. The algorithm, described at the SBI/ACR Breast Imaging Symposium, used deep learning, a form of machine learning, which is a type of artificial intelligence. Image courtesy of Sarah Eskreis-Winkler, M.D.

Feature | Society of Breast Imaging (SBI) | September 06, 2019 | By Greg Freiherr
The use of smart algorithms has the potential to make healthcare more efficient.
Philips and Fujifilm booths at SIIM 2019.

Philips and Fujifilm booths at SIIM 2019.

Feature | SIIM | September 06, 2019 | By Greg Freiherr
Pragmatism from cybersecurity to enterprise imaging was in vogue at the 2019 meeting of the Society of Imaging Inform
Sudhen Desai, M.D.

Sudhen Desai, M.D.

Feature | Pediatric Imaging | September 04, 2019 | By Jeff Zagoudis
Burnout has become a popular buzzword in today’s business world, meant to describe prolonged periods of stress in the
Heath information technology diagram showing use of cloud storage.
Feature | Archive Cloud Storage | September 04, 2019 | Tyna Callahan
In healthcare, critical systems are being used to deliver vital information and services 24x7x365.
Global Diagnostics Australia Incorporates AI Into Radiology Applications
News | Artificial Intelligence | September 04, 2019
Global Diagnostics Australia (GDA), a subsidiary of the Integral Diagnostics Group (IDX), has adopted artificial...
The CT scanner might not come with protocols that are adequate for each hospital situation, so at Phoenix Children’s Hospital they designed their own protocols, said Dianna Bardo, M.D., director of body MR and co-director of the 3D Innovation Lab at Phoenix Children’s.

The CT scanner might not come with protocols that are adequate for each hospital situation, so at Phoenix Children’s Hospital they designed their own protocols, said Dianna Bardo, M.D., director of body MR and co-director of the 3D Innovation Lab at Phoenix Children’s.

Sponsored Content | Case Study | Radiation Dose Management | September 04, 2019
Radiation dose management is central to child patient safety. Medical imaging plays an increasing role in the accurate...
Medical Imaging Rates Continue to Rise Despite Push to Reduce Their Use
News | Radiology Imaging | September 03, 2019
Despite a broad campaign among physician groups to reduce the amount of medical imaging, use rates of various scans...
The Siemens Ysio Max digital radiography system.
Webinar | Digital Radiography (DR) | September 03, 2019
The Webinar "Benefits of Advanced Automation in X-ray" will be presented Wednesday, Sept. 25 at 1 p.m.
A SPECT nuclear scan of the heart to show perfusion defects in the myocardium due to coronary artery blockages or heart attack. The imaging uses the Mo-99 based medical imaging isotope Tc-99m. The U.S. government has created policy to move away from use of highly enriched uranium (HEU) to low-enriched uranium (LEU) for Mo-99 isotope production, but there is one hold out who has not yet converted before a 2020 deadline. Photo courtesy of Philips Healthcare.

A SPECT nuclear scan of the heart to show perfusion defects in the myocardium due to coronary artery blockages or heart attack. The imaging uses the Mo-99 based medical imaging isotope Tc-99m. The U.S. government has created policy to move away from use of highly enriched uranium (HEU) to low-enriched uranium (LEU) for Mo-99 isotope production, but there is one holdout who has not yet converted before a 2020 deadline. Photo courtesy of Philips Healthcare.

Feature | Nuclear Imaging | August 30, 2019 | Dave Fornell, Editor
In a surprising move, the National Institute for Radioelements (IRE) has applied for a new license to export highly e