Greg Freiherr, Industry Consultant
Greg Freiherr, Industry Consultant

Greg Freiherr has reported on developments in radiology since 1983. He runs the consulting service, The Freiherr Group.

Blog | Greg Freiherr, Industry Consultant | Artificial Intelligence | April 03, 2020

Why Artificial Intelligence Should Not Slip Into the Background

Now that artificial intelligence (AI) has clawed its way into the mainstream, some vendors want us to forget it is there

Now that artificial intelligence (AI) has clawed its way into the mainstream, some vendors want us to forget it is there. What really matters, they say, is the end result. Knowing that AI is the reason for the conclusions is a needless distraction, they say.

But being distracted may be better in the long run than not being able to judge the validity of the underlying process. If radiologists want to secure a future as key opinion leaders (KOL), they need to take control of AI now. Here’s why.

To Obscure — Or Not to Obscure

The argument in favor of cloaking AI goes like this: vendors will be tempted to use AI as a marketing tool, as in: “Our competitors don’t have AI — but we do.” This, to some degree, is already happening. 

Last year, as I walked the RSNA exhibit floor, vendors repeatedly name-dropped AI into conversations. This happened regardless of the product. When we spoke about PACS and its steroidal doppelganger, enterprise imaging, the mention of AI was all but impossible to avoid.

But a few vendors advocated a different tack. Their executives told me they would prefer AI to drop from sight. What matters, they said, is the bottom line — the effect, either clinical or operational, that AI has on the product. If the machine is more efficient and it makes medical practice less costly, it shouldn’t matter whether smart algorithms were involved. All that should matter is the end result.

The argument seemed to make sense. And, after being barraged by AI claims, I embraced it like a climber at the peak of Mount Everest offered an oxygen mask. Then it hit me.

The argument ASSUMES that the efficiencies coming from AI are without compromise. But what makes radiologists faster and their work less costly? With AI out of sight, it would be difficult to determine whether corners were cut, and certainly if the data underlying the technology was valid. 

The Distraction of AI

There is no question that AI can be used as a marketing tool. But that is the price of progress. It has been for decades. Look no further than the computed tomography (CT) slice wars of a few years ago.

Focusing on a specification is easier than understanding the often-complicated technology. But to be accepted, clinical answers derived from the use of machines require validation. And this is where radiologists can come in.

A critical step for radiologists to solidify their positions as future KOLs is to understand AI. Keeping AI from disappearing into the background is a big part of this argument.

Obscuring the thought process underlying a technology is akin to embedding it — and the AI — into “black boxes.” Writing in the March 2018 New England Journal of Medicine, David Magnus, Ph.D., director of the Stanford University Center for Biomedical Ethics, and his Stanford colleagues¹ stated that constructing machine learning systems as black boxes “could lead to ethically problematic outcomes.”  

A year later, in a March 2019 ITN podcast (http://bit.ly/3d8D4JH), Anthony Chang, M.D., went a step further. The pediatric cardiologist, acknowledged internationally as an expert in AI, said opacity threatens the credibility, even the adoption of AI. “We have to do our best to make it a glass box — not a black box,” Chang said.

Why Understanding is Essential 

Knowing the basics of how AI works — and how it affects the output of smart machines — is critically important, according to Bradley J. Erickson, M.D., a professor of radiology and director of the radiology informatics laboratory at the Mayo Clinic in Rochester, Minn. Speaking in an ITN podcast November 2018 (http://bit.ly/3a0raiZ), he said radiologists need a basic understanding of AI so they will know how it might fool us or give a spurious result.

Erickson’s cautionary statement may apply to AI being trained to interpret medical images, as well as applications such as the selection of tools for image interpretation; ones for fetching and orienting images from prior exams; and ones designed to accelerate the reporting process. The impact on the daily practice of medicine of machines with such operational capabilities could be enormous.

Computer-aided detection software and speech recognition systems have been using AI for years. These are in routine use today. And systems using AI could become even more prevalent in 2020, particularly in radiology, according to some vendors.

Given AI’s current and likely increasing footprint, it is essential that someone be able to verify that its use is better. For Charles E. Kahn, Jr., M.D., a professor and vice chair of radiology at the University of Pennsylvania Perelman School of Medicine in Philadelphia, that “someone” is the radiologist. In an ITN podcast in June 2019 (http://bit.ly/2IYbGQI), Kahn said “it is incumbent on all of us as radiologists, when we implement these systems, that we test them rigorously to make sure they work.”

Radiologists’ Opportunity 

Having the knowledge to look competently under the hood of prospective equipment could establish radiologists as being indispensable. If a vendor says an imaging engine has a metaphorical 8 cylinders, radiologists might be called on to count them and to render an opinion about whether those cylinders can power the vehicle as claimed. 

Once purchased, the continuing correct operation of AI-enhanced equipment would be essential. Radiologists could play a key role in this.

In short, when it comes to patient health, it makes sense to apply a Russian proverb that Ronald Reagan was fond of quoting: “Trust … but verify.” Radiologists, as the users of AI-enhanced imaging machines, have the inside track to provide that verification.

Greg Freiherr is consulting editor for ITN, and has reported on developments in radiology since 1983. He runs the consulting service, The Freiherr Group.

 

Reference:

1. Char DS, Shah NH, Magnus D. Implementing Machine Learning in Health Care — Addressing Ethical Challenges NEJM. 2018 Mar 15; 378(11): 981-983 — doi:10.1056/NEJMp1714229

Related Content

Mednax, a leading health solutions partner specializing in prenatal, neonatal, pediatric and radiology services, announced a number of steps it is taking as part of its aggressive transformational activity to position the company for long-term, sustainable growth
News | Radiology Business | June 05, 2020
June 5, 2020 — Mednax, a leading health solutions partner specializing in prenatal, neonatal, pediatric and radiology
Although it is likely that existing ultrasound systems will be repurposed to treat COVID-19 patients, growth is still expected as companies plan to ramp up production. The ultrasound systems market will therefore outpace other diagnostic imaging such as computed tomography (CT) and magnetic resonance imaging (MRI). Leading data and analytics company GlobalData forecasts the market will reach $6bn by 2028, but increased usage due to COVID-19 is anticipated have a tangible effect.
News | Ultrasound Imaging | June 05, 2020
June 5, 2020 — Although it is likely that existing...
Stephen M. Hahn, M.D., Commissioner of Food and Drugs - Food and Drug Administration, discussed The COVID-19 Pandemic — Finding Solutions, Applying Lessons Learned, on June 1

Stephen M. Hahn, M.D., Commissioner of Food and Drugs - Food and Drug Administration

News | Coronavirus (COVID-19) | June 05, 2020
June 5, 2020 — The following speech was delivere
Developed by medical AI company Lunit, Software detects breast cancer with 97% accuracy; Study in Lancet Digital Health shows that Lunit INSIGHT MMG-aided radiologists showed an increase in sensitivity

Lunit INSIGHT MMG

News | Artificial Intelligence | June 02, 2020
June 2, 2020 — Lunit announced that its artificia...
AIR Recon DL delivers shorter scans and better image quality (Photo: Business Wire)

AIR Recon DL delivers shorter scans and better image quality (Photo: Business Wire).

News | Artificial Intelligence | May 29, 2020
May 29, 2020 — GE Healthcare announced U.S.
The paradox is that COVID-19 has manifested the critical need for exactly what the rules require: advancement of interoperability and digital online access to clinical data and imaging, at scale, for care coordination and infection control.

The paradox is that COVID-19 has manifested the critical need for exactly what the rules require: advancement of interoperability and digital online access to clinical data and imaging, at scale, for care coordination and infection control. Getty Images

Feature | Coronavirus (COVID-19) | May 28, 2020 | By Matthew A. Michela
One year after being proposed, federal rules to advance interoperability in healthcare and create easier access for p
The opportunity to converge the silos of data into a cross-functional analysis can provide immense value during the COVID-19 outbreak and in the future

Getty Images

Feature | Coronavirus (COVID-19) | May 28, 2020 | By Jeff Vachon
In the midst of the coronavirus pandemic normal
AI has the potential to help radiologists improve the efficiency and effectiveness of breast cancer imaging

Getty Images

Feature | Breast Imaging | May 28, 2020 | By January Lopez, M.D.
Headlines around the world the past several months declared that...