Dave Fornell, ITN Editor
Dave Fornell, ITN Editor

Dave Fornell is the editor of ITN and DAIC magazines

Blog | Dave Fornell, ITN Editor | HIMSS | March 03, 2017 | Dave Fornell

Two Technologies That Offer a Paradigm Shift in Medicine at HIMSS 2017

augmented reality, virtual reality, medical imaging, surgery, Novarad, operating room

A view through a HoloLens augmented reality visor showing an overlaid brain image co-registered with a live patient on a table at HIMSS 2017.

Information technology (IT) is among the least sexy areas to cover in medical technology advances, and is often difficult to find really interesting news as I sift through more than 1,300 vendors at the massive annual Health Information and Management Systems Society (HIMSS) conference. However, at this year’s conference I found two exciting new technologies that I feel have the potential to become paradigm shifts in medicine. The first is the integration of artificial intelligence into medical imaging IT systems. The second, and coolest tech at HIMSS, was the use of augmented reality 3-D imaging visors to create a heads-up display of 3-D imaging anatomical reconstructions, or complete computed tomography (CT) or magnetic resonance imaging (MRI) datasets surgeons can use in the operating room (OR).

The medical imaging applications of augmented reality were shown by two vendors at HIMSS, although there were dozens of booths that had the same Microsoft HoloLens augmented reality visors with fun activities in attempts to draw in attendees. TeraRecon debuted its cloud-based augmented reality solution, the HoloPack Portal, which extends the TeraRecon 3-D viewing of CT scan anatomical reconstructions to true 3-D projected in a headset viewer to provide real 3-D image viewing using the Microsoft HoloLens visor. The system uses voice commands and finger movements to enlarge, shrink or rotate the 3-D images so surgeons do not have to break the sterile field in the OR.

Novarad showed a similar work-in-progress system using the HoloLens that allowed attendees to see registered CT and MRI datasets overlaid on a live patient on a table. Using hand and finger gestures in the air in front of the visitor, the user can go through the dataset slice by slice, or change the orientation of the slices. Novarad also showed a video of how the system would work in a real OR so surgeons can see the underlying anatomical structures for real-time navigation without needing to look at a reference screen across the room and ask someone else to change the view to what they need.

After attending HIMSS, I actually feel energized about the prospects artificial intelligence (AI) may offer medicine. But, unlike the science fiction image that snaps into most people’s minds when you talk about AI, it will not be a cool, interactive, highly intelligent robot that will replace doctors. In fact, most users will not even be aware AI is assisting them in the backend of their electronic medical record (EMR) systems. AI is a topic that has been discussed for a few years now at all the medical conferences I attend, but I saw some of my first concrete examples of how AI (also called deep learning or machine learning) will help clinicians to significantly reduce time and workflow efficiency. AI will accomplish this by working in the background as an overlay software system that sits on top of the  PACS, specialty reporting systems and medical image archives at a hospital.

The AI algorithms are taught through machine learning to recognize complex patterns and relations of specific types of data that are relevant to the image or disease states being reviewed. In one example I saw from Agfa’s new integration of IBM Watson’s AI, the system was smart enough to look at a digital X-ray image and realize the patient had lung cancer and evidence of prior lung and heart surgeries. It automatically searched for specific records for the patient from oncology treatments, cardiology, prior chest exams from various modalities, recent lab results and relevant patient information on their history of smoking.

Philips Healthcare showed its Illumeo adaptive intelligence software, which uses AI to speed workflow. The example demonstrated was for oncology, where a computed tomography (CT) exam showed several tumors. The user can hover and click on a specific piece of anatomy on a specific slice and orientation. The system then automatically pulls in prior CT scans of the game region and presents the images from each exam in the same slice and orientation as the current image. If the AI determines it is a tumor, the system also runs auto quantification of the tumor sizes from all the priors and presents them in a side-by-side comparison. The goal of the software is to greatly speed up workflow and assist doctors in their tasks.

AI is also making its appearance in business and clinical analytical software, as well as imaging modality software, where it can automatically identify all the organs and anatomy, orientate the images into the standard reading reviews and perform auto quantification. This is already available on some systems, including echocardiography for automated ejection fractions and wall motion assessments.  

Watch the VIDEO from HIMSS 2016 "Expanding Role for Artificial Intelligence in Medical Imaging."
 

Read the article from HIMSS 2017 "How Artificial Intelligence Will Change Medical Imaging."

Related Content

Radiologists of Leuwiliang General Hospital using Lunit INSIGHT CXR and INFINITT PACS G7

Radiologists of Leuwiliang General Hospital using Lunit INSIGHT CXR and Infinitt PACS G7.

News | Coronavirus (COVID-19) | January 27, 2021
January 27, 2021 — Lunit, a South Korean medical...
The key trends Clinicians reviewing a COVID-19 patient's lung CT that reveals the severity of COVID-caused pneumonia. The impact of COVID on radiology was a major, over arching trend at  the 2020 Radiological Society of North America (RSNA) meeting. Getty Imagesbserved at 2020 Radiological Society of North America (RSNA) meeting all focused around COVID-19 (SARS-CoV-2) and the impact it has had on radiology. #RSNA #RSNA20 #RSNA2020

Clinicians reviewing a COVID-19 patient's lung CT that reveals the severity of COVID-caused pneumonia. The impact of COVID on radiology was a major, over arching trend at  the 2020 Radiological Society of North America (RSNA) meeting. Getty Images

Feature | RSNA | January 20, 2021 | By Melinda Taschetta-Millane and Dave Fornell
Vendor neutral archives enable a single, central location to store large volumes of radiology data, but now need to be able to house data from dozens of other departments with a wide array of data formats. This article originally ran as an introduction to the Vendor Neutral Archives comparison chart.
Feature | Vendor Neutral Archive (VNA) | January 20, 2021 | By Dave Fornell
Most radiologists and clinicians are not trained as...
AI Metrics, LLC, a medical imaging startup focused on augmented intelligence to improve patient care, announced today that the U.S. Food and Drug Administration (FDA) has granted 510(k) clearance for the company’s flagship image analysis platform.
News | Artificial Intelligence | January 18, 2021
January 18, 2021 — AI Metrics, LLC, a medical imaging startup focused on augmented intelligence to improve patient ca
This cutting-edge technology assists radiologists in the interpretation of screening mammograms and allows them to diagnose breast cancer earlier and more accurately
News | Mammography | January 12, 2021
January 12, 2021 — Therapixel announced that...
The U.S. Food and Drug Administration released the agency's first Artificial Intelligence/Machine Learning (AI/ML)-Based Software as a Medical Device (SaMD) Action Plan. This action plan describes a multi-pronged approach to advance the Agency's oversight of AI/ML-based medical software.
News | Artificial Intelligence | January 12, 2021
January 12, 2021 — The U.S.
Ultromics will offer its artificial intelligence driven EchoGo Pro as a stress-echo module in the EchoGo suite alongside EchoGo Core, its AI solution for automated systolic function and strain analysis. The EchoGo suite is a cloud-based service that uses artificial intelligence to fully automate the pathway to diagnosis, providing near-instant reports for clinicians without any need for physical software on site. #AI #AIhealthcare #AIecho

Ultromics will offer its artificial intelligence driven EchoGo Pro as a stress-echo module in the EchoGo suite alongside EchoGo Core, its AI solution for automated systolic function and strain analysis. The EchoGo suite is a cloud-based service that uses artificial intelligence to fully automate the pathway to diagnosis, providing near-instant reports for clinicians without any need for physical software on site.

News | Artificial Intelligence | January 06, 2021
January 6, 2021 — The U.S.
OptumInsight and Change Healthcare combine to advance a more modern, information and technology-enabled healthcare platform

Getty Images

News | Information Technology | January 06, 2021
January 6, 2020 — Optum, a diversified health services company and