Feature | Information Technology | February 27, 2019 | Tatyana Shavel

Augmented Reality is Taking Over Radiology Training

Augmented reality can be used to educate and train radiologists, improving their expertise and skills

EchoPixel allows radiologists to see CT, MRI and ultrasound scans in 3-D

EchoPixel allows radiologists to see CT, MRI and ultrasound scans in 3-D.

Tatyana Shavel

Tatyana Shavel

Medical images take a significant part in patient diagnostics across different care cycle points, including regular screening, diagnosis verification, perioperative planning and follow-up checkup. Accordingly, scanning equipment vendors and clinical stakeholders invest their efforts into improving the quality of the images across different modalities, accelerating their automatic processing algorithms, or even enabling preliminary analysis and segmentation to facilitate accurate scan interpretation and avoid costly medical errors.

Nevertheless, interpretation errors still happen. Due to the complexity of the radiology field itself, a specialist may fail to identify an abnormality on an image, incorrectly classify it or report the findings. For example, one of the studies dedicated to radiology practice errors estimates 3 to 5 percent of cognitive and perceptual errors occur daily across different modalities, such as computed tomography (CT), magnetic resonance imaging (MRI), ultrasound and X-ray.

While it is impossible to get rid of misinterpretation cases completely, there might be a way to reduce their occurrence with the help of technology, namely augmented reality (AR). It can be used to educate and train radiologists, improving their expertise and skills by allowing them to review a bigger variety of medical cases as well as refresh human anatomy variations.

 

Why Augmented Reality

Unlike virtual reality that blocks the user’s real-world surrounding, AR enhances it via superimposing digital images on the user’s view of their environment.

Augmented reality is already harnessed in clinical settings for medical training, intervention guidance and patient education, getting extensive investments. The global healthcare AR market is expected to reach $1.32 billion by 2023 and features a range of players from startups to more mature companies, including AccuVein, Orca Health, Iflexion, Brain Power, Augmedix and more.

AR-enhanced radiology training is already commercially available and studied across different modalities. We reviewed some of them to evaluate the potential this technology holds in terms of helping pathologists to
fine-tune their image interpretation skills. This article features two really interesting market and research cases we encountered.

 

Multimodality 3-D System

California-based EchoPixel specifies the limitations in current patient anatomy visualization approaches that force pathologists and radiologists to solve three-dimensional problems by analyzing two-dimensional images. Usually, medical specialists have to process CT, MRI and other medical scans in their minds, integrating a series of received 2-D images into a 3-D picture of the inspected organ, vessel or tissue as well as the surrounding anatomy. This difference in actual and perceived image may hinder the diagnosis verification or even lead to image misinterpretation.

The company bridges this gap and addresses the 2-D image interpretation complexity issue with their proprietary True 3D system. This solution works with HP Zvr displays, which feature four cameras to trace the user’s head motions and 3-D glasses to transform patient-specific medical images into interactive and three-dimensional AR models. Radiologists and other health specialists can view medical scans with organs, tissues, vessels and suspected abnormalities in 3-D, interact with them in real time, and even dissect the chosen objects with the help of a stylus.

The system creates an unprecedented opportunity for a wide range of medical specialists, facilitating diagnostics, surgical planning and medical education. Radiologists and pathologists can use True 3D to amplify their expertise, gain deeper human anatomy understanding, refresh knowledge and review questionable cases from a different perspective. For example, the system can be particularly useful for tumor response quantification and evaluation after the chemotherapy course across many oncology types and stages.

Currently, PennState Health and Texas A&M Health Science Center use the True 3D system in research and medical training.

 

Research: Mammographic Interpretation Training Study

According to a 2018 study, conventional training for radiologists still lacks a technical approach. In particular, they report that mammogram interpretation training highly depends on manual segmentation and transcription. With this approach, radiologists and pathologists in training may not receive real-time feedback on their progress and thus won’t be able to grasp some of the interpretation process intricacies emerging from the more advanced training method.

The researchers review the hypothesis of using augmented reality to create an automated training system, backing up current screening education techniques. They propose a system with a cyclic data flow, stylus support for precise interaction with the image, and a virtual menu for easy navigation.

One of its key advantages is that such a system will be independent of a workstation, introducing convenience and mobility into screening education. A trainee shouldn’t switch between different stations to view an image in one location and record their annotations somewhere else, as it usually happens. The system allows superimposing scans onto different surfaces, offering an uninterrupted learning process.

Moreover, the proposed augmented reality training solution allows training progress by recording and saving of achieved transcriptions and annotated markers. It then processes results for further training or post-training.

Since the system should be able to collect and recognize each operation made by the trainee, the separate features of abnormalities, such as breast carcinomas, can be analyzed individually and automatically. Apart from improving screening education, this ability can also boost the research and development process in clinical trials for oncology treatment or offer more precise post-treatment condition evaluation.

With its real-time feedback feature, the proposed AR system will allow both starting and mature health specialists to improve their image interpretation performance. And if it will be able to accumulate training data and analyze it continuously, the system can be further used in clinical trials and decision-making.

 

AR Ready to Revolutionize Radiology Training

Not yet widely adopted, augmented reality holds a big potential for revolutionizing medical education for radiologists and pathologists. We already see how AR is being appreciated in scientific and clinical communities.

Researchers and commercial users believe that technology is able to boost the learning curve for starting health specialists as well as deepen the existing expertise of more mature professionals, ultimately reducing medical image misinterpretation cases. We support this claim and anticipate AR becoming the standard practice for medical image interpretation training in the near future.

 

Tatyana Shavel is a VR/AR technology analyst at Iflexion. She works in the intersection of business and technology, exploring the practical use of augmented and virtual reality for smarter business and a better world. In addition to keeping a constant pulse on industry trends, she enjoys digging into data and conducting research.

 

Related VR and AR Content:

VIDEO: Using Virtual and Augmented Reality to Examine Brain Anatomy and Pathology at MD Anderson

Virtual Reality Boosts Revenues and Patient Understanding

Augmented Reality is Taking Over Radiology Training

VIDEO: Augmented Reality for Surgical Planning Example

Philips and Microsoft Showcase Augmented Reality for Image-Guided Minimally Invasive Therapies

Reimagining Brain Surgery 

VR in the OR 

Radiologist Uses Virtual Reality as Interventional Radiology Teaching Tool 

 

Related Content

Selecting an AI Marketplace for Radiology: Key Considerations for Healthcare Providers
Feature | Artificial Intelligence | October 18, 2019
October 18, 2019 — As the nascent market for...
Surgical Institute of Reading Chooses RamSoft's PowerServer Lite PACS
News | PACS | October 18, 2019
Surgical Institute of Reading recently selected RamSoft’s PowerServer Lite PACS (picture archiving and communication...
While electronic medical record systems have helped consolidate most patient data into one location, medical imaging IT systems has proved to be more difficult to replicate by large EMR vendors. This has made room in the market for third-party radiology IT vendors that allow easy integration with the larger EMRs like Epic and Cerner. This image shows Agfa's enterprise imaging system, leveraging its ability to be accessed anywhere with internet connection and pull images from radiology and surgery.

While electronic medical record systems have helped consolidate most patient data into one location, medical imaging IT systems has proved to be more difficult to replicate by large EMR vendors. This has made room in the market for third-party radiology information system vendors that allow easy integration with the larger EMRs like Epic and Cerner. This image shows Agfa's enterprise imaging system, leveraging its ability to be accessed anywhere with an internet connection and able to pull in images from both radiology and surgery. 

Feature | Enterprise Imaging | October 17, 2019 | Steve Holloway
October 17, 2019 — The growing influence and uptake of electronic medical records (EMRs) in healthcare has driven deb
USF Health Expands Digisonics System With Vascular Reporting
News | Cardiac PACS | October 17, 2019
University of South Florida (USF) Health in Tampa, Fla., has enhanced their use of the Digisonics Cardiovascular...
Intelerad's nuage Patient Portal

Intelerad's nuage Patient Portal. Image courtesy of Intelerad.

News | Enterprise Imaging | October 17, 2019
Intelerad Medical Systems announced that OneWelbeck, a London operator of specialist facilities for minimally-invasive...
An illustration of radiology department analytics data showing GE Healthcare’s business analytics software.

An illustration of radiology department analytics data showing GE Healthcare’s business analytics software.

Feature | Radiology Business | October 17, 2019 | By April Wilson
According to IBM, the world creates 2.5 quintillion bytes of data daily.
Image courtesy of Bethesda Health

Image courtesy of Bethesda Health

Feature | Radiology Business | October 17, 2019 | By Susan DeCathelineau
Few professions have experienced the dramatic changes that radiologists have over the past few years.
Using Compressed SENSE for faster MRI scans, healthcare providers can transform their radiology workflow.

Using Compressed SENSE for faster MRI scans, healthcare providers can transform their radiology workflow.

Sponsored Content | Case Study | Magnetic Resonance Imaging (MRI) | October 16, 2019
Since the introduction of magnetic resonan...
Feature | Artificial Intelligence | October 16, 2019 | By Siddharth (Sid) Shah
The period between November through February is pretty interesting for the field of medical imaging — two major confe
At the annual meeting of the AHRA, Agfa Healthcare demonstrated a full-scale model of its DR 800, presenting the unit as a "game changer" for its multifunctionality.

At the annual meeting of the AHRA, Agfa Healthcare demonstrated a full-scale model of its DR 800, presenting the unit as a "game changer" for its multifunctionality.

Feature | AHRA | October 16, 2019 | By Greg Freiherr
Diversity was on display at the Association for Medical Imaging Mana...