News | Interventional Radiology | April 10, 2019

Smart Speaker Technology Harnessed for Hospital Medical Treatments

Research demonstrates value of Amazon Echo and Google Home during medical procedures

Smart Speaker Technology Harnessed for Hospital Medical Treatments

April 10, 2019 —Smart speakers customarily used in your living room can act as an aid to physicians in hospital operating rooms, according to new research presented at the Society of Interventional Radiology’s (SIR) 2019 Annual Scientific Meeting, March 23-28 in Austin, Texas. Smart speakers, such as the Amazon Echo and Google Home, offer a conversational voice interface that allows interventional radiology (IR) physicians to ask questions and retrieve information needed for their patient treatments without breaking sterile scrub.

“During treatment, IRs rely on nuanced medical information delivered in a timely manner. When you’re in the middle of a procedure, you need to remain sterile, so you lose the ability to use a computer,” said Kevin Seals, M.D., a fellow in interventional radiology at the University of California, San Francisco (UCSF) and lead author of the study. “This smart speaker technology helps us to quickly and intelligently make decisions relevant to a patient’s specific needs.”

The researchers at UCSF developed a device-sizing application for the Google Home smart speaker. The application processes questions from a human voice and provides recommendations on the precise sizing of medical devices. For example, if an IR needs to know what size sheath to use to implant a stent in a patient’s blood vessel, the smart speaker can quickly and accurately communicate the correct size based on the specific circumstances, which helps the physician in making a final decision.

“There are hundreds of devices, with more being introduced every day, making it difficult to determine the correct sizing or materials needed in every circumstance. This technology allows physicians to concentrate more closely on the care of their patients, devoting less time and mental energy to device technicalities,” said Seals.

In developing the application, size specifications were acquired using literature reviews for 475 IR devices, such as catheters, sheaths, stents, vascular plugs and others. Natural language processing was implemented using Dialogflow, which extracted the information of interest from an input query. Logic operations and other data processing were performed using a Python script deployed to the cloud.

The researchers plan to continue to build on this technology and expand its scope to include information on material costs and inventory databases. Having this information readily available will make treatments more efficient, cost-effective and beneficial to patients. Further research will look to yield information for physicians in other specialties and provide information from electronic health records and patient clinical data, such as allergies or prior surgeries.

For more information: www.sirmeeting.org

Related Content

Atrium Health Debuts Amazon Alexa Skill to Help Patients Access Medical Care

Reference

1. Seals K., Al-Hakim R., Mulligan P., et al. Abstract 38: The Development of a Machine Learning Smart Speaker Application for Device Sizing in Interventional Radiology. Presented at SIR 2019.

Related Content

Sponsored Content | Videos | Enterprise Imaging | January 20, 2020
GE Healthcare's iCenter is a cloud-based management software that provides 24/7 visibility to customers' visual and o
Konica Minolta Business Solutions, U.S.A., Inc. (Konica Minolta) announced its status as a Google Cloud Premier Partner.
News | Archive Cloud Storage | January 14, 2020
January 14, 2020 — ...
This is artificial intelligence on Fujifilm's mobile digital radiography system to immediately detect pneumothorax (a collapsed lung) and show the location to the technologist and attending physician in a unit before the image is even uploaded to the PACS for a read. AI applications like this that have immediate impact on critical patient care saw a lot of interest at RSNA 2019.

This is work-in-progress artificial intelligence app on Fujifilm's mobile digital radiography system to immediately detect pneumothorax (a collapsed lung), The AI highlights the area of interest to show the location to the technologist and attending physician in a unit before the image is even uploaded to the PACS for a read by a radiologist. The technology also can flag the study for an immediate read in the PACS worklist for confirmation by a human. This technology is from a third-party and will be offered on Fujifilm's REiLI AI platform. Applications like this that have immediate impact on critical patient care saw a lot of interest at RSNA 2019. Photos by ITN Editor Dave Fornell.

Feature | Artificial Intelligence | December 27, 2019 | Siddharth Shah and Srikanth Kompalli, Frost & Sullivan
Radiology artificial intelligence (AI) was again the hottest topic at the 2019...
News | Remote Viewing Systems | December 27, 2019
December 27, 2019 — The Radiological Society of North America (RSNA) and Carequality have developed the Imaging Data
The company has selected Flywheel to support data management and curation and gain efficiencies in their machine learning workflow
News | Artificial Intelligence | December 16, 2019
December 16, 2019 — MaxQ AI, a company focus
The RIS market is expected to reach $979.1 M by 2025

Image courtesy of Agfa

News | Information Technology | December 13, 2019
December 13, 2019 — According to a new study released by Rese...
EMR patient portal on a smartphone
News | Electronic Medical Records (EMR) | December 11, 2019
December 11, 2019 — Despite the numerous benefits associated with patients accessing their medical records, a new stu