News | Interventional Radiology | April 10, 2019

Smart Speaker Technology Harnessed for Hospital Medical Treatments

Research demonstrates value of Amazon Echo and Google Home during medical procedures

Smart Speaker Technology Harnessed for Hospital Medical Treatments

April 10, 2019 —Smart speakers customarily used in your living room can act as an aid to physicians in hospital operating rooms, according to new research presented at the Society of Interventional Radiology’s (SIR) 2019 Annual Scientific Meeting, March 23-28 in Austin, Texas. Smart speakers, such as the Amazon Echo and Google Home, offer a conversational voice interface that allows interventional radiology (IR) physicians to ask questions and retrieve information needed for their patient treatments without breaking sterile scrub.

“During treatment, IRs rely on nuanced medical information delivered in a timely manner. When you’re in the middle of a procedure, you need to remain sterile, so you lose the ability to use a computer,” said Kevin Seals, M.D., a fellow in interventional radiology at the University of California, San Francisco (UCSF) and lead author of the study. “This smart speaker technology helps us to quickly and intelligently make decisions relevant to a patient’s specific needs.”

The researchers at UCSF developed a device-sizing application for the Google Home smart speaker. The application processes questions from a human voice and provides recommendations on the precise sizing of medical devices. For example, if an IR needs to know what size sheath to use to implant a stent in a patient’s blood vessel, the smart speaker can quickly and accurately communicate the correct size based on the specific circumstances, which helps the physician in making a final decision.

“There are hundreds of devices, with more being introduced every day, making it difficult to determine the correct sizing or materials needed in every circumstance. This technology allows physicians to concentrate more closely on the care of their patients, devoting less time and mental energy to device technicalities,” said Seals.

In developing the application, size specifications were acquired using literature reviews for 475 IR devices, such as catheters, sheaths, stents, vascular plugs and others. Natural language processing was implemented using Dialogflow, which extracted the information of interest from an input query. Logic operations and other data processing were performed using a Python script deployed to the cloud.

The researchers plan to continue to build on this technology and expand its scope to include information on material costs and inventory databases. Having this information readily available will make treatments more efficient, cost-effective and beneficial to patients. Further research will look to yield information for physicians in other specialties and provide information from electronic health records and patient clinical data, such as allergies or prior surgeries.

For more information: www.sirmeeting.org

Related Content

Atrium Health Debuts Amazon Alexa Skill to Help Patients Access Medical Care

Reference

1. Seals K., Al-Hakim R., Mulligan P., et al. Abstract 38: The Development of a Machine Learning Smart Speaker Application for Device Sizing in Interventional Radiology. Presented at SIR 2019.

Related Content

Mentice and RAD-AID Collaborate to Improve Access to Interventional Radiology in Resource-constrained Regions
News | Interventional Radiology | April 22, 2019
April 22, 2019 — Mentice AB, provider of endovascular performance solutions, has signed an agreement with the nonprof
HHS Extends Comment Period for Proposed Electronic Health Information Interoperability Rules
News | Electronic Medical Records (EMR) | April 19, 2019
The U.S. Department of Health and Human Services (HHS) is extending the public comment period by 30 days for two...
In a demonstration on the exhibit floor of the SBI symposium, Koios software identified suspicious lesions in ultrasound images

In a demonstration on the exhibit floor of the SBI symposium, Koios software identified suspicious lesions in ultrasound images. Photo by Greg Freiherr

Feature | Artificial Intelligence | April 19, 2019 | By Greg Freiherr
Commercial efforts to develop...
Atrium Health Debuts Amazon Alexa Skill to Help Patients Access Medical Care
News | Artificial Intelligence | April 18, 2019
Atrium Health patients will now be able to use Amazon’s electronic voice system Alexa to not only locate the nearest...
Oxipit Introduces Multilingual Support for ChestEye AI Imaging Suite
News | Artificial Intelligence | April 16, 2019
The CE-certified ChestEye artificial intelligence (AI) imaging suite by Oxipit is now available in seven European...
iCAD Appoints Stacey Stevens as President
News | Radiology Business | April 16, 2019
iCAD Inc. recently announced that Stacey Stevens has been named president. As president, Stevens will have expanded...
Radiology Publishes Roadmap for AI in Medical Imaging
News | Artificial Intelligence | April 16, 2019
In August 2018, a workshop was held at the National Institutes of Health (NIH) in Bethesda, Md., to explore the future...
Cambridge University Hospitals NHS Foundation Trust Implements Change Healthcare Enterprise Imaging
News | Enterprise Imaging | April 15, 2019
Change Healthcare successfully implemented its Radiology PACS (picture archiving and communication system), Image...