Greg Freiherr, Industry Consultant
Greg Freiherr, Industry Consultant

Greg Freiherr has reported on developments in radiology since 1983. He runs the consulting service, The Freiherr Group.

Blog | Greg Freiherr, Industry Consultant | December 20, 2013

Gesture Technology: From Xbox to OR

“Keys, scumbag. It’s the universal symbol for keys.”

Mike Ehrmantraut, his hand outstretched to Walter White (Episode 1, Season 5, Breaking Bad)


Some gestures are easy to figure out. Others less so. Under Christmas trees around the world, the latest version of Xbox is waiting to take a crack at some of what may be the first signs of a new way to manipulate medical images.

“Gesture technology” will allow owners of Xbox One to zoom in and out by closing a hand over an area, then pulling back and pushing away. It will allow them to scroll through a menu by moving a hand left or right, up or down.

This technology will soon be applied en masse around the globe in Call of Duty, BioShock and Halo. Christian Schaller, founder and CEO of the German tech start-up Metrilus, would like them used to view radiological images in OR and interventional suites.

Schaller was gesturing the possibilities in the German Pavilion on the exhibit floor of RSNA 2013. Using time-of-flight 3-D cameras similar to technology built into the Xbox Kinect motion sensor, he was able to call up an image by pointing to it with a single finger, switch displayed images with the swipe of a hand, and zoom an image by motioning up and down.

The interface was in prototype and a long way from application. But the allure was clear.

Gesture navigation offers surgeons the promise of remote control over display technology without physical contact. The advantage is obvious to anyone who has tried to maneuver the tight spaces of an operating theater, much of which is draped in blue, signifying scrubbed and sterilized surfaces that better not be touched, if the one doing the touching knows what’s good for him.

Like voice recognition, which over the last decade has become a staple in radiological circles, gesture recognition appears as inevitable as its beginning is sure to be rocky.  My nephew — an accomplished gamer — tells me an upright foot, crossed on an adjacent knee while sitting in front of an Xbox can be confused with a hand, leading to results that are anything but helpful. Unintended hand movements in the OR could have similarly unexpected effects. But, hey, gesture technology is early in its development.

The world may be on the doorstep of, as yet, unimagined interfaces, ones that will dramatically cut the time from thought to action. These may be adopted by the gaming world long before they are by the radiological community, just as medical image display on mobile devices were preceded by YouTube videos.

Not surprisingly, then, the first place to look this Christmas for the future of radiology may be under old tannenbaum.

Related Content

Nuance Launches Cloud-Based mPower Clinical Analytics Platform at AHRA 2018
Technology | Analytics Software | August 16, 2018
At the Association for Medical Imaging Management (AHRA) 2018 Annual Meeting and Exposition, July 22-25 in Orlando, Fla...
Intel and Philips Demonstrate CPU Ability in Deep Learning Inference Test Cases
News | Artificial Intelligence | August 15, 2018
Intel and Philips recently tested two healthcare uses for deep learning inference models using Intel Xeon Scalable...
Guerbet Partners With Imalogix on Dose Optimization With Artificial Intelligence
News | Radiation Dose Management | August 14, 2018
August 14, 2018 — Guerbet LLC USA announced a commercial partnership with Imalogix, a provider of...
Visage Signs Mercy for Visage 7 Open Archive
News | Enterprise Imaging | August 09, 2018
Visage Imaging Inc. announced that it has signed a seven-year contract with Mercy, the fifth largest Catholic health...
Videos | Radiomics | August 09, 2018
A discussion with Martin Vallieres, Ph.D., post-doctoral fellow at McGill University, Montreal, Canada.
Aidoc Receives FDA Clearance for AI Detection of Acute Intracranial Hemorrhage
Technology | Clinical Decision Support | August 08, 2018
Aidoc announced that it was granted U.S. Food and Drug Administration (FDA) clearance for the first product of its...
Metro Health-University of Michigan Health Partners With Eon to Improve Lung Cancer Care
News | Oncology Diagnostics | August 07, 2018
Metro Health-University of Michigan Health announced it is partnering with healthcare data company Eon to improve the...
Artificial Intelligence in Medical Imaging to Top $2 Billion by 2023
News | Artificial Intelligence | August 06, 2018
The world market for machine learning in medical imaging is set for a period of robust growth and is forecast to top $2...
Imalogix Brings Fluoroscopy Capabilities to Radiation Dose Management Platform
Technology | Radiographic Fluoroscopy (RF) | August 06, 2018
Imalogix, a provider of artificial intelligence (AI) process and workflow solutions, announced the availability of the...
Videos | Clinical Decision Support | August 03, 2018
Sheila Sferrella, president of Regents Health Resources and Bill Finerfrock, president of Capitol Associates, discuss
Overlay Init