Greg Freiherr, Industry Consultant
Greg Freiherr, Industry Consultant

Greg Freiherr has reported on developments in radiology since 1983. He runs the consulting service, The Freiherr Group.

Blog | Greg Freiherr, Industry Consultant | December 20, 2013

Gesture Technology: From Xbox to OR

“Keys, scumbag. It’s the universal symbol for keys.”

Mike Ehrmantraut, his hand outstretched to Walter White (Episode 1, Season 5, Breaking Bad)


Some gestures are easy to figure out. Others less so. Under Christmas trees around the world, the latest version of Xbox is waiting to take a crack at some of what may be the first signs of a new way to manipulate medical images.

“Gesture technology” will allow owners of Xbox One to zoom in and out by closing a hand over an area, then pulling back and pushing away. It will allow them to scroll through a menu by moving a hand left or right, up or down.

This technology will soon be applied en masse around the globe in Call of Duty, BioShock and Halo. Christian Schaller, founder and CEO of the German tech start-up Metrilus, would like them used to view radiological images in OR and interventional suites.

Schaller was gesturing the possibilities in the German Pavilion on the exhibit floor of RSNA 2013. Using time-of-flight 3-D cameras similar to technology built into the Xbox Kinect motion sensor, he was able to call up an image by pointing to it with a single finger, switch displayed images with the swipe of a hand, and zoom an image by motioning up and down.

The interface was in prototype and a long way from application. But the allure was clear.

Gesture navigation offers surgeons the promise of remote control over display technology without physical contact. The advantage is obvious to anyone who has tried to maneuver the tight spaces of an operating theater, much of which is draped in blue, signifying scrubbed and sterilized surfaces that better not be touched, if the one doing the touching knows what’s good for him.

Like voice recognition, which over the last decade has become a staple in radiological circles, gesture recognition appears as inevitable as its beginning is sure to be rocky.  My nephew — an accomplished gamer — tells me an upright foot, crossed on an adjacent knee while sitting in front of an Xbox can be confused with a hand, leading to results that are anything but helpful. Unintended hand movements in the OR could have similarly unexpected effects. But, hey, gesture technology is early in its development.

The world may be on the doorstep of, as yet, unimagined interfaces, ones that will dramatically cut the time from thought to action. These may be adopted by the gaming world long before they are by the radiological community, just as medical image display on mobile devices were preceded by YouTube videos.

Not surprisingly, then, the first place to look this Christmas for the future of radiology may be under old tannenbaum.

Related Content

AI Approach Outperformed Human Experts in Identifying Cervical Precancer
News | Digital Pathology | January 10, 2019
January 10, 2019 — A research team led by investigators from the National Institutes of Health and Global Good has de
Artificial intelligence, also called deep learning and machine learning, was the hottest topic at the 2018 Radiological Society of North America (RSNA)) meeting.

Artificial intelligence was the hottest topic at the 2018 Radiological Society of North America (RSNA)) meeting, which included a large area with its own presentation therater set asside for AI vendors.

Feature | Artificial Intelligence | January 10, 2019 | Dave Fornell, Editor
Hands down, the hottest topic in radiology the past two years has been the implementation of...
Pacific Northwest VA Network Selects Carestream as Enterprise PACS Supplier
News | PACS | January 08, 2019
Carestream has been awarded a multimillion-dollar healthcare information technology (IT) contract for Veterans Affairs...
Sponsored Content | Videos | Flat Panel Displays | December 25, 2018
EIZO, which means image in Japanese, is a visual technology company that develops and manufactures high-end display s
Videos | Artificial Intelligence | December 21, 2018
Enhao Gong, Ph.D., founder of Subtle Medical, an artificial intelligence (AI) company that develops products to help
IMS Announces Integration of Cloud Image Viewing Platform With Google Cloud
News | Archive Cloud Storage | December 20, 2018
International Medical Solutions (IMS) recently announced it will provide Google Cloud account users with the ability to...
Infinitt Showcases New RIS/PACS Features at RSNA 2018
News | PACS | December 19, 2018
Infinitt North America highlighted a range of healthcare information technology (IT) products and applications at the...
Videos | Artificial Intelligence | December 18, 2018
Radiological Society of North America (RSNA) 2018 annual meeting keynote speaker Michael Recht, M.D., chairman of rad
Nicklaus Children's Hospital Launches Enterprise Mobile Clinical Collaboration Platform
News | Enterprise Imaging | December 17, 2018
Enterprise imaging health information technology (IT) provider Dicom Systems Inc. announced a new joint deployment with...