News | Advanced Visualization | February 25, 2019

Philips and Microsoft Showcase Augmented Reality for Image-Guided Minimally Invasive Therapies

Collaboration combines Philips Azurion image-guided therapy platform with Microsoft HoloLens 2 mixed reality computing platform as a concept for the operating room of the future

Philips and Microsoft have partnered to develop an augmented reality system to help imporve workflow and procedural navigation in the cath lab. Physicians wearing visors can view and interact with true 3-D holograms above the patient on the table and manipulate the image with voice and hand motion commands to avoid breaking the sterile field.

Philips and Microsoft have partnered to develop an augmented reality system to help imporve workflow and procedural navigation in the cath lab. Physicians wearing visors can view and interact with true 3-D holograms above the patient on the table and manipulate the image with voice and hand motion commands to avoid breaking the sterile field. 

Philips and Microsoft Showcase Augmented Reality for Image-Guided Minimally Invasive Therapies

Philips and Microsoft have partnered to develop an augmented reality system to help imporve workflow and procedural navigation in the cath lab. Physicians wearing visors can view and interact with true 3-D holograms of anatomy and view things like hemodynamic data.

The use of augmented and virtual reality in the interventional suite, cath lab, interventional lab, and hybrid OR.

Philips and Microsoft have partnered to develop an augmented reality system to help imporve workflow and procedural navigation in the cath lab. Physicians wearing visors can view and interact with true 3-D holograms above the patient on the table and manipulate the image with voice and hand motion commands to avoid breaking the sterile field. 

February 25, 2019 — Philips will unveil a new mixed reality concept developed together with Microsoft that the company says is designed for the operating room of the future. Based on Philips’ Azurion image-guided therapy platform and Microsoft’s HoloLens 2 holographic computing platform, the companies will showcase novel augmented reality applications for image-guided minimally invasive therapies. The technology will debut at Mobile World Congress (MWC) Barcelona, Feb. 25-28 in Barcelona, Spain.

In contrast to open surgery, minimally invasive therapies only require a small incision. Dedicated instruments such as catheters are inserted through the incision and guided to the treatment area, which can include the heart, blood vessels, brain, liver and other major organs. During minimally invasive procedures, physicians cannot directly see and touch the treatment area. Instead they rely on advanced medical imaging technologies such as ultra-low dose X-ray imaging and ultrasound, as well as other navigation technologies, to see inside the patient and guide their actions.

The Philips and Microsoft augmented reality concept, built for HoloLens 2, brings live imaging and other sources of vital data currently displayed on large 2-D screens into a 3-D holographic augmented reality environment that can be ergonomically, easily and intuitively controlled by the physician. The concept is being used to gather further clinical insights to support the development of future commercially-available augmented reality solutions for use in image-guided procedures.

Watch the VIDEO: Editor's Choice of the Most Innovative New Imaging Technology at RSNA 2017 to see the technology in action.

Microsoft unveiled HoloLens 2 at MWC Barcelona. It is a self-contained holographic computer that enables hands-free, heads-up interaction with three-dimensional digital objects. HoloLens 2 builds on the technology of HoloLens and is even more immersive, more comfortable and delivers more value right out of the box, according to Microsoft. The device is complemented by existing and new Azure cloud services, and features built-in artificial intelligence (AI).

Philips launched the Azurion platform globally in February 2017, powered by ConnectOS that allows the integration of advanced digital innovations.

Since its global launch in February 2017, over half a million patients have been treated in more than 80 countries using the Azurion platform, which is powered by Philips’ proprietary ConnectOS and combines technical innovations in both software and hardware. ConnectOS allows the integration of advanced digital innovations on the Azurion platform.

For more information: www.usa.philips.com/healthcare

 

Related VR and AR Content:

VIDEO: Using Virtual and Augmented Reality to Examine Brain Anatomy and Pathology at MD Anderson

Virtual Reality Boosts Revenues and Patient Understanding

Augmented Reality is Taking Over Radiology Training

VIDEO: Augmented Reality for Surgical Planning Example

Philips and Microsoft Showcase Augmented Reality for Image-Guided Minimally Invasive Therapies

Reimagining Brain Surgery 

VR in the OR 

Radiologist Uses Virtual Reality as Interventional Radiology Teaching Tool 

Related Content

Densitas Wins Major Procurement of Breast Density Software for DIMASOS Breast Screening Trial
News | Breast Density | September 20, 2019
Densitas Inc. announced it has won a procurement of its densitas densityai software for deployment in up to 24 breast...
Screening Mammography Could Benefit Men at High Risk of Breast Cancer
News | Mammography | September 18, 2019
Selective mammography screening can provide potentially lifesaving early detection of breast cancer in men who are at...
New ESC Guideline Provides Class 1 Recommendation for Coronary CTA
News | CT Angiography (CTA) | September 17, 2019
The European Society of Cardiology (ESC) published new guidelines on the diagnosis and management of chronic coronary...
The Artis icono biplane angiography system is designed for use in neurointerventions and interventional radiology

The Artis icono biplane angiography system is designed for use in neurointerventions and interventional radiology. Image courtesy of Siemens Healthineers.

Technology | Angiography | September 17, 2019
The U.S. Food and Drug Administration (FDA) has cleared the Artis icono, a high-precision family of angiography systems...
3D Systems Earns Additional FDA Clearance for D2P Medical 3-D Printing Software

3D Systems’ D2P FDA-cleared software allows clinicians to 3-D-print diagnostic patient-specific anatomic models. Image courtesy of 3D Systems.

Technology | Medical 3-D Printing | September 12, 2019
3D Systems has received additional U.S. Food and Drug Administration (FDA) 510(k) clearance for its D2P software...
Richardson Healthcare Receives CE Mark Approval for ALTA750 Canon/Toshiba CT Replacement Tube
News | Computed Tomography (CT) | September 11, 2019
Richardson Healthcare, a Division of Richardson Electronics Ltd., announced it has received CE Mark approval for the...
Bayer Introduces Medrad Stellant Flex CT Injection System
Technology | Contrast Media Injectors | September 11, 2019
Bayer announced the introduction of the Medrad Stellant Flex computed tomography (CT) injection system. Stellant Flex...
iCAD's ProFound AI Wins Best New Radiology Solution in 2019 MedTech Breakthrough Awards
News | Computer-Aided Detection Software | September 09, 2019
iCAD Inc. announced MedTech Breakthrough, an independent organization that recognizes the top companies and solutions...
ASNC Announces Multisocietal Cardiac Amyloidosis Imaging Consensus
News | Cardiac Imaging | September 09, 2019
September 9, 2019 — The American Society of Nuclear Cardiology (ASNC) published a new expert consensus document along
A smart algorithm has been trained on a neural network to recognize the appearance of breast cancer in MR images

A smart algorithm has been trained on a neural network to recognize the appearance of breast cancer in MR images. The algorithm, described at the SBI/ACR Breast Imaging Symposium, used deep learning, a form of machine learning, which is a type of artificial intelligence. Image courtesy of Sarah Eskreis-Winkler, M.D.

Feature | Society of Breast Imaging (SBI) | September 06, 2019 | By Greg Freiherr
The use of smart algorithms has the potential to make healthcare more efficient.