News | Advanced Visualization | February 25, 2019

Philips and Microsoft Showcase Augmented Reality for Image-Guided Minimally Invasive Therapies

Collaboration combines Philips Azurion image-guided therapy platform with Microsoft HoloLens 2 mixed reality computing platform as a concept for the operating room of the future

Philips and Microsoft have partnered to develop an augmented reality system to help imporve workflow and procedural navigation in the cath lab. Physicians wearing visors can view and interact with true 3-D holograms above the patient on the table and manipulate the image with voice and hand motion commands to avoid breaking the sterile field.

Philips and Microsoft have partnered to develop an augmented reality system to help imporve workflow and procedural navigation in the cath lab. Physicians wearing visors can view and interact with true 3-D holograms above the patient on the table and manipulate the image with voice and hand motion commands to avoid breaking the sterile field. 

Philips and Microsoft Showcase Augmented Reality for Image-Guided Minimally Invasive Therapies

Philips and Microsoft have partnered to develop an augmented reality system to help imporve workflow and procedural navigation in the cath lab. Physicians wearing visors can view and interact with true 3-D holograms of anatomy and view things like hemodynamic data.

The use of augmented and virtual reality in the interventional suite, cath lab, interventional lab, and hybrid OR.

Philips and Microsoft have partnered to develop an augmented reality system to help imporve workflow and procedural navigation in the cath lab. Physicians wearing visors can view and interact with true 3-D holograms above the patient on the table and manipulate the image with voice and hand motion commands to avoid breaking the sterile field. 

February 25, 2019 — Philips will unveil a new mixed reality concept developed together with Microsoft that the company says is designed for the operating room of the future. Based on Philips’ Azurion image-guided therapy platform and Microsoft’s HoloLens 2 holographic computing platform, the companies will showcase novel augmented reality applications for image-guided minimally invasive therapies. The technology will debut at Mobile World Congress (MWC) Barcelona, Feb. 25-28 in Barcelona, Spain.

In contrast to open surgery, minimally invasive therapies only require a small incision. Dedicated instruments such as catheters are inserted through the incision and guided to the treatment area, which can include the heart, blood vessels, brain, liver and other major organs. During minimally invasive procedures, physicians cannot directly see and touch the treatment area. Instead they rely on advanced medical imaging technologies such as ultra-low dose X-ray imaging and ultrasound, as well as other navigation technologies, to see inside the patient and guide their actions.

The Philips and Microsoft augmented reality concept, built for HoloLens 2, brings live imaging and other sources of vital data currently displayed on large 2-D screens into a 3-D holographic augmented reality environment that can be ergonomically, easily and intuitively controlled by the physician. The concept is being used to gather further clinical insights to support the development of future commercially-available augmented reality solutions for use in image-guided procedures.

Watch the VIDEO: Editor's Choice of the Most Innovative New Imaging Technology at RSNA 2017 to see the technology in action.

Microsoft unveiled HoloLens 2 at MWC Barcelona. It is a self-contained holographic computer that enables hands-free, heads-up interaction with three-dimensional digital objects. HoloLens 2 builds on the technology of HoloLens and is even more immersive, more comfortable and delivers more value right out of the box, according to Microsoft. The device is complemented by existing and new Azure cloud services, and features built-in artificial intelligence (AI).

Philips launched the Azurion platform globally in February 2017, powered by ConnectOS that allows the integration of advanced digital innovations.

Since its global launch in February 2017, over half a million patients have been treated in more than 80 countries using the Azurion platform, which is powered by Philips’ proprietary ConnectOS and combines technical innovations in both software and hardware. ConnectOS allows the integration of advanced digital innovations on the Azurion platform.

For more information: www.usa.philips.com/healthcare

 

Related VR and AR Content:

VIDEO: Using Virtual and Augmented Reality to Examine Brain Anatomy and Pathology at MD Anderson

Virtual Reality Boosts Revenues and Patient Understanding

Augmented Reality is Taking Over Radiology Training

VIDEO: Augmented Reality for Surgical Planning Example

Philips and Microsoft Showcase Augmented Reality for Image-Guided Minimally Invasive Therapies

Reimagining Brain Surgery 

VR in the OR 

Radiologist Uses Virtual Reality as Interventional Radiology Teaching Tool 

Related Content

Nuclear Cardiology Optimistic About Return to Pre-COVID-19 Exam Levels. An American Society of Nuclear Cardiology (ASNC) member survey are confident nuclear cardiology volumes will return to pre-pandemic levels. #COVID19 #SARScov2
News | Nuclear Imaging | June 01, 2020
June 1, 2020 — While acknowledging the challenges their specialty is facing, more than two-thirds of respondents to a
AIR Recon DL delivers shorter scans and better image quality (Photo: Business Wire)

AIR Recon DL delivers shorter scans and better image quality (Photo: Business Wire).

News | Artificial Intelligence | May 29, 2020
May 29, 2020 — GE Healthcare announced U.S.
Largest case series (n=30) to date yields high frequency (77%) of negative chest CT findings among pediatric patients (10 months-18 years) with COVID-19, while also suggesting common findings in subset of children with positive CT findings

A and B, Unenhanced chest CT scans show minimal GGOs (right lower and left upper lobes) (arrows) and no consolidation. Only two lobes were affected, and CT findings were assigned CT severity score of 2. Image courtesy of American Journal of Roentgenology (AJR)

News | Coronavirus (COVID-19) | May 29, 2020
May 29, 2020 — An investigation published open-access in the ...
The paradox is that COVID-19 has manifested the critical need for exactly what the rules require: advancement of interoperability and digital online access to clinical data and imaging, at scale, for care coordination and infection control.

The paradox is that COVID-19 has manifested the critical need for exactly what the rules require: advancement of interoperability and digital online access to clinical data and imaging, at scale, for care coordination and infection control. Getty Images

Feature | Coronavirus (COVID-19) | May 28, 2020 | By Matthew A. Michela
One year after being proposed, federal rules to advance interoperability in healthcare and create easier access for p
The opportunity to converge the silos of data into a cross-functional analysis can provide immense value during the COVID-19 outbreak and in the future

Getty Images

Feature | Coronavirus (COVID-19) | May 28, 2020 | By Jeff Vachon
In the midst of the coronavirus pandemic normal
United Imaging's uMR OMEGA is designed to provide greater access to magnetic resonance imaging (MRI) with the world’s first ultra-wide 75-cm bore 3T MRI.
News | Magnetic Resonance Imaging (MRI) | May 27, 2020
May 27, 2020 — United Imaging's...
In April, the U.S. Food and Drug Administration (FDA) cleared Intelerad’s InteleConnect EV solution for diagnostic image review on a range of mobile devices.
Feature | PACS | May 27, 2020 | By Melinda Taschetta-Millane
Fast, easily accessible patient images are crucial in this day and age, as imaging and medical records take on a new
There were several new developments in digital radiography (DR) technology at the 2019 Radiological Society of North America (RSNA) annual meeting. These trends included integration of artificial intelligence (AI) auto detection technologies, more durable glassless detector plates, and technologies to pull more diagnostic data out of X-ray imaging. Some vendors also have redesigned their DR systems to make them more user-friendly and ergonomic. 
Feature | Digital Radiography (DR) | May 26, 2020 | By Dave Fornell
There were several new developments in digital rad...
The Philips Lumify point-of-care ultrasound (POCUS) system assessing a patient in the emergency room combined with telehealth to enable real-time collaboration with other physicians.

The Philips Lumify point-of-care ultrasound (POCUS) system assessing a patient in the emergency room combined with telehealth to enable real-time collaboration with other physicians.

News | Coronavirus (COVID-19) | May 26, 2020
May 26, 2020  — Philips Healthcare recently received 510(k) clearance from the U.S.
An example of DiA'a automated ejection fraction AI software on the GE vScan POCUS system at RSNA 2019.

An example of DiA'a automated ejection fraction AI software on the GE vScan POCUS system at RSNA 2019. Photo by Dave Fornell.

News | Ultrasound Imaging | May 26, 2020
May 12, 2020 — DiA Imaging Analysis, a provider of AI based ultrasound analysis solutions, said it received a governm