Feature | June 03, 2014 | Greg Freiherr

Image Fusion, Cubism and the Future of Imaging

 picasso woman with green hat.

An art critic once wrote, “If all women resembled those painted by Picasso, the Earth would be depopulated toward the end of the century.” The critic was speaking about Picasso’s “Woman in a Green Hat,” describing the model in the painting as “corpselike,” “greenish” and “formless.” 

Anyone not sharing Picasso’s cubist view of the world would likely agree. But Picasso painted what he felt more than what he saw. He painted what could not otherwise be seen. 

Commenting on the “Woman in a Green Hat,” Picasso said he painted the crooked nose on purpose “so that people were forced to see a nose. Later … they will recognize that it is not crooked at all.” 

Medical imaging has been moving in a similar direction for years. Engineers have been assembling technologies, sometimes from wholly different modalities, to form novel constructions that generate information that cannot otherwise be obtained. Positron emission tomography/computed tomography (PET/CT) is an example. 

The fusion of two modalities, PET/CT transcends its components, rendering a combination of anatomical and functional data. The concept of modality fusion took root with this hybrid, blossomed several years later into single-photon emission computed tomography (SPECT)/CT and, most recently, bore fruit as PET/magnetic resonance (MR).  

Each hybrid provides information that cannot otherwise be obtained. But, just as being able to paint in cubist style is not reason enough to do so, neither is being able to fuse imaging technologies enough to justify such hybridization. Only if fused technologies provide clinical value are they worth the effort of their creation. And there is the rub.

Clinical value often is recognizable only in hindsight. And even then this value may be realized in ways not initially expected.

In the early 1990s, engineers were mounting image intensifiers the size of curb-side garbage cans on a ring that spun at high speed around patients’ heads. The dynamic images of 3-D brain aneurysms filling with contrast medium were as remarkable as the scans were frightening to watch. 

The advent of flat panel detectors later in that decade improved image quality and increased the speed with which this ring could be spun. So encouraging was this leap forward that some pundits believed these once gangly and oversized systems might one day replace CTs. What happened instead was the evolution of multi-detector CTs (MDCT) and C-arm rotational angiography.

Today the most advanced MDCTs can cover the entire brain or heart in a single rotation, much like the image intensifier (II) prototype was envisioned to be able to do. Similarly, the technique of rotational angiography proven by those spinning IIs was modified to work with a single flat panel mounted on a C-arm, systems that are now commonplace in imaging centers around the world …
as are multi-detector CTs. 

The footprints of other hybridizations are evident elsewhere. One, involving digital breast tomosynthesis (DBT), developed out of necessity. Seen for decades as the holy grail for evaluating breast cancer, DBT was found to work best with the technology it was meant to replace. The signs of cancer were easier to spot, it was learned, when 3-D and 2-D images were interpreted together. The need for this pairing led one manufacturer to develop an algorithm that synthesizes 2-D images from 3-D data, creating a synergy of 2-D and 3-D mammography in a single unit. 

Imaging technologies will continue to be fused in the years ahead, propelling all of medicine forward as it has in the past. Like the early rotational angiography machines of 20 years ago, their unions may look like they’ve been torn from a Rube Goldberg sketchbook. But their clinical impact may be no laughing matter.

It will serve us well to remember that many of today’s most useful imaging systems began in the imagination of someone who saw, as Picasso said, “with different eyes.”

Greg Freiherr has reported on developments in radiology since 1983. He runs the consulting service, The Freiherr Group. Read more of his views on his blog at www.itnonline.com.

Related Content

Video Plus Brochure Helps Patients Make Lung Cancer Scan Decision

Image courtesy of the American Thoracic Society

News | Lung Cancer | April 19, 2019
A short video describing the potential benefits and risks of low-dose computed tomography (CT) screening for lung...
FDA Clears GE's Deep Learning Image Reconstruction Engine
Technology | Computed Tomography (CT) | April 19, 2019
GE Healthcare has received 510(k) clearance from the U.S. Food and Drug Administration (FDA) of its Deep Learning Image...
Videos | RSNA | April 03, 2019
ITN Editor Dave Fornell takes a tour of some of the most interesting new medical imaging technologies displa
Four of the top pieces of content in March included news on proton therapy, including a 360 image and videos from ITN's recent visit to the Northwestern Medicine Proton Center in the Chicago suburbs. This image shows the main proton treatment room gantry at the proton center in Warrenville, Ill. Interview with Mark Pankuch, Ph.D.

Four of the top pieces of content in March included news on proton therapy, including a 360 image and videos from ITN's recent visit to the Northwestern Medicine Proton Center in the Chicago suburbs. This image shows the main proton treatment room gantry at the proton center in Warrenville, Ill.
 

Feature | April 02, 2019 | Dave Fornell, Editor and A.J. Connell
April 2, 2019 — Here is the list of the most popular content on the Imaging Technology News (ITN) magazine w
Johns Hopkins Medicine First in U.S. to Install Canon Medical's Aquilion Precision
News | Computed Tomography (CT) | March 26, 2019
March 26, 2019 — Johns Hopkins Medicine now has access to the first...
At #ACC.19, Siemens unveiled a version of its go.Top platform optimized for cardiovascular imaging. The newly packaged scanner can generate the data needed to do CT-based FFR (fractional flow reserve).

At #ACC.19, Siemens unveiled a version of its go.Top platform optimized for cardiovascular imaging. The newly packaged scanner can generate the data needed to do CT-based FFR (fractional flow reserve). Photo by Greg Freiherr

Feature | Cardiac Imaging | March 22, 2019 | By Greg Freiherr
Reflecting a trend toward the increased use of...
Researchers Use Radiomics to Predict Who Will Benefit from Chemotherapy
News | Radiomics | March 21, 2019
Using data from computed tomography (CT) images, researchers may be able to predict which lung cancer patients will...
HeartFlow Analysis Successfully Stratifies Heart Disease Patients at One Year
News | CT Angiography (CTA) | March 19, 2019
Late-breaking results confirm the HeartFlow FFRct (fractional flow reserve computed tomography) Analysis enables...
SyncVision iFR Co-registration from Philips Healthcare maps iFR pressure readings onto angiogram.

SyncVision iFR Co-registration from Philips Healthcare maps iFR pressure readings onto angiogram. Results from an international study presented at #ACC19 show that pressure readings in coronary arteries may identify locations of stenoses remaining after cardiac cath interventions.

Feature | Cardiac Imaging | March 18, 2019 | By Greg Freiherr
As many as one in four patients who undergo cath lab interventions can benefit from a technology that identifies the