News | Artificial Intelligence | March 22, 2021

Making the Role of AI in Breast Cancer Explainable

Analysis system for the diagnosis of breast cancer

Detection of tumor-infiltrating lymphocytes (TILs) using explainable AI. The AI-technique is used to generate a heatmap showing TILs (red) and other tissues and cells (blue and green). Image courtesy of Klauschen/Charité

Detection of tumor-infiltrating lymphocytes (TILs) using explainable AI. The AI-technique is used to generate a heatmap showing TILs (red) and other tissues and cells (blue and green). Image courtesy of Klauschen/Charité

Breast cancer tissue sample (hematoxylin and eosin staining). Image courtesy of Klauschen/Charité

Breast cancer tissue sample (hematoxylin and eosin staining). Image courtesy of Klauschen/Charité

March 22, 2021 — Researchers at Charité - Universitätsmedizin Berlin and TU Berlin as well as the University of Oslo have developed a new tissue-section analysis system for diagnosing breast cancer based on artificial intelligence (AI). Two further developments make this system unique: For the first time, morphological, molecular and histological data are integrated in a single analysis. Secondly, the system provides a clarification of the AI decision process in the form of heatmaps. Pixel by pixel, these heatmaps show which visual information influenced the AI decision process and to what extent, thus enabling doctors to understand and assess the plausibility of the results of the AI analysis. This represents a decisive and essential step forward for the future regular use of AI systems in hospitals. The results of this research have now been published in Nature Machine Intelligence.

Cancer treatment is increasingly concerned with the molecular characterization of tumor tissue samples. Studies are conducted to determine whether and/or how the DNA has changed in the tumor tissue as well as the gene and protein expression in the tissue sample. At the same time, researchers are becoming increasingly aware that cancer progression is closely related to intercellular cross-talk and the interaction of neoplastic cells with the surrounding tissue - including the immune system.

Although microscopic techniques enable biological processes to be studied with high spatial detail, they only permit a limited measurement of molecular markers. These are rather determined using proteins or DNA taken from tissue. As a result, spatial detail is not possible and the relationship between these markers and the microscopic structures is typically unclear. "We know that in the case of breast cancer, the number of immigrated immune cells, known as lymphocytes, in tumor tissue has an influence on the patient's prognosis. There are also discussions as to whether this number has a predictive value - in other words if it enables us to say how effective a particular therapy is," said Prof. Frederick Klauschen, M.D., of Charité's Institute of Pathology.

"The problem we have is the following: We have good and reliable molecular data and we have good histological data with high spatial detail. What we don't have as yet is the decisive link between imaging data and high-dimensional molecular data," added Prof. Klaus-Robert Müller, M.D., professor of machine learning at TU Berlin. Both researchers have been working together for a number of years now at the national AI center of excellence the Berlin Institute for the Foundations of Learning and Data (BIFOLD) located at TU Berlin.

It is precisely this symbiosis which the newly published approach makes possible. "Our system facilitates the detection of pathological alterations in microscopic images. Parallel to this, we are able to provide precise heatmap visualizations showing which pixel in the microscopic image contributed to the diagnostic algorithm and to what extent," explained Müller. The research team has also succeeded in significantly further developing this process: "Our analysis system has been trained using machine learning processes so that it can also predict various molecular characteristics, including the condition of the DNA, the gene expression as well as the protein expression in specific areas of the tissue, on the basis of the histological images.

Next on the agenda are certification and further clinical validations - including tests in tumor routine diagnostics. However, Klauschen is already convinced of the value of the research: "The methods we have developed will make it possible in the future to make histopathological tumor diagnostics more precise, more standardized and qualitatively better."

For more information: www.charite.de

Related Breast Cancer/AI Workflow Content:

VIDEO: Integrating Artificial Intelligence Into Radiologists Workflow

Related Content

Comparisons of high definition and standard definition infrared imaging for digital histopathology. Image courtesy of the Beckman Institute

Comparisons of high definition and standard definition infrared imaging for digital histopathology. Image courtesy of the Beckman Institute

News | Breast Imaging | April 14, 2021
April 14, 2021 — Detecting and analyzing breast cancer
A doctor reading #CXR scans using #SenseCare-Chest #DR Pro #diagnostic #software.

A doctor reading CXR scans using SenseCare-Chest DR Pro diagnostic software.

News | Artificial Intelligence | April 14, 2021
April 14, 2021 — SenseTime, a world-leading...
The U.S. Food and Drug Administration (#FDA) authorized marketing of #Medtronic's #GIGenius, the first device that uses #artificialintelligence (#AI) based on #machinelearning to assist #clinicians in detecting #lesions (such as #polyps or suspected tumors) in the #colon in real time during a c#olonoscopy.

The GI Genius intelligent endoscopy module works in real-time, automatically identifying and marking (with a green box) abnormalities consistent with colorectal polyps, including small flat polyps.

News | Artificial Intelligence | April 12, 2021
A 37-year-old woman developed a new, palpable left supraclavicular lymphadenopathy lump five days after her first dose of the Moderna COVID-19 vaccine in the left arm. On the day of vaccination, the patient was asymptomatic. This is an example of how the vaccine can mimic cancer and swollen lymph nodes. Image used with permission of RSNA.

A 37-year-old woman developed a new, palpable left supraclavicular lymphadenopathy lump five days after her first dose of the Moderna COVID-19 vaccine in the left arm. On the day of vaccination, the patient was asymptomatic. This is an example of how the vaccine can mimic cancer and swollen lymph nodes. Read more about this case study. Image used with permission of RSNA.

Feature | Coronavirus (COVID-19) | April 09, 2021 | By Dave Fornell, Editor
While the mass COVID-19 vaccinat
3-D mammography reduces the number of breast cancer cases diagnosed in the period between routine screenings, when compared with traditional mammography, according to a large study from Lund University in Sweden. The results are published in the journal Radiology.

Getty Images

News | Breast Imaging | April 09, 2021
April 9, 2021 — 3-D mammography reduces the number of breast cancer cases diagnosed in the period between routine scr
Varian announced it is collaborating with Google Cloud to build an advanced artificial intelligence (AI) based diagnostic platform to aid in the fight against cancer. Varian and Google Cloud AI embarked on a deployment journey, using Neural Architecture Search (NAS) technology via Google Cloud AI Platform, to create AI models for organ segmentation — a crucial and labor-intensive step in radiation oncology that can be a bottleneck in the cancer treatment clinical workflow.
News | Artificial Intelligence | April 08, 2021
April 8, 2021 — Varian announced it is collaborating with Google...
Mobidiag Oy, a privately held, commercial-stage Finnish-French developer of innovative molecular diagnostic tests and instrumentation, announced today that it has signed a definitive agreement to be acquired by Hologic, Inc., a global leader in women's health, for an enterprise value of approximately $795 million.  This includes a cash payment of approximately $714 million for Mobidiag’s equity, and net debt of approximately $81 million.
News | Women's Health | April 08, 2021
April 8, 2021 — Mobidiag Oy, a privately held, commercial-stage F
Brain tumors edged out by artificial intelligence: VBrain applies auto-contouring to the three most common types of brain tumors: brain metastasis, meningioma and acoustic neuroma.

Brain tumors edged out by artificial intelligence: VBrain applies auto-contouring to the three most common types of brain tumors: brain metastasis, meningioma and acoustic neuroma.

News | Artificial Intelligence | April 07, 2021
April 7, 2021 — Vysioneer, a leader in a...
Ultrasound is an invaluable diagnostic tool for the early detection of breast cancer, but the classification of lesions is sometimes challenging and time consuming. Could artificial intelligence hold the answer to solving these problems? Graphic courtesy of Chinese Medical Journal

Ultrasound is an invaluable diagnostic tool for the early detection of breast cancer, but the classification of lesions is sometimes challenging and time consuming. Could artificial intelligence hold the answer to solving these problems? Graphic courtesy of Chinese Medical Journal

News | Artificial Intelligence | April 06, 2021
April 6, 2021 — In 2020, the International Agency for Research on...