An interpretable automated detection system for FISH-based HER2 oncogene
amplification testing in histo-pathological routine images of breast and
gastric cancer diagnostics
- URL: http://arxiv.org/abs/2005.12066v1
- Date: Mon, 25 May 2020 12:14:38 GMT
- Title: An interpretable automated detection system for FISH-based HER2 oncogene
amplification testing in histo-pathological routine images of breast and
gastric cancer diagnostics
- Authors: Sarah Schmell and Falk Zakrzewski and Walter de Back and Martin
Weigert and Uwe Schmidt and Torsten Wenke and Silke Zeugner and Robert Mantey
and Christian Sperling and Ingo Roeder and Pia Hoenscheid and Daniela Aust
and Gustavo Baretton
- Abstract summary: We develop an interpretable, deep learning (DL)-based pipeline which automates the evaluation of FISH images with respect to HER2 gene amplification testing.
It mimics the pathological assessment and relies on the detection and localization of interphase nuclei based on instance segmentation networks.
It localizes and classifies fluorescence signals within each nucleus with the help of image classification and object detection convolutional neural networks (CNNs)
- Score: 0.2479153065703935
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Histo-pathological diagnostics are an inherent part of the everyday work but
are particularly laborious and associated with time-consuming manual analysis
of image data. In order to cope with the increasing diagnostic case numbers due
to the current growth and demographic change of the global population and the
progress in personalized medicine, pathologists ask for assistance. Profiting
from digital pathology and the use of artificial intelligence, individual
solutions can be offered (e.g. detect labeled cancer tissue sections). The
testing of the human epidermal growth factor receptor 2 (HER2) oncogene
amplification status via fluorescence in situ hybridization (FISH) is
recommended for breast and gastric cancer diagnostics and is regularly
performed at clinics. Here, we develop an interpretable, deep learning
(DL)-based pipeline which automates the evaluation of FISH images with respect
to HER2 gene amplification testing. It mimics the pathological assessment and
relies on the detection and localization of interphase nuclei based on instance
segmentation networks. Furthermore, it localizes and classifies fluorescence
signals within each nucleus with the help of image classification and object
detection convolutional neural networks (CNNs). Finally, the pipeline
classifies the whole image regarding its HER2 amplification status. The
visualization of pixels on which the networks' decision occurs, complements an
essential part to enable interpretability by pathologists.
Related papers
- Ophthalmic Biomarker Detection with Parallel Prediction of Transformer and Convolutional Architecture [1.6893691730575022]
This paper presents a novel approach for ophthalmic biomarker detection using an ensemble of Convolutional Neural Network (CNN) and Vision Transformer.
Our method has been implemented on the OLIVES dataset to detect 6 major biomarkers from the OCT images and shows significant improvement of the macro averaged F1 score on the dataset.
arXiv Detail & Related papers (2024-09-26T12:33:34Z) - Automated HER2 Scoring in Breast Cancer Images Using Deep Learning and Pyramid Sampling [3.711848341917877]
We introduce a deep learning-based approach utilizing pyramid sampling for the automated classification of HER2 status in IHC-stained BC tissue images.
Our approach analyzes morphological features at various spatial scales, efficiently managing the computational load and facilitating a detailed examination of cellular and larger-scale tissue-level details.
arXiv Detail & Related papers (2024-04-01T00:23:22Z) - Deep learning-based instance segmentation for the precise automated
quantification of digital breast cancer immunohistochemistry images [1.8434042562191815]
We demonstrate the feasibility of using a deep learning-based instance segmentation architecture for the automatic quantification of both nuclear and membrane biomarkers applied to IHC-stained slides.
We have collected annotations over samples of HE, ER and Ki-67 (nuclear biomarkers) and HER2 (membrane biomarker) IHC-stained images.
We have trained two models, so-called nuclei- and membrane-aware segmentation models, which, once successfully validated, have revealed to be a promising method to segment nuclei instances in IHC-stained images.
arXiv Detail & Related papers (2023-11-22T22:23:47Z) - A Pathologist-Informed Workflow for Classification of Prostate Glands in
Histopathology [62.997667081978825]
Pathologists diagnose and grade prostate cancer by examining tissue from needle biopsies on glass slides.
Cancer's severity and risk of metastasis are determined by the Gleason grade, a score based on the organization and morphology of prostate cancer glands.
This paper proposes an automated workflow that follows pathologists' textitmodus operandi, isolating and classifying multi-scale patches of individual glands.
arXiv Detail & Related papers (2022-09-27T14:08:19Z) - Preservation of High Frequency Content for Deep Learning-Based Medical
Image Classification [74.84221280249876]
An efficient analysis of large amounts of chest radiographs can aid physicians and radiologists.
We propose a novel Discrete Wavelet Transform (DWT)-based method for the efficient identification and encoding of visual information.
arXiv Detail & Related papers (2022-05-08T15:29:54Z) - Lymphocyte Classification in Hyperspectral Images of Ovarian Cancer
Tissue Biopsy Samples [94.37521840642141]
We present a machine learning pipeline to segment white blood cell pixels in hyperspectral images of biopsy cores.
These cells are clinically important for diagnosis, but some prior work has struggled to incorporate them due to difficulty obtaining precise pixel labels.
arXiv Detail & Related papers (2022-03-23T00:58:27Z) - Lung Cancer Lesion Detection in Histopathology Images Using Graph-Based
Sparse PCA Network [93.22587316229954]
We propose a graph-based sparse principal component analysis (GS-PCA) network, for automated detection of cancerous lesions on histological lung slides stained by hematoxylin and eosin (H&E)
We evaluate the performance of the proposed algorithm on H&E slides obtained from an SVM K-rasG12D lung cancer mouse model using precision/recall rates, F-score, Tanimoto coefficient, and area under the curve (AUC) of the receiver operator characteristic (ROC)
arXiv Detail & Related papers (2021-10-27T19:28:36Z) - Exploiting generative self-supervised learning for the assessment of
biological images with lack of annotations: a COVID-19 case-study [0.41998444721319217]
GAN-DL is a Discriminator Learner based on the StyleGAN2 architecture.
We show that our technique can be exploited not only for classification tasks, but also to effectively derive a dose response curve.
arXiv Detail & Related papers (2021-07-16T08:36:34Z) - G-MIND: An End-to-End Multimodal Imaging-Genetics Framework for
Biomarker Identification and Disease Classification [49.53651166356737]
We propose a novel deep neural network architecture to integrate imaging and genetics data, as guided by diagnosis, that provides interpretable biomarkers.
We have evaluated our model on a population study of schizophrenia that includes two functional MRI (fMRI) paradigms and Single Nucleotide Polymorphism (SNP) data.
arXiv Detail & Related papers (2021-01-27T19:28:04Z) - Explaining Clinical Decision Support Systems in Medical Imaging using
Cycle-Consistent Activation Maximization [112.2628296775395]
Clinical decision support using deep neural networks has become a topic of steadily growing interest.
clinicians are often hesitant to adopt the technology because its underlying decision-making process is considered to be intransparent and difficult to comprehend.
We propose a novel decision explanation scheme based on CycleGAN activation which generates high-quality visualizations of classifier decisions even in smaller data sets.
arXiv Detail & Related papers (2020-10-09T14:39:27Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.