Computational analysis of pathological image enables interpretable
prediction for microsatellite instability
- URL: http://arxiv.org/abs/2010.03130v1
- Date: Wed, 7 Oct 2020 03:05:05 GMT
- Title: Computational analysis of pathological image enables interpretable
prediction for microsatellite instability
- Authors: Jin Zhu, Wangwei Wu, Yuting Zhang, Shiyun Lin, Yukang Jiang, Ruixian
Liu, Xueqin Wang
- Abstract summary: Microsatellite instability (MSI) is associated with several tumor types and its status has become increasingly vital in guiding patient treatment decisions.
In this study, interpretable pathological image analysis strategies are established to help medical experts to automatically identify MSI.
The strategies only require ubiquitous Haematoxylin and eosin-stained whole-slide images and can achieve decent performance in the three cohorts collected from The Cancer Genome Atlas.
- Score: 5.774965366076466
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: Microsatellite instability (MSI) is associated with several tumor types and
its status has become increasingly vital in guiding patient treatment
decisions. However, in clinical practice, distinguishing MSI from its
counterpart is challenging since the diagnosis of MSI requires additional
genetic or immunohistochemical tests. In this study, interpretable pathological
image analysis strategies are established to help medical experts to
automatically identify MSI. The strategies only require ubiquitous Haematoxylin
and eosin-stained whole-slide images and can achieve decent performance in the
three cohorts collected from The Cancer Genome Atlas. The strategies provide
interpretability in two aspects. On the one hand, the image-level
interpretability is achieved by generating localization heat maps of important
regions based on the deep learning network; on the other hand, the
feature-level interpretability is attained through feature importance and
pathological feature interaction analysis. More interestingly, both from the
image-level and feature-level interpretability, color features and texture
characteristics are shown to contribute the most to the MSI predictions.
Therefore, the classification models under the proposed strategies can not only
serve as an efficient tool for predicting the MSI status of patients, but also
provide more insights to pathologists with clinical understanding.
Related papers
- Multimodal Cross-Task Interaction for Survival Analysis in Whole Slide Pathological Images [10.996711454572331]
Survival prediction, utilizing pathological images and genomic profiles, is increasingly important in cancer analysis and prognosis.
Existing multimodal methods often rely on alignment strategies to integrate complementary information.
We propose a Multimodal Cross-Task Interaction (MCTI) framework to explore the intrinsic correlations between subtype classification and survival analysis tasks.
arXiv Detail & Related papers (2024-06-25T02:18:35Z) - QUBIQ: Uncertainty Quantification for Biomedical Image Segmentation Challenge [93.61262892578067]
Uncertainty in medical image segmentation tasks, especially inter-rater variability, presents a significant challenge.
This variability directly impacts the development and evaluation of automated segmentation algorithms.
We report the set-up and summarize the benchmark results of the Quantification of Uncertainties in Biomedical Image Quantification Challenge (QUBIQ)
arXiv Detail & Related papers (2024-03-19T17:57:24Z) - A self-supervised framework for learning whole slide representations [52.774822784847565]
We present Slide Pre-trained Transformers (SPT) for gigapixel-scale self-supervision of whole slide images.
We benchmark SPT visual representations on five diagnostic tasks across three biomedical microscopy datasets.
arXiv Detail & Related papers (2024-02-09T05:05:28Z) - Style transfer between Microscopy and Magnetic Resonance Imaging via
Generative Adversarial Network in small sample size settings [49.84018914962972]
Cross-modal augmentation of Magnetic Resonance Imaging (MRI) and microscopic imaging based on the same tissue samples is promising.
We tested a method for generating microscopic histological images from MRI scans of the corpus callosum using conditional generative adversarial network (cGAN) architecture.
arXiv Detail & Related papers (2023-10-16T13:58:53Z) - K-Space-Aware Cross-Modality Score for Synthesized Neuroimage Quality
Assessment [71.27193056354741]
The problem of how to assess cross-modality medical image synthesis has been largely unexplored.
We propose a new metric K-CROSS to spur progress on this challenging problem.
K-CROSS uses a pre-trained multi-modality segmentation network to predict the lesion location.
arXiv Detail & Related papers (2023-07-10T01:26:48Z) - Detecting Histologic & Clinical Glioblastoma Patterns of Prognostic
Relevance [6.281092892485014]
Glioblastoma is the most common and aggressive malignant adult tumor of the central nervous system.
Since adopting the current standard-of-care treatment 18 years ago, no substantial prognostic improvement has been noticed.
Here, we focus on identifying prognostically relevant characteristics from H&E stained WSI & clinical data relating to OS.
arXiv Detail & Related papers (2023-02-01T18:56:09Z) - Hierarchical Transformer for Survival Prediction Using Multimodality
Whole Slide Images and Genomics [63.76637479503006]
Learning good representation of giga-pixel level whole slide pathology images (WSI) for downstream tasks is critical.
This paper proposes a hierarchical-based multimodal transformer framework that learns a hierarchical mapping between pathology images and corresponding genes.
Our architecture requires fewer GPU resources compared with benchmark methods while maintaining better WSI representation ability.
arXiv Detail & Related papers (2022-11-29T23:47:56Z) - Deep Learning-Based Sparse Whole-Slide Image Analysis for the Diagnosis
of Gastric Intestinal Metaplasia [5.64692772904991]
We propose a sparse WSI analysis method for the rapid identification of high-power ROI for WSI-level classification.
We test our method on a common but time-consuming task in pathology - that of diagnosing gastric intestinal metaplasia (GIM) on hematoxylin and eosin slides.
Our method successfully detects GIM in all positive WSI, with a WSI-level classification area under the receiver operating characteristic curve (AUC) of 0.98 and an average precision (AP) of 0.95.
arXiv Detail & Related papers (2022-01-05T04:43:46Z) - MIMO: Mutual Integration of Patient Journey and Medical Ontology for
Healthcare Representation Learning [49.57261599776167]
We propose an end-to-end robust Transformer-based solution, Mutual Integration of patient journey and Medical Ontology (MIMO) for healthcare representation learning and predictive analytics.
arXiv Detail & Related papers (2021-07-20T07:04:52Z) - Multi-task Graph Convolutional Neural Network for Calcification
Morphology and Distribution Analysis in Mammograms [4.731981307843478]
morphology and distribution of microcalcifications in a cluster are the most important characteristics for radiologists to diagnose breast cancer.
We propose a multi-task deep graph convolutional network (GCN) method for the automatic characterization of morphology and distribution of microcalcifications in mammograms.
arXiv Detail & Related papers (2021-05-14T13:32:47Z) - Multiple Sclerosis Lesion Analysis in Brain Magnetic Resonance Images:
Techniques and Clinical Applications [22.410543483471915]
Multiple sclerosis (MS) is a chronic inflammatory and degenerative disease of the central nervous system.
Traditionally, MS lesions have been manually annotated on 2D MRI slices.
Deep learning techniques have achieved remarkable breakthroughs in the MS lesion segmentation task.
arXiv Detail & Related papers (2021-04-20T15:08:51Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.