Visualization for Histopathology Images using Graph Convolutional Neural Networks

• URL: http://arxiv.org/abs/2006.09464v1
• Date: Tue, 16 Jun 2020 19:14:19 GMT
• Title: Visualization for Histopathology Images using Graph Convolutional Neural Networks
• Authors: Mookund Sureka, Abhijeet Patil, Deepak Anand, Amit Sethi
• Abstract summary: We adopt an approach to model histology tissue as a graph of nuclei and develop a graph convolutional network framework for disease diagnosis. Our visualization of such networks trained to distinguish between invasive and in-situ breast cancers, and Gleason 3 and 4 prostate cancers generate interpretable visual maps.
• Score: 1.8939984161954087
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: With the increase in the use of deep learning for computer-aided diagnosis in medical images, the criticism of the black-box nature of the deep learning models is also on the rise. The medical community needs interpretable models for both due diligence and advancing the understanding of disease and treatment mechanisms. In histology, in particular, while there is rich detail available at the cellular level and that of spatial relationships between cells, it is difficult to modify convolutional neural networks to point out the relevant visual features. We adopt an approach to model histology tissue as a graph of nuclei and develop a graph convolutional network framework based on attention mechanism and node occlusion for disease diagnosis. The proposed method highlights the relative contribution of each cell nucleus in the whole-slide image. Our visualization of such networks trained to distinguish between invasive and in-situ breast cancers, and Gleason 3 and 4 prostate cancers generate interpretable visual maps that correspond well with our understanding of the structures that are important to experts for their diagnosis.

Related papers

• Pathology-genomic fusion via biologically informed cross-modality graph learning for survival analysis [7.996257103473235]
  We propose Pathology-Genome Heterogeneous Graph (PGHG) that integrates whole slide images (WSI) and bulk RNA-Seq expression data with heterogeneous graph neural network for cancer survival analysis. The PGHG consists of biological knowledge-guided representation learning network and pathology-genome heterogeneous graph. We evaluate the model on low-grade gliomas, glioblastoma, and kidney renal papillary cell carcinoma datasets from the Cancer Genome Atlas.
  arXiv  Detail & Related papers  (2024-04-11T09:07:40Z)
• Digital Histopathology with Graph Neural Networks: Concepts and Explanations for Clinicians [54.136225756724755]
  We provide global explanations for Graph Neural Networks using GCExplainer and Logic Explained Networks. By training on H&E slides of breast cancer, we show promising results in offering explainable and trustworthy AI tools for clinicians.
  arXiv  Detail & Related papers  (2023-12-04T00:20:50Z)
• Classification of developmental and brain disorders via graph convolutional aggregation [6.6356049194991815]
  We introduce an aggregator normalization graph convolutional network by leveraging aggregation in graph sampling. The proposed model learns discriminative graph node representations by incorporating both imaging and non-imaging features into the graph nodes and edges. We benchmark our model against several recent baseline methods on two large datasets, Autism Brain Imaging Data Exchange (ABIDE) and Alzheimer's Disease Neuroimaging Initiative (ADNI)
  arXiv  Detail & Related papers  (2023-11-13T14:36:29Z)
• Tertiary Lymphoid Structures Generation through Graph-based Diffusion [54.37503714313661]
  In this work, we leverage state-of-the-art graph-based diffusion models to generate biologically meaningful cell-graphs. We show that the adopted graph diffusion model is able to accurately learn the distribution of cells in terms of their tertiary lymphoid structures (TLS) content.
  arXiv  Detail & Related papers  (2023-10-10T14:37:17Z)
• Deep Learning Generates Synthetic Cancer Histology for Explainability and Education [37.13457398561086]
  Conditional generative adversarial networks (cGANs) are AI models that generate synthetic images. We describe the use of a cGAN for explaining models trained to classify molecularly-subtyped tumors. We show that clear, intuitive cGAN visualizations can reinforce and improve human understanding of histologic manifestations of tumor biology.
  arXiv  Detail & Related papers  (2022-11-12T00:14:57Z)
• Contrastive Brain Network Learning via Hierarchical Signed Graph Pooling Model [64.29487107585665]
  Graph representation learning techniques on brain functional networks can facilitate the discovery of novel biomarkers for clinical phenotypes and neurodegenerative diseases. Here, we propose an interpretable hierarchical signed graph representation learning model to extract graph-level representations from brain functional networks. In order to further improve the model performance, we also propose a new strategy to augment functional brain network data for contrastive learning.
  arXiv  Detail & Related papers  (2022-07-14T20:03:52Z)
• Functional2Structural: Cross-Modality Brain Networks Representation Learning [55.24969686433101]
  Graph mining on brain networks may facilitate the discovery of novel biomarkers for clinical phenotypes and neurodegenerative diseases. We propose a novel graph learning framework, known as Deep Signed Brain Networks (DSBN), with a signed graph encoder. We validate our framework on clinical phenotype and neurodegenerative disease prediction tasks using two independent, publicly available datasets.
  arXiv  Detail & Related papers  (2022-05-06T03:45:36Z)
• An explainability framework for cortical surface-based deep learning [110.83289076967895]
  We develop a framework for cortical surface-based deep learning. First, we adapted a perturbation-based approach for use with surface data. We show that our explainability framework is not only able to identify important features and their spatial location but that it is also reliable and valid.
  arXiv  Detail & Related papers  (2022-03-15T23:16:49Z)
• Graph Convolutional Networks for Multi-modality Medical Imaging: Methods, Architectures, and Clinical Applications [13.940158397866625]
  Development of graph convolutional networks (GCNs) has spawned a new wave of research in medical imaging analysis. GCNs capabilities have spawned a new wave of research in medical imaging analysis with the overarching goal of improving quantitative disease understanding, monitoring, and diagnosis.
  arXiv  Detail & Related papers  (2022-02-17T22:03:59Z)
• A Survey on Graph-Based Deep Learning for Computational Histopathology [36.58189530598098]
  We have witnessed a rapid expansion of the use of machine learning and deep learning for the analysis of digital pathology and biopsy image patches. Traditional learning over patch-wise features using convolutional neural networks limits the model when attempting to capture global contextual information. We provide a conceptual grounding of graph-based deep learning and discuss its current success for tumor localization and classification, tumor invasion and staging, image retrieval, and survival prediction.
  arXiv  Detail & Related papers  (2021-07-01T07:50:35Z)
• CS2-Net: Deep Learning Segmentation of Curvilinear Structures in Medical Imaging [90.78899127463445]
  We propose a generic and unified convolution neural network for the segmentation of curvilinear structures. We introduce a new curvilinear structure segmentation network (CS2-Net), which includes a self-attention mechanism in the encoder and decoder.
  arXiv  Detail & Related papers  (2020-10-15T03:06:37Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.