Pan-Cancer Integrative Histology-Genomic Analysis via Interpretable Multimodal Deep Learning

• URL: http://arxiv.org/abs/2108.02278v1
• Date: Wed, 4 Aug 2021 20:40:05 GMT
• Title: Pan-Cancer Integrative Histology-Genomic Analysis via Interpretable Multimodal Deep Learning
• Authors: Richard J. Chen, Ming Y. Lu, Drew F. K. Williamson, Tiffany Y. Chen, Jana Lipkova, Muhammad Shaban, Maha Shady, Mane Williams, Bumjin Joo, Zahra Noor, Faisal Mahmood
• Abstract summary: We integrate whole slide pathology images, RNA-seq abundance, copy number variation, and mutation data from 5,720 patients across 14 major cancer types. Our interpretable, weakly-supervised, multimodal deep learning algorithm is able to fuse these heterogeneous modalities for predicting outcomes. We analyze morphologic and molecular markers responsible for prognostic predictions across all cancer types.
• Score: 4.764927152701701
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The rapidly emerging field of deep learning-based computational pathology has demonstrated promise in developing objective prognostic models from histology whole slide images. However, most prognostic models are either based on histology or genomics alone and do not address how histology and genomics can be integrated to develop joint image-omic prognostic models. Additionally identifying explainable morphological and molecular descriptors from these models that govern such prognosis is of interest. We used multimodal deep learning to integrate gigapixel whole slide pathology images, RNA-seq abundance, copy number variation, and mutation data from 5,720 patients across 14 major cancer types. Our interpretable, weakly-supervised, multimodal deep learning algorithm is able to fuse these heterogeneous modalities for predicting outcomes and discover prognostic features from these modalities that corroborate with poor and favorable outcomes via multimodal interpretability. We compared our model with unimodal deep learning models trained on histology slides and molecular profiles alone, and demonstrate performance increase in risk stratification on 9 out of 14 cancers. In addition, we analyze morphologic and molecular markers responsible for prognostic predictions across all cancer types. All analyzed data, including morphological and molecular correlates of patient prognosis across the 14 cancer types at a disease and patient level are presented in an interactive open-access database (http://pancancer.mahmoodlab.org) to allow for further exploration and prognostic biomarker discovery. To validate that these model explanations are prognostic, we further analyzed high attention morphological regions in WSIs, which indicates that tumor-infiltrating lymphocyte presence corroborates with favorable cancer prognosis on 9 out of 14 cancer types studied.

Related papers

• Pathology-genomic fusion via biologically informed cross-modality graph learning for survival analysis [7.996257103473235]
  We propose Pathology-Genome Heterogeneous Graph (PGHG) that integrates whole slide images (WSI) and bulk RNA-Seq expression data with heterogeneous graph neural network for cancer survival analysis. The PGHG consists of biological knowledge-guided representation learning network and pathology-genome heterogeneous graph. We evaluate the model on low-grade gliomas, glioblastoma, and kidney renal papillary cell carcinoma datasets from the Cancer Genome Atlas.
  arXiv  Detail & Related papers  (2024-04-11T09:07:40Z)
• Gene-MOE: A sparsely gated prognosis and classification framework exploiting pan-cancer genomic information [13.57379781623848]
  We introduce a novel sparsely gated RNA-seq analysis framework called Gene-MOE. Gene-MOE exploits the potential of the MOE layers and the proposed mixture of attention expert layers to enhance the analysis accuracy. It addresses overfitting challenges by integrating pan-cancer information from 33 distinct cancer types through pre-training.
  arXiv  Detail & Related papers  (2023-11-29T07:09:25Z)
• Artificial-intelligence-based molecular classification of diffuse gliomas using rapid, label-free optical imaging [59.79875531898648]
  DeepGlioma is an artificial-intelligence-based diagnostic screening system. DeepGlioma can predict the molecular alterations used by the World Health Organization to define the adult-type diffuse glioma taxonomy.
  arXiv  Detail & Related papers  (2023-03-23T18:50:18Z)
• Machine Learning Methods for Cancer Classification Using Gene Expression Data: A Review [77.34726150561087]
  Cancer is the second major cause of death after cardiovascular diseases. Gene expression can play a fundamental role in the early detection of cancer. This study reviews recent progress in gene expression analysis for cancer classification using machine learning methods.
  arXiv  Detail & Related papers  (2023-01-28T15:03:03Z)
• Deep learning methods for drug response prediction in cancer: predominant and emerging trends [50.281853616905416]
  Exploiting computational predictive models to study and treat cancer holds great promise in improving drug development and personalized design of treatment plans. A wave of recent papers demonstrates promising results in predicting cancer response to drug treatments while utilizing deep learning methods. This review allows to better understand the current state of the field and identify major challenges and promising solution paths.
  arXiv  Detail & Related papers  (2022-11-18T03:26:31Z)
• Attention-based Interpretable Regression of Gene Expression in Histology [0.0]
  Interpretability of deep learning is widely used to evaluate the reliability of medical imaging models. We show that interpretability can reveal connections between the microscopic appearance of cancer tissue and its gene expression profiling.
  arXiv  Detail & Related papers  (2022-08-29T07:30:33Z)
• Contrastive learning-based computational histopathology predict differential expression of cancer driver genes [13.167222116204226]
  HistCode is a self-supervised contrastive learning framework to infer differential gene expressions from whole slide images. Our experiments showed that our method outperformed other state-of-the-art models in tumor diagnosis tasks.
  arXiv  Detail & Related papers  (2022-04-25T23:21:33Z)
• Transcriptome-wide prediction of prostate cancer gene expression from histopathology images using co-expression based convolutional neural networks [0.8874479658912061]
  We propose a new, computationally efficient approach for disease specific modelling of relationships between morphology and gene expression. We conducted the first transcriptome-wide analysis in prostate cancer, using CNNs to predict bulk RNA-sequencing estimates.
  arXiv  Detail & Related papers  (2021-04-19T13:50:25Z)
• G-MIND: An End-to-End Multimodal Imaging-Genetics Framework for Biomarker Identification and Disease Classification [49.53651166356737]
  We propose a novel deep neural network architecture to integrate imaging and genetics data, as guided by diagnosis, that provides interpretable biomarkers. We have evaluated our model on a population study of schizophrenia that includes two functional MRI (fMRI) paradigms and Single Nucleotide Polymorphism (SNP) data.
  arXiv  Detail & Related papers  (2021-01-27T19:28:04Z)
• Topological Data Analysis of copy number alterations in cancer [70.85487611525896]
  We explore the potential to capture information contained in cancer genomic information using a novel topology-based approach. We find that this technique has the potential to extract meaningful low-dimensional representations in cancer somatic genetic data.
  arXiv  Detail & Related papers  (2020-11-22T17:31:23Z)
• A Systematic Approach to Featurization for Cancer Drug Sensitivity Predictions with Deep Learning [49.86828302591469]
  We train >35,000 neural network models, sweeping over common featurization techniques. We found the RNA-seq to be highly redundant and informative even with subsets larger than 128 features.
  arXiv  Detail & Related papers  (2020-04-30T20:42:17Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.