Weakly-supervised learning for image-based classification of primary melanomas into genomic immune subgroups

• URL: http://arxiv.org/abs/2202.11524v1
• Date: Wed, 23 Feb 2022 13:57:35 GMT
• Title: Weakly-supervised learning for image-based classification of primary melanomas into genomic immune subgroups
• Authors: Lucy Godson, Navid Alemi, Jeremie Nsengimana, Graham P. Cook, Emily L. Clarke, Darren Treanor, D. Timothy Bishop, Julia Newton-Bishop and Ali Gooya
• Abstract summary: We develop deep learning models to classify gigapixel H&E stained pathology slides into immune subgroups. We leverage a multiple-instance learning approach, which only requires slide-level labels and uses an attention mechanism to highlight regions of high importance to the classification.
• Score: 1.4585861543119112
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Determining early-stage prognostic markers and stratifying patients for effective treatment are two key challenges for improving outcomes for melanoma patients. Previous studies have used tumour transcriptome data to stratify patients into immune subgroups, which were associated with differential melanoma specific survival and potential treatment strategies. However, acquiring transcriptome data is a time-consuming and costly process. Moreover, it is not routinely used in the current clinical workflow. Here we attempt to overcome this by developing deep learning models to classify gigapixel H&E stained pathology slides, which are well established in clinical workflows, into these immune subgroups. Previous subtyping approaches have employed supervised learning which requires fully annotated data, or have only examined single genetic mutations in melanoma patients. We leverage a multiple-instance learning approach, which only requires slide-level labels and uses an attention mechanism to highlight regions of high importance to the classification. Moreover, we show that pathology-specific self-supervised models generate better representations compared to pathology-agnostic models for improving our model performance, achieving a mean AUC of 0.76 for classifying histopathology images as high or low immune subgroups. We anticipate that this method may allow us to find new biomarkers of high importance and could act as a tool for clinicians to infer the immune landscape of tumours and stratify patients, without needing to carry out additional expensive genetic tests.

Related papers

• Single-Cell Deep Clustering Method Assisted by Exogenous Gene Information: A Novel Approach to Identifying Cell Types [50.55583697209676]
  We develop an attention-enhanced graph autoencoder, which is designed to efficiently capture the topological features between cells. During the clustering process, we integrated both sets of information and reconstructed the features of both cells and genes to generate a discriminative representation. This research offers enhanced insights into the characteristics and distribution of cells, thereby laying the groundwork for early diagnosis and treatment of diseases.
  arXiv  Detail & Related papers  (2023-11-28T09:14:55Z)
• Improving Performance in Colorectal Cancer Histology Decomposition using Deep and Ensemble Machine Learning [0.7437806321813133]
  Histologic samples stained with hematoxylin and eosin are commonly used in colorectal cancer management. Recent research highlights the potential of convolutional neural networks (CNNs) in facilitating the extraction of clinically relevant biomarkers from readily available images. CNN-based biomarkers can predict patient outcomes comparably to golden standards, with the added advantages of speed, automation, and minimal cost.
  arXiv  Detail & Related papers  (2023-10-25T19:46:27Z)
• Deep Learning-Based Prediction of Molecular Tumor Biomarkers from H&E: A Practical Review [0.0]
  Molecular and genomic properties are critical in selecting cancer treatments to target individual tumors. Applying machine learning to H&E images can provide a more cost-effective screening method. This article reviews the diverse applications across cancer types and the methodology to train and validate these models.
  arXiv  Detail & Related papers  (2022-11-27T14:57:41Z)
• A Pathologist-Informed Workflow for Classification of Prostate Glands in Histopathology [62.997667081978825]
  Pathologists diagnose and grade prostate cancer by examining tissue from needle biopsies on glass slides. Cancer's severity and risk of metastasis are determined by the Gleason grade, a score based on the organization and morphology of prostate cancer glands. This paper proposes an automated workflow that follows pathologists' textitmodus operandi, isolating and classifying multi-scale patches of individual glands.
  arXiv  Detail & Related papers  (2022-09-27T14:08:19Z)
• Mapping the landscape of histomorphological cancer phenotypes using self-supervised learning on unlabeled, unannotated pathology slides [9.27127895781971]
  Histomorphological Phenotype Learning operates via the automatic discovery of discriminatory image features in small image tiles. Tiles are grouped into morphologically similar clusters which constitute a library of histomorphological phenotypes.
  arXiv  Detail & Related papers  (2022-05-04T08:06:55Z)
• Multi-class versus One-class classifier in spontaneous speech analysis oriented to Alzheimer Disease diagnosis [58.720142291102135]
  The aim of our project is to contribute to earlier diagnosis of AD and better estimates of its severity by using automatic analysis performed through new biomarkers extracted from speech signal. The use of information about outlier and Fractal Dimension features improves the system performance.
  arXiv  Detail & Related papers  (2022-03-21T09:57:20Z)
• An Attention-based Weakly Supervised framework for Spitzoid Melanocytic Lesion Diagnosis in WSI [1.0948946179065253]
  Melanoma is an aggressive neoplasm responsible for the majority of deaths from skin cancer. The gold standard for its diagnosis and prognosis is the analysis of skin biopsies. We propose a novel end-to-end weakly-supervised deep learning model, based on inductive transfer learning with an improved convolutional neural network (CNN) The framework is composed of a source model in charge of finding the tumor patch-level patterns, and a target model focuses on the specific diagnosis of a biopsy.
  arXiv  Detail & Related papers  (2021-04-20T10:18:57Z)
• G-MIND: An End-to-End Multimodal Imaging-Genetics Framework for Biomarker Identification and Disease Classification [49.53651166356737]
  We propose a novel deep neural network architecture to integrate imaging and genetics data, as guided by diagnosis, that provides interpretable biomarkers. We have evaluated our model on a population study of schizophrenia that includes two functional MRI (fMRI) paradigms and Single Nucleotide Polymorphism (SNP) data.
  arXiv  Detail & Related papers  (2021-01-27T19:28:04Z)
• Select-ProtoNet: Learning to Select for Few-Shot Disease Subtype Prediction [55.94378672172967]
  We focus on few-shot disease subtype prediction problem, identifying subgroups of similar patients. We introduce meta learning techniques to develop a new model, which can extract the common experience or knowledge from interrelated clinical tasks. Our new model is built upon a carefully designed meta-learner, called Prototypical Network, that is a simple yet effective meta learning machine for few-shot image classification.
  arXiv  Detail & Related papers  (2020-09-02T02:50:30Z)
• Divide-and-Rule: Self-Supervised Learning for Survival Analysis in Colorectal Cancer [9.431791041887957]
  We propose a self-supervised learning method that learns a representation of tissue regions as well as a metric of the clustering to obtain their underlying patterns. We show that the proposed approach can benefit from linear predictors to avoid overfitting in patient outcomes predictions.
  arXiv  Detail & Related papers  (2020-07-07T09:15:36Z)
• Spectral-Spatial Recurrent-Convolutional Networks for In-Vivo Hyperspectral Tumor Type Classification [49.32653090178743]
  We demonstrate the feasibility of in-vivo tumor type classification using hyperspectral imaging and deep learning. Our best model achieves an AUC of 76.3%, significantly outperforming previous conventional and deep learning methods.
  arXiv  Detail & Related papers  (2020-07-02T12:00:53Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.