Weakly-supervised learning for image-based classification of primary melanomas into genomic immune subgroups

• URL: http://arxiv.org/abs/2202.11524v1
• Date: Wed, 23 Feb 2022 13:57:35 GMT
• Title: Weakly-supervised learning for image-based classification of primary melanomas into genomic immune subgroups
• Authors: Lucy Godson, Navid Alemi, Jeremie Nsengimana, Graham P. Cook, Emily L. Clarke, Darren Treanor, D. Timothy Bishop, Julia Newton-Bishop and Ali Gooya
• Abstract summary: We develop deep learning models to classify gigapixel H&E stained pathology slides into immune subgroups. We leverage a multiple-instance learning approach, which only requires slide-level labels and uses an attention mechanism to highlight regions of high importance to the classification.
• Score: 1.4585861543119112
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Determining early-stage prognostic markers and stratifying patients for effective treatment are two key challenges for improving outcomes for melanoma patients. Previous studies have used tumour transcriptome data to stratify patients into immune subgroups, which were associated with differential melanoma specific survival and potential treatment strategies. However, acquiring transcriptome data is a time-consuming and costly process. Moreover, it is not routinely used in the current clinical workflow. Here we attempt to overcome this by developing deep learning models to classify gigapixel H&E stained pathology slides, which are well established in clinical workflows, into these immune subgroups. Previous subtyping approaches have employed supervised learning which requires fully annotated data, or have only examined single genetic mutations in melanoma patients. We leverage a multiple-instance learning approach, which only requires slide-level labels and uses an attention mechanism to highlight regions of high importance to the classification. Moreover, we show that pathology-specific self-supervised models generate better representations compared to pathology-agnostic models for improving our model performance, achieving a mean AUC of 0.76 for classifying histopathology images as high or low immune subgroups. We anticipate that this method may allow us to find new biomarkers of high importance and could act as a tool for clinicians to infer the immune landscape of tumours and stratify patients, without needing to carry out additional expensive genetic tests.

Related papers

• Renal Cell Carcinoma subtyping: learning from multi-resolution localization [1.5728609542259502]
  This study investigates a novel self supervised training strategy for machine learning diagnostic tools. We aim at reducing the need of annotated dataset, without significantly reducing the accuracy of the tool. We demonstrate the classification capability of our tool on a whole slide imaging dataset for Renal Cancer subtyping, and we compare our solution with several state-of-the-art classification counterparts.
  arXiv  Detail & Related papers  (2024-11-14T14:21:49Z)
• Single-Cell Deep Clustering Method Assisted by Exogenous Gene Information: A Novel Approach to Identifying Cell Types [50.55583697209676]
  We develop an attention-enhanced graph autoencoder, which is designed to efficiently capture the topological features between cells. During the clustering process, we integrated both sets of information and reconstructed the features of both cells and genes to generate a discriminative representation. This research offers enhanced insights into the characteristics and distribution of cells, thereby laying the groundwork for early diagnosis and treatment of diseases.
  arXiv  Detail & Related papers  (2023-11-28T09:14:55Z)
• Regression-based Deep-Learning predicts molecular biomarkers from pathology slides [40.24757332810004]
  We developed and evaluated a new self-supervised attention-based weakly supervised regression method that predicts continuous biomarkers directly from images. Using regression significantly enhances the accuracy of biomarker prediction, while also improving the interpretability of the results over classification. Our open-source regression approach offers a promising alternative for continuous biomarker analysis in computational pathology.
  arXiv  Detail & Related papers  (2023-04-11T11:43:51Z)
• Deep Learning-Based Prediction of Molecular Tumor Biomarkers from H&E: A Practical Review [0.0]
  Molecular and genomic properties are critical in selecting cancer treatments to target individual tumors. Applying machine learning to H&E images can provide a more cost-effective screening method. This article reviews the diverse applications across cancer types and the methodology to train and validate these models.
  arXiv  Detail & Related papers  (2022-11-27T14:57:41Z)
• Mapping the landscape of histomorphological cancer phenotypes using self-supervised learning on unlabeled, unannotated pathology slides [9.27127895781971]
  Histomorphological Phenotype Learning operates via the automatic discovery of discriminatory image features in small image tiles. Tiles are grouped into morphologically similar clusters which constitute a library of histomorphological phenotypes.
  arXiv  Detail & Related papers  (2022-05-04T08:06:55Z)
• An Attention-based Weakly Supervised framework for Spitzoid Melanocytic Lesion Diagnosis in WSI [1.0948946179065253]
  Melanoma is an aggressive neoplasm responsible for the majority of deaths from skin cancer. The gold standard for its diagnosis and prognosis is the analysis of skin biopsies. We propose a novel end-to-end weakly-supervised deep learning model, based on inductive transfer learning with an improved convolutional neural network (CNN) The framework is composed of a source model in charge of finding the tumor patch-level patterns, and a target model focuses on the specific diagnosis of a biopsy.
  arXiv  Detail & Related papers  (2021-04-20T10:18:57Z)
• Cancer Gene Profiling through Unsupervised Discovery [49.28556294619424]
  We introduce a novel, automatic and unsupervised framework to discover low-dimensional gene biomarkers. Our method is based on the LP-Stability algorithm, a high dimensional center-based unsupervised clustering algorithm. Our signature reports promising results on distinguishing immune inflammatory and immune desert tumors.
  arXiv  Detail & Related papers  (2021-02-11T09:04:45Z)
• G-MIND: An End-to-End Multimodal Imaging-Genetics Framework for Biomarker Identification and Disease Classification [49.53651166356737]
  We propose a novel deep neural network architecture to integrate imaging and genetics data, as guided by diagnosis, that provides interpretable biomarkers. We have evaluated our model on a population study of schizophrenia that includes two functional MRI (fMRI) paradigms and Single Nucleotide Polymorphism (SNP) data.
  arXiv  Detail & Related papers  (2021-01-27T19:28:04Z)
• Select-ProtoNet: Learning to Select for Few-Shot Disease Subtype Prediction [55.94378672172967]
  We focus on few-shot disease subtype prediction problem, identifying subgroups of similar patients. We introduce meta learning techniques to develop a new model, which can extract the common experience or knowledge from interrelated clinical tasks. Our new model is built upon a carefully designed meta-learner, called Prototypical Network, that is a simple yet effective meta learning machine for few-shot image classification.
  arXiv  Detail & Related papers  (2020-09-02T02:50:30Z)
• Divide-and-Rule: Self-Supervised Learning for Survival Analysis in Colorectal Cancer [9.431791041887957]
  We propose a self-supervised learning method that learns a representation of tissue regions as well as a metric of the clustering to obtain their underlying patterns. We show that the proposed approach can benefit from linear predictors to avoid overfitting in patient outcomes predictions.
  arXiv  Detail & Related papers  (2020-07-07T09:15:36Z)
• Spectral-Spatial Recurrent-Convolutional Networks for In-Vivo Hyperspectral Tumor Type Classification [49.32653090178743]
  We demonstrate the feasibility of in-vivo tumor type classification using hyperspectral imaging and deep learning. Our best model achieves an AUC of 76.3%, significantly outperforming previous conventional and deep learning methods.
  arXiv  Detail & Related papers  (2020-07-02T12:00:53Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.