Interpretable HER2 scoring by evaluating clinical Guidelines through a weakly supervised, constrained Deep Learning Approach

• URL: http://arxiv.org/abs/2211.09559v1
• Date: Thu, 17 Nov 2022 14:28:35 GMT
• Title: Interpretable HER2 scoring by evaluating clinical Guidelines through a weakly supervised, constrained Deep Learning Approach
• Authors: Manh Dan Pham, Cyprien Tilmant, St\'ephanie Petit, Isabelle Salmon, Saima Ben Hadj, Rutger H.J. Fick
• Abstract summary: This paper focuses on the interpretability of HER2 scoring by a pathologist. We propose a semi-automatic, two-stage deep learning approach that directly evaluates the clinical HER2 guidelines. We achieve a performance of 0.78 in F1-score on the test set while keeping our model interpretable for the pathologist.
• Score: 0.0
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: The evaluation of the Human Epidermal growth factor Receptor-2 (HER2) expression is an important prognostic biomarker for breast cancer treatment selection. However, HER2 scoring has notoriously high interobserver variability due to stain variations between centers and the need to estimate visually the staining intensity in specific percentages of tumor area. In this paper, focusing on the interpretability of HER2 scoring by a pathologist, we propose a semi-automatic, two-stage deep learning approach that directly evaluates the clinical HER2 guidelines defined by the American Society of Clinical Oncology/ College of American Pathologists (ASCO/CAP). In the first stage, we segment the invasive tumor over the user-indicated Region of Interest (ROI). Then, in the second stage, we classify the tumor tissue into four HER2 classes. For the classification stage, we use weakly supervised, constrained optimization to find a model that classifies cancerous patches such that the tumor surface percentage meets the guidelines specification of each HER2 class. We end the second stage by freezing the model and refining its output logits in a supervised way to all slide labels in the training set. To ensure the quality of our dataset's labels, we conducted a multi-pathologist HER2 scoring consensus. For the assessment of doubtful cases where no consensus was found, our model can help by interpreting its HER2 class percentages output. We achieve a performance of 0.78 in F1-score on the test set while keeping our model interpretable for the pathologist, hopefully contributing to interpretable AI models in digital pathology.

Related papers

• Automated HER2 Scoring in Breast Cancer Images Using Deep Learning and Pyramid Sampling [3.711848341917877]
  We introduce a deep learning-based approach utilizing pyramid sampling for the automated classification of HER2 status in IHC-stained BC tissue images. Our approach analyzes morphological features at various spatial scales, efficiently managing the computational load and facilitating a detailed examination of cellular and larger-scale tissue-level details.
  arXiv  Detail & Related papers  (2024-04-01T00:23:22Z)
• Addressing Uncertainty in Imbalanced Histopathology Image Classification of HER2 Breast Cancer: An interpretable Ensemble Approach with Threshold Filtered Single Instance Evaluation (SIE) [0.0]
  Early diagnosis can alleviate the mortality rate by helping patients make efficient treatment decisions. HER2 has become one the most lethal subtype of Breast Cancer. DenseNet201 and Xception have been ensembled into a single classifier.
  arXiv  Detail & Related papers  (2023-08-01T19:44:31Z)
• Learning to diagnose cirrhosis from radiological and histological labels with joint self and weakly-supervised pretraining strategies [62.840338941861134]
  We propose to leverage transfer learning from large datasets annotated by radiologists, to predict the histological score available on a small annex dataset. We compare different pretraining methods, namely weakly-supervised and self-supervised ones, to improve the prediction of the cirrhosis. This method outperforms the baseline classification of the METAVIR score, reaching an AUC of 0.84 and a balanced accuracy of 0.75.
  arXiv  Detail & Related papers  (2023-02-16T17:06:23Z)
• Rethinking Semi-Supervised Medical Image Segmentation: A Variance-Reduction Perspective [51.70661197256033]
  We propose ARCO, a semi-supervised contrastive learning framework with stratified group theory for medical image segmentation. We first propose building ARCO through the concept of variance-reduced estimation and show that certain variance-reduction techniques are particularly beneficial in pixel/voxel-level segmentation tasks. We experimentally validate our approaches on eight benchmarks, i.e., five 2D/3D medical and three semantic segmentation datasets, with different label settings.
  arXiv  Detail & Related papers  (2023-02-03T13:50:25Z)
• A Pathologist-Informed Workflow for Classification of Prostate Glands in Histopathology [62.997667081978825]
  Pathologists diagnose and grade prostate cancer by examining tissue from needle biopsies on glass slides. Cancer's severity and risk of metastasis are determined by the Gleason grade, a score based on the organization and morphology of prostate cancer glands. This paper proposes an automated workflow that follows pathologists' textitmodus operandi, isolating and classifying multi-scale patches of individual glands.
  arXiv  Detail & Related papers  (2022-09-27T14:08:19Z)
• Moving from 2D to 3D: volumetric medical image classification for rectal cancer staging [62.346649719614]
  preoperative discrimination between T2 and T3 stages is arguably both the most challenging and clinically significant task for rectal cancer treatment. We present a volumetric convolutional neural network to accurately discriminate T2 from T3 stage rectal cancer with rectal MR volumes.
  arXiv  Detail & Related papers  (2022-09-13T07:10:14Z)
• A Deep Learning Approach to Predicting Collateral Flow in Stroke Patients Using Radiomic Features from Perfusion Images [58.17507437526425]
  Collateral circulation results from specialized anastomotic channels which provide oxygenated blood to regions with compromised blood flow. The actual grading is mostly done through manual inspection of the acquired images. We present a deep learning approach to predicting collateral flow grading in stroke patients based on radiomic features extracted from MR perfusion data.
  arXiv  Detail & Related papers  (2021-10-24T18:58:40Z)
• Automated Scoring System of HER2 in Pathological Images under the Microscope [3.689994643251581]
  We propose a HER2 automated scoring system that strictly follows the HER2 scoring guidelines. The proposed system will be embedded in our Thorough Eye platform for deployment in hospitals.
  arXiv  Detail & Related papers  (2021-10-21T01:38:35Z)
• SlideGraph+: Whole Slide Image Level Graphs to Predict HER2Status in Breast Cancer [1.8374319565577157]
  We propose a novel graph neural network (GNN) based model to predict HER2 status directly from whole-slide images of routine Haematoxylin and Eosin slides. We demonstrate that the proposed model outperforms the state-of-the-art methods with area under the ROC curve (ordering) values > 0.75 on TCGA and 0.8 on independent test sets.
  arXiv  Detail & Related papers  (2021-10-12T14:40:15Z)
• Microscope Based HER2 Scoring System [37.747953235497256]
  We propose a real-time HER2 scoring system, which follows the HER2 scoring guidelines to complete diagnosis. Unlike the previous scoring systems based on whole-slide imaging, our HER2 scoring system is integrated into an augmented reality microscope.
  arXiv  Detail & Related papers  (2020-09-15T01:44:39Z)
• Segmentation of the Myocardium on Late-Gadolinium Enhanced MRI based on 2.5 D Residual Squeeze and Excitation Deep Learning Model [55.09533240649176]
  The aim of this work is to develop an accurate automatic segmentation method based on deep learning models for the myocardial borders on LGE-MRI. A total number of 320 exams (with a mean number of 6 slices per exam) were used for training and 28 exams used for testing. The performance analysis of the proposed ensemble model in the basal and middle slices was similar as compared to intra-observer study and slightly lower at apical slices.
  arXiv  Detail & Related papers  (2020-05-27T20:44:38Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.