Microscope Based HER2 Scoring System
- URL: http://arxiv.org/abs/2009.06816v1
- Date: Tue, 15 Sep 2020 01:44:39 GMT
- Title: Microscope Based HER2 Scoring System
- Authors: Jun Zhang, Kuan Tian, Pei Dong, Haocheng Shen, Kezhou Yan, Jianhua
Yao, Junzhou Huang, Xiao Han
- Abstract summary: We propose a real-time HER2 scoring system, which follows the HER2 scoring guidelines to complete diagnosis.
Unlike the previous scoring systems based on whole-slide imaging, our HER2 scoring system is integrated into an augmented reality microscope.
- Score: 37.747953235497256
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: The overexpression of human epidermal growth factor receptor 2 (HER2) has
been established as a therapeutic target in multiple types of cancers, such as
breast and gastric cancers. Immunohistochemistry (IHC) is employed as a basic
HER2 test to identify the HER2-positive, borderline, and HER2-negative
patients. However, the reliability and accuracy of HER2 scoring are affected by
many factors, such as pathologists' experience. Recently, artificial
intelligence (AI) has been used in various disease diagnosis to improve
diagnostic accuracy and reliability, but the interpretation of diagnosis
results is still an open problem. In this paper, we propose a real-time HER2
scoring system, which follows the HER2 scoring guidelines to complete the
diagnosis, and thus each step is explainable. Unlike the previous scoring
systems based on whole-slide imaging, our HER2 scoring system is integrated
into an augmented reality (AR) microscope that can feedback AI results to the
pathologists while reading the slide. The pathologists can help select
informative fields of view (FOVs), avoiding the confounding regions, such as
DCIS. Importantly, we illustrate the intermediate results with membrane
staining condition and cell classification results, making it possible to
evaluate the reliability of the diagnostic results. Also, we support the
interactive modification of selecting regions-of-interest, making our system
more flexible in clinical practice. The collaboration of AI and pathologists
can significantly improve the robustness of our system. We evaluate our system
with 285 breast IHC HER2 slides, and the classification accuracy of 95\% shows
the effectiveness of our HER2 scoring system.
Related papers
- Automated HER2 Scoring in Breast Cancer Images Using Deep Learning and Pyramid Sampling [3.711848341917877]
We introduce a deep learning-based approach utilizing pyramid sampling for the automated classification of HER2 status in IHC-stained BC tissue images.
Our approach analyzes morphological features at various spatial scales, efficiently managing the computational load and facilitating a detailed examination of cellular and larger-scale tissue-level details.
arXiv Detail & Related papers (2024-04-01T00:23:22Z) - Addressing Uncertainty in Imbalanced Histopathology Image Classification
of HER2 Breast Cancer: An interpretable Ensemble Approach with Threshold
Filtered Single Instance Evaluation (SIE) [0.0]
Early diagnosis can alleviate the mortality rate by helping patients make efficient treatment decisions.
HER2 has become one the most lethal subtype of Breast Cancer.
DenseNet201 and Xception have been ensembled into a single classifier.
arXiv Detail & Related papers (2023-08-01T19:44:31Z) - Interpretable HER2 scoring by evaluating clinical Guidelines through a
weakly supervised, constrained Deep Learning Approach [0.0]
This paper focuses on the interpretability of HER2 scoring by a pathologist.
We propose a semi-automatic, two-stage deep learning approach that directly evaluates the clinical HER2 guidelines.
We achieve a performance of 0.78 in F1-score on the test set while keeping our model interpretable for the pathologist.
arXiv Detail & Related papers (2022-11-17T14:28:35Z) - A Pathologist-Informed Workflow for Classification of Prostate Glands in
Histopathology [62.997667081978825]
Pathologists diagnose and grade prostate cancer by examining tissue from needle biopsies on glass slides.
Cancer's severity and risk of metastasis are determined by the Gleason grade, a score based on the organization and morphology of prostate cancer glands.
This paper proposes an automated workflow that follows pathologists' textitmodus operandi, isolating and classifying multi-scale patches of individual glands.
arXiv Detail & Related papers (2022-09-27T14:08:19Z) - SpineNetV2: Automated Detection, Labelling and Radiological Grading Of
Clinical MR Scans [70.04389979779195]
SpineNetV2 is an automated tool which detects and labels vertebral bodies in clinical spinal magnetic resonance (MR) scans.
It also performs radiological grading of lumbar intervertebral discs in T2-weighted scans for a range of common degenerative changes.
arXiv Detail & Related papers (2022-05-03T15:05:58Z) - Multi-Scale Hybrid Vision Transformer for Learning Gastric Histology:
AI-Based Decision Support System for Gastric Cancer Treatment [50.89811515036067]
Gastric endoscopic screening is an effective way to decide appropriate gastric cancer (GC) treatment at an early stage, reducing GC-associated mortality rate.
We propose a practical AI system that enables five subclassifications of GC pathology, which can be directly matched to general GC treatment guidance.
arXiv Detail & Related papers (2022-02-17T08:33:52Z) - SpineOne: A One-Stage Detection Framework for Degenerative Discs and
Vertebrae [54.751251046196494]
We propose a one-stage detection framework termed SpineOne to simultaneously localize and classify degenerative discs and vertebrae from MRI slices.
SpineOne is built upon the following three key techniques: 1) a new design of the keypoint heatmap to facilitate simultaneous keypoint localization and classification; 2) the use of attention modules to better differentiate the representations between discs and vertebrae; and 3) a novel gradient-guided objective association mechanism to associate multiple learning objectives at the later training stage.
arXiv Detail & Related papers (2021-10-28T12:59:06Z) - Automated Scoring System of HER2 in Pathological Images under the
Microscope [3.689994643251581]
We propose a HER2 automated scoring system that strictly follows the HER2 scoring guidelines.
The proposed system will be embedded in our Thorough Eye platform for deployment in hospitals.
arXiv Detail & Related papers (2021-10-21T01:38:35Z) - Multiple Sclerosis Lesion Activity Segmentation with Attention-Guided
Two-Path CNNs [49.32653090178743]
convolutional neural networks (CNNs) are studied for lesion activity segmentation from two time points.
CNNs are designed and evaluated that combine the information from two points in different ways.
It is demonstrated that deep learning-based methods outperform classic approaches.
arXiv Detail & Related papers (2020-08-05T08:49:20Z) - An interpretable automated detection system for FISH-based HER2 oncogene
amplification testing in histo-pathological routine images of breast and
gastric cancer diagnostics [0.2479153065703935]
We develop an interpretable, deep learning (DL)-based pipeline which automates the evaluation of FISH images with respect to HER2 gene amplification testing.
It mimics the pathological assessment and relies on the detection and localization of interphase nuclei based on instance segmentation networks.
It localizes and classifies fluorescence signals within each nucleus with the help of image classification and object detection convolutional neural networks (CNNs)
arXiv Detail & Related papers (2020-05-25T12:14:38Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.