An Attention-based Weakly Supervised framework for Spitzoid Melanocytic Lesion Diagnosis in WSI

• URL: http://arxiv.org/abs/2104.09878v1
• Date: Tue, 20 Apr 2021 10:18:57 GMT
• Title: An Attention-based Weakly Supervised framework for Spitzoid Melanocytic Lesion Diagnosis in WSI
• Authors: Roc\'io del Amor, La\"etitia Launet, Adri\'an Colomer, Ana\"is Moscard\'o, Andr\'es Mosquera-Zamudio, Carlos Monteagudo and Valery Naranjo
• Abstract summary: Melanoma is an aggressive neoplasm responsible for the majority of deaths from skin cancer. The gold standard for its diagnosis and prognosis is the analysis of skin biopsies. We propose a novel end-to-end weakly-supervised deep learning model, based on inductive transfer learning with an improved convolutional neural network (CNN) The framework is composed of a source model in charge of finding the tumor patch-level patterns, and a target model focuses on the specific diagnosis of a biopsy.
• Score: 1.0948946179065253
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Melanoma is an aggressive neoplasm responsible for the majority of deaths from skin cancer. Specifically, spitzoid melanocytic tumors are one of the most challenging melanocytic lesions due to their ambiguous morphological features. The gold standard for its diagnosis and prognosis is the analysis of skin biopsies. In this process, dermatopathologists visualize skin histology slides under a microscope, in a high time-consuming and subjective task. In the last years, computer-aided diagnosis (CAD) systems have emerged as a promising tool that could support pathologists in daily clinical practice. Nevertheless, no automatic CAD systems have yet been proposed for the analysis of spitzoid lesions. Regarding common melanoma, no proposed system allows both the selection of the tumoral region and the prediction of the diagnosis as benign or malignant. Motivated by this, we propose a novel end-to-end weakly-supervised deep learning model, based on inductive transfer learning with an improved convolutional neural network (CNN) to refine the embedding features of the latent space. The framework is composed of a source model in charge of finding the tumor patch-level patterns, and a target model focuses on the specific diagnosis of a biopsy. The latter retrains the backbone of the source model through a multiple instance learning workflow to obtain the biopsy-level scoring. To evaluate the performance of the proposed methods, we perform extensive experiments on a private skin database with spitzoid lesions. Test results reach an accuracy of 0.9231 and 0.80 for the source and the target models, respectively. Besides, the heat map findings are directly in line with the clinicians' medical decision and even highlight, in some cases, patterns of interest that were overlooked by the pathologist due to the huge workload.

Related papers

• Potential of Multimodal Large Language Models for Data Mining of Medical Images and Free-text Reports [51.45762396192655]
  Multimodal large language models (MLLMs) have recently transformed many domains, significantly affecting the medical field. Notably, Gemini-Vision-series (Gemini) and GPT-4-series (GPT-4) models have epitomized a paradigm shift in Artificial General Intelligence for computer vision. This study evaluated the performance of the Gemini, GPT-4, and 4 popular large models for an exhaustive evaluation across 14 medical imaging datasets.
  arXiv  Detail & Related papers  (2024-07-08T09:08:42Z)
• A Dual Convolutional Neural Network Pipeline for Melanoma Diagnostics and Prognostics [0.7498348529748513]
  Melanoma is a type of cancer that begins in the cells controlling the pigment of the skin. Recent increase in melanoma incidents indicates a growing demand for a more efficient diagnostic process. This paper presents a pipeline for melanoma diagnostics, leveraging two convolutional neural networks, a diagnosis, and a prognosis model.
  arXiv  Detail & Related papers  (2023-12-14T09:28:50Z)
• Detection and Localization of Melanoma Skin Cancer in Histopathological Whole Slide Images [1.0962389869127878]
  A projected increase in skin cancer incidents and a dearth of dermatopathologists have emphasized the need for computational pathology (CPATH) systems. This paper proposes a DL method to detect melanoma and distinguish between normal skin and benign/malignant melanocytic lesions in Whole Slide Images (WSI) Our method detects lesions with high accuracy and localizes them on a WSI to identify potential regions of interest for pathologists.
  arXiv  Detail & Related papers  (2023-02-06T18:54:14Z)
• A Pathologist-Informed Workflow for Classification of Prostate Glands in Histopathology [62.997667081978825]
  Pathologists diagnose and grade prostate cancer by examining tissue from needle biopsies on glass slides. Cancer's severity and risk of metastasis are determined by the Gleason grade, a score based on the organization and morphology of prostate cancer glands. This paper proposes an automated workflow that follows pathologists' textitmodus operandi, isolating and classifying multi-scale patches of individual glands.
  arXiv  Detail & Related papers  (2022-09-27T14:08:19Z)
• A Pathology Deep Learning System Capable of Triage of Melanoma Specimens Utilizing Dermatopathologist Consensus as Ground Truth [5.46895714413677]
  We present a pathology deep learning system (PDLS) that performs hierarchical classification of digitized whole slide image (WSI) specimens. We trained the system on 7,685 images from a single lab, including the the largest set of triple-concordant melanocytic specimens compiled to date. We demonstrate that the PDLS is capable of automatically sorting and triaging skin specimens with high sensitivity to Melanocytic Suspect cases.
  arXiv  Detail & Related papers  (2021-09-15T19:48:51Z)
• Medulloblastoma Tumor Classification using Deep Transfer Learning with Multi-Scale EfficientNets [63.62764375279861]
  We propose an end-to-end MB tumor classification and explore transfer learning with various input sizes and matching network dimensions. Using a data set with 161 cases, we demonstrate that pre-trained EfficientNets with larger input resolutions lead to significant performance improvements.
  arXiv  Detail & Related papers  (2021-09-10T13:07:11Z)
• Learned super resolution ultrasound for improved breast lesion characterization [52.77024349608834]
  Super resolution ultrasound localization microscopy enables imaging of the microvasculature at the capillary level. In this work we use a deep neural network architecture that makes effective use of signal structure to address these challenges. By leveraging our trained network, the microvasculature structure is recovered in a short time, without prior PSF knowledge, and without requiring separability of the UCAs.
  arXiv  Detail & Related papers  (2021-07-12T09:04:20Z)
• Segmentation and ABCD rule extraction for skin tumors classification [0.0]
  We present an automated diagnosis system based on the ABCD rule used in clinical diagnosis in order to discriminate benign from malignant skin lesions. This framework has been tested on a dermoscopic database [16] of 320 images.
  arXiv  Detail & Related papers  (2021-06-08T14:07:59Z)
• Wide & Deep neural network model for patch aggregation in CNN-based prostate cancer detection systems [51.19354417900591]
  Prostate cancer (PCa) is one of the leading causes of death among men, with almost 1.41 million new cases and around 375,000 deaths in 2020. To perform an automatic diagnosis, prostate tissue samples are first digitized into gigapixel-resolution whole-slide images. Small subimages called patches are extracted and predicted, obtaining a patch-level classification.
  arXiv  Detail & Related papers  (2021-05-20T18:13:58Z)
• SkiNet: A Deep Learning Solution for Skin Lesion Diagnosis with Uncertainty Estimation and Explainability [0.5735035463793008]
  SkiNet is a two-stage pipeline wherein the lesion segmentation is followed by the lesion classification. The publicly available dataset, ISIC-2018, is used to perform experimentation and ablation studies.
  arXiv  Detail & Related papers  (2020-12-30T05:39:57Z)
• Spectral-Spatial Recurrent-Convolutional Networks for In-Vivo Hyperspectral Tumor Type Classification [49.32653090178743]
  We demonstrate the feasibility of in-vivo tumor type classification using hyperspectral imaging and deep learning. Our best model achieves an AUC of 76.3%, significantly outperforming previous conventional and deep learning methods.
  arXiv  Detail & Related papers  (2020-07-02T12:00:53Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.