An Attention-based Weakly Supervised framework for Spitzoid Melanocytic
Lesion Diagnosis in WSI
- URL: http://arxiv.org/abs/2104.09878v1
- Date: Tue, 20 Apr 2021 10:18:57 GMT
- Title: An Attention-based Weakly Supervised framework for Spitzoid Melanocytic
Lesion Diagnosis in WSI
- Authors: Roc\'io del Amor, La\"etitia Launet, Adri\'an Colomer, Ana\"is
Moscard\'o, Andr\'es Mosquera-Zamudio, Carlos Monteagudo and Valery Naranjo
- Abstract summary: Melanoma is an aggressive neoplasm responsible for the majority of deaths from skin cancer.
The gold standard for its diagnosis and prognosis is the analysis of skin biopsies.
We propose a novel end-to-end weakly-supervised deep learning model, based on inductive transfer learning with an improved convolutional neural network (CNN)
The framework is composed of a source model in charge of finding the tumor patch-level patterns, and a target model focuses on the specific diagnosis of a biopsy.
- Score: 1.0948946179065253
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Melanoma is an aggressive neoplasm responsible for the majority of deaths
from skin cancer. Specifically, spitzoid melanocytic tumors are one of the most
challenging melanocytic lesions due to their ambiguous morphological features.
The gold standard for its diagnosis and prognosis is the analysis of skin
biopsies. In this process, dermatopathologists visualize skin histology slides
under a microscope, in a high time-consuming and subjective task. In the last
years, computer-aided diagnosis (CAD) systems have emerged as a promising tool
that could support pathologists in daily clinical practice. Nevertheless, no
automatic CAD systems have yet been proposed for the analysis of spitzoid
lesions. Regarding common melanoma, no proposed system allows both the
selection of the tumoral region and the prediction of the diagnosis as benign
or malignant. Motivated by this, we propose a novel end-to-end
weakly-supervised deep learning model, based on inductive transfer learning
with an improved convolutional neural network (CNN) to refine the embedding
features of the latent space. The framework is composed of a source model in
charge of finding the tumor patch-level patterns, and a target model focuses on
the specific diagnosis of a biopsy. The latter retrains the backbone of the
source model through a multiple instance learning workflow to obtain the
biopsy-level scoring. To evaluate the performance of the proposed methods, we
perform extensive experiments on a private skin database with spitzoid lesions.
Test results reach an accuracy of 0.9231 and 0.80 for the source and the target
models, respectively. Besides, the heat map findings are directly in line with
the clinicians' medical decision and even highlight, in some cases, patterns of
interest that were overlooked by the pathologist due to the huge workload.
Related papers
- Potential of Multimodal Large Language Models for Data Mining of Medical Images and Free-text Reports [51.45762396192655]
Multimodal large language models (MLLMs) have recently transformed many domains, significantly affecting the medical field. Notably, Gemini-Vision-series (Gemini) and GPT-4-series (GPT-4) models have epitomized a paradigm shift in Artificial General Intelligence for computer vision.
This study evaluated the performance of the Gemini, GPT-4, and 4 popular large models for an exhaustive evaluation across 14 medical imaging datasets.
arXiv Detail & Related papers (2024-07-08T09:08:42Z) - A Dual Convolutional Neural Network Pipeline for Melanoma Diagnostics
and Prognostics [0.7498348529748513]
Melanoma is a type of cancer that begins in the cells controlling the pigment of the skin.
Recent increase in melanoma incidents indicates a growing demand for a more efficient diagnostic process.
This paper presents a pipeline for melanoma diagnostics, leveraging two convolutional neural networks, a diagnosis, and a prognosis model.
arXiv Detail & Related papers (2023-12-14T09:28:50Z) - Detection and Localization of Melanoma Skin Cancer in Histopathological
Whole Slide Images [1.0962389869127878]
A projected increase in skin cancer incidents and a dearth of dermatopathologists have emphasized the need for computational pathology (CPATH) systems.
This paper proposes a DL method to detect melanoma and distinguish between normal skin and benign/malignant melanocytic lesions in Whole Slide Images (WSI)
Our method detects lesions with high accuracy and localizes them on a WSI to identify potential regions of interest for pathologists.
arXiv Detail & Related papers (2023-02-06T18:54:14Z) - A Pathologist-Informed Workflow for Classification of Prostate Glands in
Histopathology [62.997667081978825]
Pathologists diagnose and grade prostate cancer by examining tissue from needle biopsies on glass slides.
Cancer's severity and risk of metastasis are determined by the Gleason grade, a score based on the organization and morphology of prostate cancer glands.
This paper proposes an automated workflow that follows pathologists' textitmodus operandi, isolating and classifying multi-scale patches of individual glands.
arXiv Detail & Related papers (2022-09-27T14:08:19Z) - A Pathology Deep Learning System Capable of Triage of Melanoma Specimens
Utilizing Dermatopathologist Consensus as Ground Truth [5.46895714413677]
We present a pathology deep learning system (PDLS) that performs hierarchical classification of digitized whole slide image (WSI) specimens.
We trained the system on 7,685 images from a single lab, including the the largest set of triple-concordant melanocytic specimens compiled to date.
We demonstrate that the PDLS is capable of automatically sorting and triaging skin specimens with high sensitivity to Melanocytic Suspect cases.
arXiv Detail & Related papers (2021-09-15T19:48:51Z) - Medulloblastoma Tumor Classification using Deep Transfer Learning with
Multi-Scale EfficientNets [63.62764375279861]
We propose an end-to-end MB tumor classification and explore transfer learning with various input sizes and matching network dimensions.
Using a data set with 161 cases, we demonstrate that pre-trained EfficientNets with larger input resolutions lead to significant performance improvements.
arXiv Detail & Related papers (2021-09-10T13:07:11Z) - Learned super resolution ultrasound for improved breast lesion
characterization [52.77024349608834]
Super resolution ultrasound localization microscopy enables imaging of the microvasculature at the capillary level.
In this work we use a deep neural network architecture that makes effective use of signal structure to address these challenges.
By leveraging our trained network, the microvasculature structure is recovered in a short time, without prior PSF knowledge, and without requiring separability of the UCAs.
arXiv Detail & Related papers (2021-07-12T09:04:20Z) - Segmentation and ABCD rule extraction for skin tumors classification [0.0]
We present an automated diagnosis system based on the ABCD rule used in clinical diagnosis in order to discriminate benign from malignant skin lesions.
This framework has been tested on a dermoscopic database [16] of 320 images.
arXiv Detail & Related papers (2021-06-08T14:07:59Z) - SkiNet: A Deep Learning Solution for Skin Lesion Diagnosis with
Uncertainty Estimation and Explainability [0.5735035463793008]
SkiNet is a two-stage pipeline wherein the lesion segmentation is followed by the lesion classification.
The publicly available dataset, ISIC-2018, is used to perform experimentation and ablation studies.
arXiv Detail & Related papers (2020-12-30T05:39:57Z) - Spectral-Spatial Recurrent-Convolutional Networks for In-Vivo
Hyperspectral Tumor Type Classification [49.32653090178743]
We demonstrate the feasibility of in-vivo tumor type classification using hyperspectral imaging and deep learning.
Our best model achieves an AUC of 76.3%, significantly outperforming previous conventional and deep learning methods.
arXiv Detail & Related papers (2020-07-02T12:00:53Z) - Melanoma Diagnosis with Spatio-Temporal Feature Learning on Sequential
Dermoscopic Images [40.743870665742975]
Existing dermatologists for automated melanoma diagnosis are based on single-time point images of lesions.
We propose an automated framework for melanoma diagnosis using sequential dermoscopic images.
arXiv Detail & Related papers (2020-06-19T04:08:22Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.