Melanoma Diagnosis with Spatio-Temporal Feature Learning on Sequential Dermoscopic Images

• URL: http://arxiv.org/abs/2006.10950v1
• Date: Fri, 19 Jun 2020 04:08:22 GMT
• Title: Melanoma Diagnosis with Spatio-Temporal Feature Learning on Sequential Dermoscopic Images
• Authors: Zhen Yu, Jennifer Nguyen, Xiaojun Chang, John Kelly, Catriona Mclean, Lei Zhang, Victoria Mar, Zongyuan Ge
• Abstract summary: Existing dermatologists for automated melanoma diagnosis are based on single-time point images of lesions. We propose an automated framework for melanoma diagnosis using sequential dermoscopic images.
• Score: 40.743870665742975
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Existing studies for automated melanoma diagnosis are based on single-time point images of lesions. However, melanocytic lesions de facto are progressively evolving and, moreover, benign lesions can progress into malignant melanoma. Ignoring cross-time morphological changes of lesions thus may lead to misdiagnosis in borderline cases. Based on the fact that dermatologists diagnose ambiguous skin lesions by evaluating the dermoscopic changes over time via follow-up examination, in this study, we propose an automated framework for melanoma diagnosis using sequential dermoscopic images. To capture the spatio-temporal characterization of dermoscopic evolution, we construct our model in a two-stream network architecture which capable of simultaneously learning appearance representations of individual lesions while performing temporal reasoning on both raw pixels difference and abstract features difference. We collect 184 cases of serial dermoscopic image data, which consists of histologically confirmed 92 benign lesions and 92 melanoma lesions, to evaluate the effectiveness of the proposed method. Our model achieved AUC of 74.34%, which is ~8% higher than that of only using single images and ~6% higher than the widely used sequence learning model based on LSTM.

Related papers

• Region of Interest Detection in Melanocytic Skin Tumor Whole Slide Images -- Nevus & Melanoma [4.265489979736396]
  We developed an in-house deep-learning method to allow for classification, at the slide level, of nevi and melanomas. The accuracy of the slide classification task was 92.3% and our model also performed well in terms of predicting the region of interest annotated by the pathologists.
  arXiv  Detail & Related papers  (2024-05-16T07:00:44Z)
• Stain-invariant self supervised learning for histopathology image analysis [74.98663573628743]
  We present a self-supervised algorithm for several classification tasks within hematoxylin and eosin stained images of breast cancer. Our method achieves the state-of-the-art performance on several publicly available breast cancer datasets.
  arXiv  Detail & Related papers  (2022-11-14T18:16:36Z)
• Using Whole Slide Image Representations from Self-Supervised Contrastive Learning for Melanoma Concordance Regression [2.21878843241715]
  Diagnosis is complicated by a high discordance rate among pathologists when distinguishing between melanoma and benign melanocytic lesions. We present a melanoma concordance regression deep learning model capable of predicting the concordance rate of invasive melanoma or melanoma in-situ from digitized Whole Slide Images (WSIs) We trained a SimCLR feature extractor with 83,356 WSI tiles randomly sampled from 10,895 specimens originating from four distinct pathology labs. We achieved a Root Mean Squared Error (RMSE) of 0.28 +/- 0.01 on the test set and a precision and recall of 0.85 +/- 0.05 and 0.61 +/- 0.06, respectively
  arXiv  Detail & Related papers  (2022-10-10T16:07:41Z)
• Multiple EffNet/ResNet Architectures for Melanoma Classification [3.047409448159345]
  Melanoma is the most malignant skin tumor and usually cancerates from normal moles. We propose a new melanoma classification model based on EffNet and Resnet. Our model not only uses images within the same patient but also consider patient-level contextual information for better cancer prediction.
  arXiv  Detail & Related papers  (2022-04-21T14:46:55Z)
• Breast Cancer Induced Bone Osteolysis Prediction Using Temporal Variational Auto-Encoders [65.95959936242993]
  We develop a deep learning framework that can accurately predict and visualize the progression of osteolytic bone lesions. It will assist in planning and evaluating treatment strategies to prevent skeletal related events (SREs) in breast cancer patients.
  arXiv  Detail & Related papers  (2022-03-20T21:00:10Z)
• Texture Characterization of Histopathologic Images Using Ecological Diversity Measures and Discrete Wavelet Transform [82.53597363161228]
  This paper proposes a method for characterizing texture across histopathologic images with a considerable success rate. It is possible to quantify the intrinsic properties of such images with promising accuracy on two HI datasets.
  arXiv  Detail & Related papers  (2022-02-27T02:19:09Z)
• Early Melanoma Diagnosis with Sequential Dermoscopic Images [10.487636624052564]
  Existing algorithms for early melanoma diagnosis are developed using single time-point images of lesions. We propose a framework for automated early melanoma diagnosis using sequential dermoscopic images.
  arXiv  Detail & Related papers  (2021-10-12T13:05:41Z)
• An Attention-based Weakly Supervised framework for Spitzoid Melanocytic Lesion Diagnosis in WSI [1.0948946179065253]
  Melanoma is an aggressive neoplasm responsible for the majority of deaths from skin cancer. The gold standard for its diagnosis and prognosis is the analysis of skin biopsies. We propose a novel end-to-end weakly-supervised deep learning model, based on inductive transfer learning with an improved convolutional neural network (CNN) The framework is composed of a source model in charge of finding the tumor patch-level patterns, and a target model focuses on the specific diagnosis of a biopsy.
  arXiv  Detail & Related papers  (2021-04-20T10:18:57Z)
• Malignancy Prediction and Lesion Identification from Clinical Dermatological Images [65.1629311281062]
  We consider machine-learning-based malignancy prediction and lesion identification from clinical dermatological images. We first identify all lesions present in the image regardless of sub-type or likelihood of malignancy, then it estimates their likelihood of malignancy, and through aggregation, it also generates an image-level likelihood of malignancy.
  arXiv  Detail & Related papers  (2021-04-02T20:52:05Z)
• Spectral-Spatial Recurrent-Convolutional Networks for In-Vivo Hyperspectral Tumor Type Classification [49.32653090178743]
  We demonstrate the feasibility of in-vivo tumor type classification using hyperspectral imaging and deep learning. Our best model achieves an AUC of 76.3%, significantly outperforming previous conventional and deep learning methods.
  arXiv  Detail & Related papers  (2020-07-02T12:00:53Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.