Early Melanoma Diagnosis with Sequential Dermoscopic Images
- URL: http://arxiv.org/abs/2110.05976v1
- Date: Tue, 12 Oct 2021 13:05:41 GMT
- Title: Early Melanoma Diagnosis with Sequential Dermoscopic Images
- Authors: Zhen Yu, Jennifer Nguyen, Toan D Nguyen, John Kelly, Catriona Mclean,
Paul Bonnington, Lei Zhang, Victoria Mar, Zongyuan Ge
- Abstract summary: Existing algorithms for early melanoma diagnosis are developed using single time-point images of lesions.
We propose a framework for automated early melanoma diagnosis using sequential dermoscopic images.
- Score: 10.487636624052564
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Dermatologists often diagnose or rule out early melanoma by evaluating the
follow-up dermoscopic images of skin lesions. However, existing algorithms for
early melanoma diagnosis are developed using single time-point images of
lesions. Ignoring the temporal, morphological changes of lesions can lead to
misdiagnosis in borderline cases. In this study, we propose a framework for
automated early melanoma diagnosis using sequential dermoscopic images. To this
end, we construct our method in three steps. First, we align sequential
dermoscopic images of skin lesions using estimated Euclidean transformations,
extract the lesion growth region by computing image differences among the
consecutive images, and then propose a spatio-temporal network to capture the
dermoscopic changes from aligned lesion images and the corresponding difference
images. Finally, we develop an early diagnosis module to compute probability
scores of malignancy for lesion images over time. We collected 179 serial
dermoscopic imaging data from 122 patients to verify our method. Extensive
experiments show that the proposed model outperforms other commonly used
sequence models. We also compared the diagnostic results of our model with
those of seven experienced dermatologists and five registrars. Our model
achieved higher diagnostic accuracy than clinicians (63.69% vs. 54.33%,
respectively) and provided an earlier diagnosis of melanoma (60.7% vs. 32.7% of
melanoma correctly diagnosed on the first follow-up images). These results
demonstrate that our model can be used to identify melanocytic lesions that are
at high-risk of malignant transformation earlier in the disease process and
thereby redefine what is possible in the early detection of melanoma.
Related papers
- Harnessing the power of longitudinal medical imaging for eye disease prognosis using Transformer-based sequence modeling [49.52787013516891]
Our proposed Longitudinal Transformer for Survival Analysis (LTSA) enables dynamic disease prognosis from longitudinal medical imaging.
A temporal attention analysis also suggested that, while the most recent image is typically the most influential, prior imaging still provides additional prognostic value.
arXiv Detail & Related papers (2024-05-14T17:15:28Z) - Skin Lesion Diagnosis Using Convolutional Neural Networks [0.30458514384586394]
This project aims to address the issue by collecting state-of-the-art techniques for image classification from various fields.
The models were trained using a dataset of 8012 images, and their performance was evaluated using 2003 images.
It's worth noting that this model is trained end-to-end, directly from the image to the labels, without the need for handcrafted feature extraction.
arXiv Detail & Related papers (2023-05-18T17:15:08Z) - Using Whole Slide Image Representations from Self-Supervised Contrastive
Learning for Melanoma Concordance Regression [2.21878843241715]
Diagnosis is complicated by a high discordance rate among pathologists when distinguishing between melanoma and benign melanocytic lesions.
We present a melanoma concordance regression deep learning model capable of predicting the concordance rate of invasive melanoma or melanoma in-situ from digitized Whole Slide Images (WSIs)
We trained a SimCLR feature extractor with 83,356 WSI tiles randomly sampled from 10,895 specimens originating from four distinct pathology labs.
We achieved a Root Mean Squared Error (RMSE) of 0.28 +/- 0.01 on the test set and a precision and recall of 0.85 +/- 0.05 and 0.61 +/- 0.06, respectively
arXiv Detail & Related papers (2022-10-10T16:07:41Z) - Automated SSIM Regression for Detection and Quantification of Motion
Artefacts in Brain MR Images [54.739076152240024]
Motion artefacts in magnetic resonance brain images are a crucial issue.
The assessment of MR image quality is fundamental before proceeding with the clinical diagnosis.
An automated image quality assessment based on the structural similarity index (SSIM) regression has been proposed here.
arXiv Detail & Related papers (2022-06-14T10:16:54Z) - Multiple EffNet/ResNet Architectures for Melanoma Classification [3.047409448159345]
Melanoma is the most malignant skin tumor and usually cancerates from normal moles.
We propose a new melanoma classification model based on EffNet and Resnet.
Our model not only uses images within the same patient but also consider patient-level contextual information for better cancer prediction.
arXiv Detail & Related papers (2022-04-21T14:46:55Z) - Breast Cancer Induced Bone Osteolysis Prediction Using Temporal
Variational Auto-Encoders [65.95959936242993]
We develop a deep learning framework that can accurately predict and visualize the progression of osteolytic bone lesions.
It will assist in planning and evaluating treatment strategies to prevent skeletal related events (SREs) in breast cancer patients.
arXiv Detail & Related papers (2022-03-20T21:00:10Z) - Texture Characterization of Histopathologic Images Using Ecological
Diversity Measures and Discrete Wavelet Transform [82.53597363161228]
This paper proposes a method for characterizing texture across histopathologic images with a considerable success rate.
It is possible to quantify the intrinsic properties of such images with promising accuracy on two HI datasets.
arXiv Detail & Related papers (2022-02-27T02:19:09Z) - Malignancy Prediction and Lesion Identification from Clinical
Dermatological Images [65.1629311281062]
We consider machine-learning-based malignancy prediction and lesion identification from clinical dermatological images.
We first identify all lesions present in the image regardless of sub-type or likelihood of malignancy, then it estimates their likelihood of malignancy, and through aggregation, it also generates an image-level likelihood of malignancy.
arXiv Detail & Related papers (2021-04-02T20:52:05Z) - Method to Classify Skin Lesions using Dermoscopic images [0.0]
Skin cancer is the most common cancer in the existing world constituting one-third of the cancer cases.
In this project, an automated model for skin lesion classification using dermoscopic images has been developed with CNN(Convolution Neural Networks) as a training model.
The best accuracy this model could achieve is 0.886.
arXiv Detail & Related papers (2020-08-21T10:58:33Z) - Melanoma Diagnosis with Spatio-Temporal Feature Learning on Sequential
Dermoscopic Images [40.743870665742975]
Existing dermatologists for automated melanoma diagnosis are based on single-time point images of lesions.
We propose an automated framework for melanoma diagnosis using sequential dermoscopic images.
arXiv Detail & Related papers (2020-06-19T04:08:22Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.