Melanoma Detection using Adversarial Training and Deep Transfer Learning
- URL: http://arxiv.org/abs/2004.06824v2
- Date: Tue, 28 Jul 2020 16:46:09 GMT
- Title: Melanoma Detection using Adversarial Training and Deep Transfer Learning
- Authors: Hasib Zunair and A. Ben Hamza
- Abstract summary: We propose a two-stage framework for automatic classification of skin lesion images.
In the first stage, we leverage the inter-class variation of the data distribution for the task of conditional image synthesis.
In the second stage, we train a deep convolutional neural network for skin lesion classification.
- Score: 6.22964000148682
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Skin lesion datasets consist predominantly of normal samples with only a
small percentage of abnormal ones, giving rise to the class imbalance problem.
Also, skin lesion images are largely similar in overall appearance owing to the
low inter-class variability. In this paper, we propose a two-stage framework
for automatic classification of skin lesion images using adversarial training
and transfer learning toward melanoma detection. In the first stage, we
leverage the inter-class variation of the data distribution for the task of
conditional image synthesis by learning the inter-class mapping and
synthesizing under-represented class samples from the over-represented ones
using unpaired image-to-image translation. In the second stage, we train a deep
convolutional neural network for skin lesion classification using the original
training set combined with the newly synthesized under-represented class
samples. The training of this classifier is carried out by minimizing the focal
loss function, which assists the model in learning from hard examples, while
down-weighting the easy ones. Experiments conducted on a dermatology image
benchmark demonstrate the superiority of our proposed approach over several
standard baseline methods, achieving significant performance improvements.
Interestingly, we show through feature visualization and analysis that our
method leads to context based lesion assessment that can reach an expert
dermatologist level.
Related papers
- Adapting Visual-Language Models for Generalizable Anomaly Detection in Medical Images [68.42215385041114]
This paper introduces a novel lightweight multi-level adaptation and comparison framework to repurpose the CLIP model for medical anomaly detection.
Our approach integrates multiple residual adapters into the pre-trained visual encoder, enabling a stepwise enhancement of visual features across different levels.
Our experiments on medical anomaly detection benchmarks demonstrate that our method significantly surpasses current state-of-the-art models.
arXiv Detail & Related papers (2024-03-19T09:28:19Z) - Multi-task Explainable Skin Lesion Classification [54.76511683427566]
We propose a few-shot-based approach for skin lesions that generalizes well with few labelled data.
The proposed approach comprises a fusion of a segmentation network that acts as an attention module and classification network.
arXiv Detail & Related papers (2023-10-11T05:49:47Z) - Rethinking Semi-Supervised Medical Image Segmentation: A
Variance-Reduction Perspective [51.70661197256033]
We propose ARCO, a semi-supervised contrastive learning framework with stratified group theory for medical image segmentation.
We first propose building ARCO through the concept of variance-reduced estimation and show that certain variance-reduction techniques are particularly beneficial in pixel/voxel-level segmentation tasks.
We experimentally validate our approaches on eight benchmarks, i.e., five 2D/3D medical and three semantic segmentation datasets, with different label settings.
arXiv Detail & Related papers (2023-02-03T13:50:25Z) - Stain-invariant self supervised learning for histopathology image
analysis [74.98663573628743]
We present a self-supervised algorithm for several classification tasks within hematoxylin and eosin stained images of breast cancer.
Our method achieves the state-of-the-art performance on several publicly available breast cancer datasets.
arXiv Detail & Related papers (2022-11-14T18:16:36Z) - Learning Discriminative Representation via Metric Learning for
Imbalanced Medical Image Classification [52.94051907952536]
We propose embedding metric learning into the first stage of the two-stage framework specially to help the feature extractor learn to extract more discriminative feature representations.
Experiments mainly on three medical image datasets show that the proposed approach consistently outperforms existing onestage and two-stage approaches.
arXiv Detail & Related papers (2022-07-14T14:57:01Z) - SuperCon: Supervised Contrastive Learning for Imbalanced Skin Lesion
Classification [9.265557367859637]
SuperCon is a two-stage training strategy to overcome the class imbalance problem on skin lesion classification.
Our two-stage training strategy effectively addresses the class imbalance classification problem, and significantly improves existing works in terms of F1-score and AUC score.
arXiv Detail & Related papers (2022-02-11T15:19:36Z) - Constrained Deep One-Class Feature Learning For Classifying Imbalanced
Medical Images [4.211466076086617]
One-class classification has attracted increasing attention to address the data imbalance problem.
We propose a novel deep learning-based method to learn compact features.
Our method can learn more relevant features associated with the given class, making the majority and minority samples more distinguishable.
arXiv Detail & Related papers (2021-11-20T15:25:24Z) - Magnification-independent Histopathological Image Classification with
Similarity-based Multi-scale Embeddings [12.398787062519034]
We propose an approach that learns similarity-based multi-scale embeddings for magnification-independent image classification.
In particular, a pair loss and a triplet loss are leveraged to learn similarity-based embeddings from image pairs or image triplets.
The SMSE achieves the best performance on the BreakHis benchmark with an improvement ranging from 5% to 18% compared to previous methods.
arXiv Detail & Related papers (2021-07-02T13:18:45Z) - Dermoscopic Image Classification with Neural Style Transfer [5.314466196448187]
We propose an adaptation of the Neural Style Transfer (NST) as a novel image pre-processing step for skin lesion classification problems.
We represent each dermoscopic image as the style image and transfer the style of the lesion onto a homogeneous content image.
This transfers the main variability of each lesion onto the same localized region, which allows us to integrate the generated images together and extract latent, low-rank style features.
arXiv Detail & Related papers (2021-05-17T03:50:51Z) - Analysis of skin lesion images with deep learning [0.0]
We evaluate the current state of the art in the classification of dermoscopic images.
Various deep neural network architectures pre-trained on the ImageNet data set are adapted to a combined training data set.
The performance and applicability of these models for the detection of eight classes of skin lesions are examined.
arXiv Detail & Related papers (2021-01-11T10:58:36Z) - Multi-label Thoracic Disease Image Classification with Cross-Attention
Networks [65.37531731899837]
We propose a novel scheme of Cross-Attention Networks (CAN) for automated thoracic disease classification from chest x-ray images.
We also design a new loss function that beyond cross-entropy loss to help cross-attention process and is able to overcome the imbalance between classes and easy-dominated samples within each class.
arXiv Detail & Related papers (2020-07-21T14:37:00Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.