Few-Shot Classification of Skin Lesions from Dermoscopic Images by
Meta-Learning Representative Embeddings
- URL: http://arxiv.org/abs/2210.16954v1
- Date: Sun, 30 Oct 2022 21:27:15 GMT
- Title: Few-Shot Classification of Skin Lesions from Dermoscopic Images by
Meta-Learning Representative Embeddings
- Authors: Karthik Desingu and Mirunalini P. and Aravindan Chandrabose
- Abstract summary: Annotated images and ground truth for diagnosis of rare and novel diseases are scarce.
Few-shot learning, and meta-learning in general, aim to overcome these issues by aiming to perform well in low data regimes.
This paper focuses on improving meta-learning for the classification of dermoscopic images.
- Score: 1.957558771641347
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Annotated images and ground truth for the diagnosis of rare and novel
diseases are scarce. This is expected to prevail, considering the small number
of affected patient population and limited clinical expertise to annotate
images. Further, the frequently occurring long-tailed class distributions in
skin lesion and other disease classification datasets cause conventional
training approaches to lead to poor generalization due to biased class priors.
Few-shot learning, and meta-learning in general, aim to overcome these issues
by aiming to perform well in low data regimes. This paper focuses on improving
meta-learning for the classification of dermoscopic images. Specifically, we
propose a baseline supervised method on the meta-training set that allows a
network to learn highly representative and generalizable feature embeddings for
images, that are readily transferable to new few-shot learning tasks. We follow
some of the previous work in literature that posit that a representative
feature embedding can be more effective than complex meta-learning algorithms.
We empirically prove the efficacy of the proposed meta-training method on
dermoscopic images for learning embeddings, and show that even simple linear
classifiers trained atop these representations suffice to outperform some of
the usual meta-learning methods.
Related papers
- Boosting Few-Shot Learning with Disentangled Self-Supervised Learning and Meta-Learning for Medical Image Classification [8.975676404678374]
We present a strategy for improving the performance and generalization capabilities of models trained in low-data regimes.
The proposed method starts with a pre-training phase, where features learned in a self-supervised learning setting are disentangled to improve the robustness of the representations for downstream tasks.
We then introduce a meta-fine-tuning step, leveraging related classes between meta-training and meta-testing phases but varying the level.
arXiv Detail & Related papers (2024-03-26T09:36:20Z) - A Systematic Review of Few-Shot Learning in Medical Imaging [1.049712834719005]
Few-shot learning techniques can reduce data scarcity issues and enhance medical image analysis.
This systematic review gives a comprehensive overview of few-shot learning in medical imaging.
arXiv Detail & Related papers (2023-09-20T16:10:53Z) - Disruptive Autoencoders: Leveraging Low-level features for 3D Medical
Image Pre-training [51.16994853817024]
This work focuses on designing an effective pre-training framework for 3D radiology images.
We introduce Disruptive Autoencoders, a pre-training framework that attempts to reconstruct the original image from disruptions created by a combination of local masking and low-level perturbations.
The proposed pre-training framework is tested across multiple downstream tasks and achieves state-of-the-art performance.
arXiv Detail & Related papers (2023-07-31T17:59:42Z) - MedFMC: A Real-world Dataset and Benchmark For Foundation Model
Adaptation in Medical Image Classification [41.16626194300303]
Foundation models, often pre-trained with large-scale data, have achieved paramount success in jump-starting various vision and language applications.
Recent advances further enable adapting foundation models in downstream tasks efficiently using only a few training samples.
Yet, the application of such learning paradigms in medical image analysis remains scarce due to the shortage of publicly accessible data and benchmarks.
arXiv Detail & Related papers (2023-06-16T01:46:07Z) - Learning Discriminative Representation via Metric Learning for
Imbalanced Medical Image Classification [52.94051907952536]
We propose embedding metric learning into the first stage of the two-stage framework specially to help the feature extractor learn to extract more discriminative feature representations.
Experiments mainly on three medical image datasets show that the proposed approach consistently outperforms existing onestage and two-stage approaches.
arXiv Detail & Related papers (2022-07-14T14:57:01Z) - Intelligent Masking: Deep Q-Learning for Context Encoding in Medical
Image Analysis [48.02011627390706]
We develop a novel self-supervised approach that occludes targeted regions to improve the pre-training procedure.
We show that training the agent against the prediction model can significantly improve the semantic features extracted for downstream classification tasks.
arXiv Detail & Related papers (2022-03-25T19:05:06Z) - On the Robustness of Pretraining and Self-Supervision for a Deep
Learning-based Analysis of Diabetic Retinopathy [70.71457102672545]
We compare the impact of different training procedures for diabetic retinopathy grading.
We investigate different aspects such as quantitative performance, statistics of the learned feature representations, interpretability and robustness to image distortions.
Our results indicate that models from ImageNet pretraining report a significant increase in performance, generalization and robustness to image distortions.
arXiv Detail & Related papers (2021-06-25T08:32:45Z) - Domain Generalization on Medical Imaging Classification using Episodic
Training with Task Augmentation [62.49837463676111]
We propose a novel scheme of episodic training with task augmentation on medical imaging classification.
Motivated by the limited number of source domains in real-world medical deployment, we consider the unique task-level overfitting.
arXiv Detail & Related papers (2021-06-13T03:56:59Z) - Few-shot segmentation of medical images based on meta-learning with
implicit gradients [0.48861336570452174]
We propose to exploit an optimization-based implicit model agnostic meta-learning iMAML algorithm in a few-shot setting for medical image segmentation.
Our approach can leverage the learned weights from a diverse set of training samples and can be deployed on a new unseen dataset.
arXiv Detail & Related papers (2021-06-06T19:52:06Z) - Multi-label Thoracic Disease Image Classification with Cross-Attention
Networks [65.37531731899837]
We propose a novel scheme of Cross-Attention Networks (CAN) for automated thoracic disease classification from chest x-ray images.
We also design a new loss function that beyond cross-entropy loss to help cross-attention process and is able to overcome the imbalance between classes and easy-dominated samples within each class.
arXiv Detail & Related papers (2020-07-21T14:37:00Z) - Melanoma Detection using Adversarial Training and Deep Transfer Learning [6.22964000148682]
We propose a two-stage framework for automatic classification of skin lesion images.
In the first stage, we leverage the inter-class variation of the data distribution for the task of conditional image synthesis.
In the second stage, we train a deep convolutional neural network for skin lesion classification.
arXiv Detail & Related papers (2020-04-14T22:46:20Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.