SPLAL: Similarity-based pseudo-labeling with alignment loss for
semi-supervised medical image classification
- URL: http://arxiv.org/abs/2307.04610v1
- Date: Mon, 10 Jul 2023 14:53:24 GMT
- Title: SPLAL: Similarity-based pseudo-labeling with alignment loss for
semi-supervised medical image classification
- Authors: Md Junaid Mahmood, Pranaw Raj, Divyansh Agarwal, Suruchi Kumari,
Pravendra Singh
- Abstract summary: Semi-supervised learning (SSL) methods can mitigate challenges by leveraging both labeled and unlabeled data.
SSL methods for medical image classification need to address two key challenges: (1) estimating reliable pseudo-labels for the images in the unlabeled dataset and (2) reducing biases caused by class imbalance.
In this paper, we propose a novel SSL approach, SPLAL, that effectively addresses these challenges.
- Score: 11.435826510575879
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: Medical image classification is a challenging task due to the scarcity of
labeled samples and class imbalance caused by the high variance in disease
prevalence. Semi-supervised learning (SSL) methods can mitigate these
challenges by leveraging both labeled and unlabeled data. However, SSL methods
for medical image classification need to address two key challenges: (1)
estimating reliable pseudo-labels for the images in the unlabeled dataset and
(2) reducing biases caused by class imbalance. In this paper, we propose a
novel SSL approach, SPLAL, that effectively addresses these challenges. SPLAL
leverages class prototypes and a weighted combination of classifiers to predict
reliable pseudo-labels over a subset of unlabeled images. Additionally, we
introduce alignment loss to mitigate model biases toward majority classes. To
evaluate the performance of our proposed approach, we conduct experiments on
two publicly available medical image classification benchmark datasets: the
skin lesion classification (ISIC 2018) and the blood cell classification
dataset (BCCD). The experimental results empirically demonstrate that our
approach outperforms several state-of-the-art SSL methods over various
evaluation metrics. Specifically, our proposed approach achieves a significant
improvement over the state-of-the-art approach on the ISIC 2018 dataset in both
Accuracy and F1 score, with relative margins of 2.24\% and 11.40\%,
respectively. Finally, we conduct extensive ablation experiments to examine the
contribution of different components of our approach, validating its
effectiveness.
Related papers
- Iterative Online Image Synthesis via Diffusion Model for Imbalanced
Classification [29.730360798234294]
We introduce an Iterative Online Image Synthesis framework to address the class imbalance problem in medical image classification.
Our framework incorporates two key modules, namely Online Image Synthesis (OIS) and Accuracy Adaptive Sampling (AAS)
To evaluate the effectiveness of our proposed method in addressing imbalanced classification, we conduct experiments on the HAM10000 and APTOS datasets.
arXiv Detail & Related papers (2024-03-13T10:51:18Z) - Rethinking Semi-Supervised Medical Image Segmentation: A
Variance-Reduction Perspective [51.70661197256033]
We propose ARCO, a semi-supervised contrastive learning framework with stratified group theory for medical image segmentation.
We first propose building ARCO through the concept of variance-reduced estimation and show that certain variance-reduction techniques are particularly beneficial in pixel/voxel-level segmentation tasks.
We experimentally validate our approaches on eight benchmarks, i.e., five 2D/3D medical and three semantic segmentation datasets, with different label settings.
arXiv Detail & Related papers (2023-02-03T13:50:25Z) - PercentMatch: Percentile-based Dynamic Thresholding for Multi-Label
Semi-Supervised Classification [64.39761523935613]
We propose a percentile-based threshold adjusting scheme to dynamically alter the score thresholds of positive and negative pseudo-labels for each class during the training.
We achieve strong performance on Pascal VOC2007 and MS-COCO datasets when compared to recent SSL methods.
arXiv Detail & Related papers (2022-08-30T01:27:48Z) - Hierarchical Semi-Supervised Contrastive Learning for
Contamination-Resistant Anomaly Detection [81.07346419422605]
Anomaly detection aims at identifying deviant samples from the normal data distribution.
Contrastive learning has provided a successful way to sample representation that enables effective discrimination on anomalies.
We propose a novel hierarchical semi-supervised contrastive learning framework, for contamination-resistant anomaly detection.
arXiv Detail & Related papers (2022-07-24T18:49:26Z) - Learning Discriminative Representation via Metric Learning for
Imbalanced Medical Image Classification [52.94051907952536]
We propose embedding metric learning into the first stage of the two-stage framework specially to help the feature extractor learn to extract more discriminative feature representations.
Experiments mainly on three medical image datasets show that the proposed approach consistently outperforms existing onestage and two-stage approaches.
arXiv Detail & Related papers (2022-07-14T14:57:01Z) - SuperCon: Supervised Contrastive Learning for Imbalanced Skin Lesion
Classification [9.265557367859637]
SuperCon is a two-stage training strategy to overcome the class imbalance problem on skin lesion classification.
Our two-stage training strategy effectively addresses the class imbalance classification problem, and significantly improves existing works in terms of F1-score and AUC score.
arXiv Detail & Related papers (2022-02-11T15:19:36Z) - ACPL: Anti-curriculum Pseudo-labelling forSemi-supervised Medical Image
Classification [22.5935068122522]
We propose a new SSL algorithm, called anti-curriculum pseudo-labelling (ACPL)
ACPL introduces novel techniques to select informative unlabelled samples, improving training balance and allowing the model to work for both multi-label and multi-class problems.
Our method outperforms previous SOTA SSL methods on both datasets.
arXiv Detail & Related papers (2021-11-25T05:31:52Z) - Cross-Site Severity Assessment of COVID-19 from CT Images via Domain
Adaptation [64.59521853145368]
Early and accurate severity assessment of Coronavirus disease 2019 (COVID-19) based on computed tomography (CT) images offers a great help to the estimation of intensive care unit event.
To augment the labeled data and improve the generalization ability of the classification model, it is necessary to aggregate data from multiple sites.
This task faces several challenges including class imbalance between mild and severe infections, domain distribution discrepancy between sites, and presence of heterogeneous features.
arXiv Detail & Related papers (2021-09-08T07:56:51Z) - Semi-supervised learning for medical image classification using
imbalanced training data [11.87832944550453]
We propose Adaptive Blended Consistency Loss (ABCL) as a drop-in replacement for consistency loss in perturbation-based SSL methods.
ABCL counteracts data skew by adaptively mixing the target class distribution of the consistency loss in accordance with class frequency.
Our experiments with ABCL reveal improvements to unweighted average recall on two different imbalanced medical image classification datasets.
arXiv Detail & Related papers (2021-08-20T01:06:42Z) - Semi-supervised Medical Image Classification with Relation-driven
Self-ensembling Model [71.80319052891817]
We present a relation-driven semi-supervised framework for medical image classification.
It exploits the unlabeled data by encouraging the prediction consistency of given input under perturbations.
Our method outperforms many state-of-the-art semi-supervised learning methods on both single-label and multi-label image classification scenarios.
arXiv Detail & Related papers (2020-05-15T06:57:54Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.