PCCT: Progressive Class-Center Triplet Loss for Imbalanced Medical Image
Classification
- URL: http://arxiv.org/abs/2207.04793v1
- Date: Mon, 11 Jul 2022 11:43:51 GMT
- Title: PCCT: Progressive Class-Center Triplet Loss for Imbalanced Medical Image
Classification
- Authors: Kanghao Chen, Weixian Lei, Rong Zhang, Shen Zhao, Wei-shi Zheng,
Ruixuan Wang
- Abstract summary: Imbalanced training data is a significant challenge for medical image classification.
We propose a novel Progressive Class-Center Triplet (PCCT) framework to alleviate the class imbalance issue.
The PCCT framework works effectively for medical image classification with imbalanced training images.
- Score: 55.703445291264
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Imbalanced training data is a significant challenge for medical image
classification. In this study, we propose a novel Progressive Class-Center
Triplet (PCCT) framework to alleviate the class imbalance issue particularly
for diagnosis of rare diseases, mainly by carefully designing the triplet
sampling strategy and the triplet loss formation. Specifically, the PCCT
framework includes two successive stages. In the first stage, PCCT trains the
diagnosis system via a class-balanced triplet loss to coarsely separate
distributions of different classes. In the second stage, the PCCT framework
further improves the diagnosis system via a class-center involved triplet loss
to cause a more compact distribution for each class. For the class-balanced
triplet loss, triplets are sampled equally for each class at each training
iteration, thus alleviating the imbalanced data issue. For the class-center
involved triplet loss, the positive and negative samples in each triplet are
replaced by their corresponding class centers, which enforces data
representations of the same class closer to the class center. Furthermore, the
class-center involved triplet loss is extended to the pair-wise ranking loss
and the quadruplet loss, which demonstrates the generalization of the proposed
framework. Extensive experiments support that the PCCT framework works
effectively for medical image classification with imbalanced training images.
On two skin image datasets and one chest X-ray dataset, the proposed approach
respectively obtains the mean F1 score 86.2, 65.2, and 90.66 over all classes
and 81.4, 63.87, and 81.92 for rare classes, achieving state-of-the-art
performance and outperforming the widely used methods for the class imbalance
issue.
Related papers
- Addressing Imbalance for Class Incremental Learning in Medical Image Classification [14.242875524728495]
We introduce two plug-in methods to mitigate the adverse effects of imbalance.
First, we propose a CIL-balanced classification loss to mitigate the classification bias toward majority classes.
Second, we propose a distribution margin loss that not only alleviates the inter-class overlap in embedding space but also enforces the intra-class compactness.
arXiv Detail & Related papers (2024-07-18T17:59:44Z) - DHC: Dual-debiased Heterogeneous Co-training Framework for
Class-imbalanced Semi-supervised Medical Image Segmentation [19.033066343869862]
We present a novel Dual-debiased Heterogeneous Co-training (DHC) framework for semi-supervised 3D medical image segmentation.
Specifically, we propose two loss weighting strategies, namely Distribution-aware Debiased Weighting (DistDW) and Difficulty-aware Debiased Weighting (DiffDW)
Our proposed framework brings significant improvements by using pseudo labels for debiasing and alleviating the class imbalance problem.
arXiv Detail & Related papers (2023-07-22T02:16:05Z) - Overlapping oriented imbalanced ensemble learning method based on
projective clustering and stagewise hybrid sampling [22.32930261633615]
This paper proposes an ensemble learning algorithm based on dual clustering and stage-wise hybrid sampling (DCSHS)
The major advantage of our algorithm is that it can exploit the intersectionality of the CCS to realize the soft elimination of overlapping majority samples.
arXiv Detail & Related papers (2022-11-30T01:49:06Z) - Density-Aware Personalized Training for Risk Prediction in Imbalanced
Medical Data [89.79617468457393]
Training models with imbalance rate (class density discrepancy) may lead to suboptimal prediction.
We propose a framework for training models for this imbalance issue.
We demonstrate our model's improved performance in real-world medical datasets.
arXiv Detail & Related papers (2022-07-23T00:39:53Z) - Learning Discriminative Representation via Metric Learning for
Imbalanced Medical Image Classification [52.94051907952536]
We propose embedding metric learning into the first stage of the two-stage framework specially to help the feature extractor learn to extract more discriminative feature representations.
Experiments mainly on three medical image datasets show that the proposed approach consistently outperforms existing onestage and two-stage approaches.
arXiv Detail & Related papers (2022-07-14T14:57:01Z) - Cross-Site Severity Assessment of COVID-19 from CT Images via Domain
Adaptation [64.59521853145368]
Early and accurate severity assessment of Coronavirus disease 2019 (COVID-19) based on computed tomography (CT) images offers a great help to the estimation of intensive care unit event.
To augment the labeled data and improve the generalization ability of the classification model, it is necessary to aggregate data from multiple sites.
This task faces several challenges including class imbalance between mild and severe infections, domain distribution discrepancy between sites, and presence of heterogeneous features.
arXiv Detail & Related papers (2021-09-08T07:56:51Z) - Categorical Relation-Preserving Contrastive Knowledge Distillation for
Medical Image Classification [75.27973258196934]
We propose a novel Categorical Relation-preserving Contrastive Knowledge Distillation (CRCKD) algorithm, which takes the commonly used mean-teacher model as the supervisor.
With this regularization, the feature distribution of the student model shows higher intra-class similarity and inter-class variance.
With the contribution of the CCD and CRP, our CRCKD algorithm can distill the relational knowledge more comprehensively.
arXiv Detail & Related papers (2021-07-07T13:56:38Z) - Multi-label Thoracic Disease Image Classification with Cross-Attention
Networks [65.37531731899837]
We propose a novel scheme of Cross-Attention Networks (CAN) for automated thoracic disease classification from chest x-ray images.
We also design a new loss function that beyond cross-entropy loss to help cross-attention process and is able to overcome the imbalance between classes and easy-dominated samples within each class.
arXiv Detail & Related papers (2020-07-21T14:37:00Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.