Equilibrium contrastive learning for imbalanced image classification

• URL: http://arxiv.org/abs/2602.09506v2
• Date: Wed, 18 Feb 2026 10:51:01 GMT
• Title: Equilibrium contrastive learning for imbalanced image classification
• Authors: Sumin Roh, Harim Kim, Ho Yun Lee, Il Yong Chun,
• Abstract summary: Contrastive learning (CL) is a predominant technique in image classification, but they showed limited performance with an imbalanced dataset.<n>Recently, several supervised CL methods have been proposed to promote an ideal regular simplex geometric configuration.<n>We propose Equilibrium Contrastive Learning (ECL), a supervised CL framework designed to promote geometric equilibrium.
• Score: 5.198140836737882
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Contrastive learning (CL) is a predominant technique in image classification, but they showed limited performance with an imbalanced dataset. Recently, several supervised CL methods have been proposed to promote an ideal regular simplex geometric configuration in the representation space-characterized by intra-class feature collapse and uniform inter-class mean spacing, especially for imbalanced datasets. In particular, existing prototype-based methods include class prototypes, as additional samples to consider all classes. However, the existing CL methods suffer from two limitations. First, they do not consider the alignment between the class means/prototypes and classifiers, which could lead to poor generalization. Second, existing prototype-based methods treat prototypes as only one additional sample per class, making their influence depend on the number of class instances in a batch and causing unbalanced contributions across classes. To address these limitations, we propose Equilibrium Contrastive Learning (ECL), a supervised CL framework designed to promote geometric equilibrium, where class features, means, and classifiers are harmoniously balanced under data imbalance. The proposed ECL framework uses two main components. First, ECL promotes the representation geometric equilibrium (i.e., a regular simplex geometry characterized by collapsed class samples and uniformly distributed class means), while balancing the contributions of class-average features and class prototypes. Second, ECL establishes a classifier-class center geometric equilibrium by aligning classifier weights and class prototypes. We ran experiments with three long-tailed datasets, the CIFAR-10(0)-LT, ImageNet-LT, and the two imbalanced medical datasets, the ISIC 2019 and our constructed LCCT dataset. Results show that ECL outperforms existing SOTA supervised CL methods designed for imbalanced classification.

Related papers

• Self-Supervised Graph Embedding Clustering [70.36328717683297]
  K-means one-step dimensionality reduction clustering method has made some progress in addressing the curse of dimensionality in clustering tasks. We propose a unified framework that integrates manifold learning with K-means, resulting in the self-supervised graph embedding framework.
  arXiv  Detail & Related papers  (2024-09-24T08:59:51Z)
• Twice Class Bias Correction for Imbalanced Semi-Supervised Learning [59.90429949214134]
  We introduce a novel approach called textbfTwice textbfClass textbfBias textbfCorrection (textbfTCBC) We estimate the class bias of the model parameters during the training process. We apply a secondary correction to the model's pseudo-labels for unlabeled samples.
  arXiv  Detail & Related papers  (2023-12-27T15:06:36Z)
• Subclass-balancing Contrastive Learning for Long-tailed Recognition [38.31221755013738]
  Long-tailed recognition with imbalanced class distribution naturally emerges in practical machine learning applications. We propose a novel subclass-balancing contrastive learning'' approach that clusters each head class into multiple subclasses of similar sizes as the tail classes. We evaluate SBCL over a list of long-tailed benchmark datasets and it achieves the state-of-the-art performance.
  arXiv  Detail & Related papers  (2023-06-28T05:08:43Z)
• Learning in Imperfect Environment: Multi-Label Classification with Long-Tailed Distribution and Partial Labels [53.68653940062605]
  We introduce a novel task, Partial labeling and Long-Tailed Multi-Label Classification (PLT-MLC) We find that most LT-MLC and PL-MLC approaches fail to solve the degradation-MLC. We propose an end-to-end learning framework: textbfCOrrection $rightarrow$ textbfModificattextbfIon $rightarrow$ balantextbfCe.
  arXiv  Detail & Related papers  (2023-04-20T20:05:08Z)
• CLIPood: Generalizing CLIP to Out-of-Distributions [73.86353105017076]
  Contrastive language-image pre-training (CLIP) models have shown impressive zero-shot ability, but the further adaptation of CLIP on downstream tasks undesirably degrades OOD performances. We propose CLIPood, a fine-tuning method that can adapt CLIP models to OOD situations where both domain shifts and open classes may occur on unseen test data. Experiments on diverse datasets with different OOD scenarios show that CLIPood consistently outperforms existing generalization techniques.
  arXiv  Detail & Related papers  (2023-02-02T04:27:54Z)
• Overlapping oriented imbalanced ensemble learning method based on projective clustering and stagewise hybrid sampling [22.32930261633615]
  This paper proposes an ensemble learning algorithm based on dual clustering and stage-wise hybrid sampling (DCSHS) The major advantage of our algorithm is that it can exploit the intersectionality of the CCS to realize the soft elimination of overlapping majority samples.
  arXiv  Detail & Related papers  (2022-11-30T01:49:06Z)
• Invariant Feature Learning for Generalized Long-Tailed Classification [63.97988111638796]
  We introduce Generalized Long-Tailed classification (GLT) to jointly consider both kinds of imbalances.<n>We argue that most class-wise LT methods degenerate in our proposed two benchmarks: ImageNet-GLT and MSCOCO-GLT.<n>We propose an Invariant Feature Learning (IFL) method as the first strong baseline for GLT.
  arXiv  Detail & Related papers  (2022-07-19T18:27:42Z)
• An Asymmetric Contrastive Loss for Handling Imbalanced Datasets [0.0]
  We introduce an asymmetric version of CL, referred to as ACL, to address the problem of class imbalance. In addition, we propose the asymmetric focal contrastive loss (AFCL) as a further generalization of both ACL and focal contrastive loss. Results on the FMNIST and ISIC 2018 imbalanced datasets show that AFCL is capable of outperforming CL and FCL in terms of both weighted and unweighted classification accuracies.
  arXiv  Detail & Related papers  (2022-07-14T17:30:13Z)
• Self-Supervised Class Incremental Learning [51.62542103481908]
  Existing Class Incremental Learning (CIL) methods are based on a supervised classification framework sensitive to data labels. When updating them based on the new class data, they suffer from catastrophic forgetting: the model cannot discern old class data clearly from the new. In this paper, we explore the performance of Self-Supervised representation learning in Class Incremental Learning (SSCIL) for the first time.
  arXiv  Detail & Related papers  (2021-11-18T06:58:19Z)
• CReST: A Class-Rebalancing Self-Training Framework for Imbalanced Semi-Supervised Learning [15.671523625324388]
  We propose Class-Rebalancing Self-Training (CReST) to improve existing SSL methods on class-imbalanced data. CReST iteratively retrains a baseline SSL model with a labeled set expanded. We show that CReST and CReST+ improve state-of-the-art SSL algorithms on various class-imbalanced datasets.
  arXiv  Detail & Related papers  (2021-02-18T18:59:57Z)
• Population structure-learned classifier for high-dimension low-sample-size class-imbalanced problem [3.411873646414169]
  Population Structure-learned classifier (PSC) is proposed. PSC can obtain better generalization performance on IHDLSS. PSC is superior to the state-of-art methods in IHDLSS.
  arXiv  Detail & Related papers  (2020-09-10T08:33:39Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.