PROTOCOL: Partial Optimal Transport-enhanced Contrastive Learning for Imbalanced Multi-view Clustering

• URL: http://arxiv.org/abs/2506.12408v1
• Date: Sat, 14 Jun 2025 08:58:14 GMT
• Title: PROTOCOL: Partial Optimal Transport-enhanced Contrastive Learning for Imbalanced Multi-view Clustering
• Authors: Xuqian Xue, Yiming Lei, Qi Cai, Hongming Shan, Junping Zhang,
• Abstract summary: We present the first systematic study of imbalanced multi-view clustering.<n>We propose PROTOCOL, a novel PaRtial Optimal TranspOrt-enhanced COntrastive Learning framework.<n>We show that PROTOCOL significantly improves clustering performance on imbalanced multi-view data.
• Score: 45.7495319490544
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: While contrastive multi-view clustering has achieved remarkable success, it implicitly assumes balanced class distribution. However, real-world multi-view data primarily exhibits class imbalance distribution. Consequently, existing methods suffer performance degradation due to their inability to perceive and model such imbalance. To address this challenge, we present the first systematic study of imbalanced multi-view clustering, focusing on two fundamental problems: i. perceiving class imbalance distribution, and ii. mitigating representation degradation of minority samples. We propose PROTOCOL, a novel PaRtial Optimal TranspOrt-enhanced COntrastive Learning framework for imbalanced multi-view clustering. First, for class imbalance perception, we map multi-view features into a consensus space and reformulate the imbalanced clustering as a partial optimal transport (POT) problem, augmented with progressive mass constraints and weighted KL divergence for class distributions. Second, we develop a POT-enhanced class-rebalanced contrastive learning at both feature and class levels, incorporating logit adjustment and class-sensitive learning to enhance minority sample representations. Extensive experiments demonstrate that PROTOCOL significantly improves clustering performance on imbalanced multi-view data, filling a critical research gap in this field.

Related papers

• Adversarial Fair Multi-View Clustering [7.650076926241037]
  We propose an adversarial fair multi-view clustering (AFMVC) framework that integrates fairness learning into the representation learning process.<n>Our framework achieves superior fairness and competitive clustering performance compared to existing multi-view clustering and fairness-aware clustering methods.
  arXiv  Detail & Related papers  (2025-08-06T04:07:08Z)
• GBRIP: Granular Ball Representation for Imbalanced Partial Label Learning [34.555684625956516]
  We introduce Granular Ball Representation for Imbalanced (GBRIP), a novel framework for imbalanced learning.<n>GBRIP utilizes coarse-grained granular ball representation and multi-center loss to construct a granular ball-based nfeature space through unsupervised learning.<n>The novel multi-center loss function enhances learning by emphasizing the relationships between samples and their respective centers within the granular balls.
  arXiv  Detail & Related papers  (2024-12-19T06:26:16Z)
• Revisiting Self-Supervised Heterogeneous Graph Learning from Spectral Clustering Perspective [52.662463893268225]
  Self-supervised heterogeneous graph learning (SHGL) has shown promising potential in diverse scenarios.<n>Existing SHGL methods encounter two significant limitations.<n>We introduce a novel framework enhanced by rank and dual consistency constraints.
  arXiv  Detail & Related papers  (2024-12-01T09:33:20Z)
• Covariance-corrected Whitening Alleviates Network Degeneration on Imbalanced Classification [6.197116272789107]
  Class imbalance is a critical issue in image classification that significantly affects the performance of deep recognition models. We propose a novel framework called Whitening-Net to mitigate the degenerate solutions. In scenarios with extreme class imbalance, the batch covariance statistic exhibits significant fluctuations, impeding the convergence of the whitening operation.
  arXiv  Detail & Related papers  (2024-08-30T10:49:33Z)
• P$^2$OT: Progressive Partial Optimal Transport for Deep Imbalanced Clustering [16.723646401890495]
  We propose a novel pseudo-labeling-based learning framework for deep clustering. Our framework generates imbalance-aware pseudo-labels and learning from high-confident samples. Experiments on various datasets, including a human-curated long-tailed CIFAR100, demonstrate the superiority of our method.
  arXiv  Detail & Related papers  (2024-01-17T15:15:46Z)
• Uncertainty-guided Boundary Learning for Imbalanced Social Event Detection [64.4350027428928]
  We propose a novel uncertainty-guided class imbalance learning framework for imbalanced social event detection tasks. Our model significantly improves social event representation and classification tasks in almost all classes, especially those uncertain ones.
  arXiv  Detail & Related papers  (2023-10-30T03:32:04Z)
• Class-Imbalanced Graph Learning without Class Rebalancing [62.1368829847041]
  Class imbalance is prevalent in real-world node classification tasks and poses great challenges for graph learning models. In this work, we approach the root cause of class-imbalance bias from an topological paradigm. We devise a lightweight topological augmentation framework BAT to mitigate the class-imbalance bias without class rebalancing.
  arXiv  Detail & Related papers  (2023-08-27T19:01:29Z)
• Joint Debiased Representation and Image Clustering Learning with Self-Supervision [3.1806743741013657]
  We develop a novel joint clustering and contrastive learning framework. We adapt the debiased contrastive loss to avoid under-clustering minority classes of imbalanced datasets.
  arXiv  Detail & Related papers  (2022-09-14T21:23:41Z)
• Targeted Supervised Contrastive Learning for Long-Tailed Recognition [50.24044608432207]
  Real-world data often exhibits long tail distributions with heavy class imbalance. We show that while supervised contrastive learning can help improve performance, past baselines suffer from poor uniformity brought in by imbalanced data distribution. We propose targeted supervised contrastive learning (TSC), which improves the uniformity of the feature distribution on the hypersphere.
  arXiv  Detail & Related papers  (2021-11-27T22:40:10Z)
• Supercharging Imbalanced Data Learning With Energy-based Contrastive Representation Transfer [72.5190560787569]
  In computer vision, learning from long tailed datasets is a recurring theme, especially for natural image datasets. Our proposal posits a meta-distributional scenario, where the data generating mechanism is invariant across the label-conditional feature distributions. This allows us to leverage a causal data inflation procedure to enlarge the representation of minority classes.
  arXiv  Detail & Related papers  (2020-11-25T00:13:11Z)
• Unbalanced Incomplete Multi-view Clustering via the Scheme of View Evolution: Weak Views are Meat; Strong Views do Eat [59.77141155608009]
  Unbalanced Incomplete Multi-view Clustering method (UIMC) is first effective method based on view evolution for unbalanced incomplete multi-view clustering. UIMC improves the clustering performance by up to 40% on three evaluation metrics over other state-of-the-art methods.
  arXiv  Detail & Related papers  (2020-11-20T08:00:25Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.