FedHarmony: Harmonizing Heterogeneous Label Correlations in Federated Multi-Label Learning

• URL: http://arxiv.org/abs/2604.28024v1
• Date: Thu, 30 Apr 2026 15:42:17 GMT
• Title: FedHarmony: Harmonizing Heterogeneous Label Correlations in Federated Multi-Label Learning
• Abstract summary: We propose FedHarmony, a framework that harmonizes heterogeneous label correlations across clients.<n>During aggregation, FedHarmony evaluates each client by both data size and correlation quality, assigning weights accordingly.<n>Experiments on real-world federated multi-label datasets show that FedHarmony consistently outperforms state-of-the-art methods.
• Score: 76.62016339908384
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Federated Multi-Label Learning is a distributed paradigm where multiple clients possess heterogeneous multi-label data and perform collaborative learning under privacy constraints without sharing raw data. However, modeling label correlations under heterogeneous distributions remains challenging. Due to client-specific label spaces and varying co-occurrence patterns, correlations learned by individual clients inevitably deviate from the global structure, a phenomenon we term label correlation drift. To address this, we propose FedHarmony, a framework that harmonizes heterogeneous label correlations across clients. It introduces consensus correlation, capturing agreement among other clients and serving as a global teacher to correct biased local estimates. During aggregation, FedHarmony evaluates each client by both data size and correlation quality, assigning weights accordingly. Moreover, we develop an accelerated optimization algorithm for FedHarmony and theoretically establish faster convergence without sacrificing accuracy. Experiments on real-world federated multi-label datasets show that FedHarmony consistently outperforms state-of-the-art methods.

Related papers

• FedFusion: Federated Learning with Diversity- and Cluster-Aware Encoders for Robust Adaptation under Label Scarcity [33.17279604575767]
  FedFusion is a federated transfer-learning framework that unifies domain adaptation and frugal labelling.<n>Labelled teacher clients guide learner clients via confidence-filtered pseudo-labels and domain-adaptive transfer.<n>FedFusion consistently outperforms state-of-the-art baselines in accuracy, robustness, and fairness.
  arXiv  Detail & Related papers  (2025-09-23T16:46:06Z)
• Multi-Label Bayesian Active Learning with Inter-Label Relationships [6.641227380551414]
  We propose a new multi-label active learning strategy to address both challenges.<n>Our method incorporates progressively updated positive and negative correlation matrices to capture co-occurrence and disjoint relationships.<n>Our strategy consistently achieves more reliable and superior performance, compared to several established methods.
  arXiv  Detail & Related papers  (2024-11-26T23:28:54Z)
• Overcoming label shift with target-aware federated learning [10.355835466049092]
  Federated learning enables multiple actors to collaboratively train models without sharing private data.<n>A common reason is label shift -- that the label distributions differ between clients and the target domain.<n>We propose FedPALS, a principled and practical model aggregation scheme that adapts to label shifts to improve performance in the target domain.
  arXiv  Detail & Related papers  (2024-11-06T09:52:45Z)
• An Aggregation-Free Federated Learning for Tackling Data Heterogeneity [50.44021981013037]
  Federated Learning (FL) relies on the effectiveness of utilizing knowledge from distributed datasets. Traditional FL methods adopt an aggregate-then-adapt framework, where clients update local models based on a global model aggregated by the server from the previous training round. We introduce FedAF, a novel aggregation-free FL algorithm.
  arXiv  Detail & Related papers  (2024-04-29T05:55:23Z)
• FedCoSR: Personalized Federated Learning with Contrastive Shareable Representations for Label Heterogeneity in Non-IID Data [11.389706928654965]
  This paper proposes a novel personalized learning algorithm, named Federated Contrastive Shareable Representations (FedCoSR)<n>The parameters of local models' shallow layers and typical local representations are both considered as shareable information for the server.<n>To address performance degradation caused by label distribution skew among clients, contrastive learning is adopted between local and global representations.
  arXiv  Detail & Related papers  (2024-04-27T14:05:18Z)
• Federated Learning with Only Positive Labels by Exploring Label Correlations [78.59613150221597]
  Federated learning aims to collaboratively learn a model by using the data from multiple users under privacy constraints. In this paper, we study the multi-label classification problem under the federated learning setting. We propose a novel and generic method termed Federated Averaging by exploring Label Correlations (FedALC)
  arXiv  Detail & Related papers  (2024-04-24T02:22:50Z)
• FedAnchor: Enhancing Federated Semi-Supervised Learning with Label Contrastive Loss for Unlabeled Clients [19.3885479917635]
  Federated learning (FL) is a distributed learning paradigm that facilitates collaborative training of a shared global model across devices. We propose FedAnchor, an innovative FSSL method that introduces a unique double-head structure, called anchor head, paired with the classification head trained exclusively on labeled anchor data on the server. Our approach mitigates the confirmation bias and overfitting issues associated with pseudo-labeling techniques based on high-confidence model prediction samples.
  arXiv  Detail & Related papers  (2024-02-15T18:48:21Z)
• JointMatch: A Unified Approach for Diverse and Collaborative Pseudo-Labeling to Semi-Supervised Text Classification [65.268245109828]
  Semi-supervised text classification (SSTC) has gained increasing attention due to its ability to leverage unlabeled data. Existing approaches based on pseudo-labeling suffer from the issues of pseudo-label bias and error accumulation. We propose JointMatch, a holistic approach for SSTC that addresses these challenges by unifying ideas from recent semi-supervised learning.
  arXiv  Detail & Related papers  (2023-10-23T05:43:35Z)
• FedFM: Anchor-based Feature Matching for Data Heterogeneity in Federated Learning [91.74206675452888]
  We propose a novel method FedFM, which guides each client's features to match shared category-wise anchors. To achieve higher efficiency and flexibility, we propose a FedFM variant, called FedFM-Lite, where clients communicate with server with fewer synchronization times and communication bandwidth costs.
  arXiv  Detail & Related papers  (2022-10-14T08:11:34Z)
• Multi-View Correlation Consistency for Semi-Supervised Semantic Segmentation [59.34619548026885]
  Semi-supervised semantic segmentation needs rich and robust supervision on unlabeled data. We propose a view-coherent data augmentation strategy that guarantees pixel-pixel correspondence between different views. In a series of semi-supervised settings on two datasets, we report competitive accuracy compared with the state-of-the-art methods.
  arXiv  Detail & Related papers  (2022-08-17T17:59:11Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.