FedTopo: Relation-Level Topology Sharing for Model-Heterogeneous Federated Learning

• URL: http://arxiv.org/abs/2607.26801v1
• Date: Wed, 29 Jul 2026 11:39:21 GMT
• Title: FedTopo: Relation-Level Topology Sharing for Model-Heterogeneous Federated Learning
• Abstract summary: Federated learning (FL) enables collaborative learning over decentralized data silos without centralizing raw data.<n>Existing paradigms share this knowledge as model parameters, distilled predictions, or class prototypes.<n>We propose FedTopo, a relation-level framework that encodes global knowledge as class relation topology.
• Score: 32.256904591785094
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Federated learning (FL) enables collaborative learning over decentralized data silos without centralizing raw data. However, heterogeneous local architectures often induce non-aligned representation spaces, making it difficult to transfer global knowledge across silos. Existing paradigms share this knowledge as model parameters, distilled predictions, or class prototypes, yet all encode it in an absolute space that must be aligned across clients. Heterogeneous backbones break this alignment, so the shared knowledge becomes unreliable and misleads local training. We propose FedTopo, a relation-level framework that encodes global knowledge as class relation topology, capturing how classes relate within each client rather than where they lie in feature space. Each client builds its relation topology from local prototypes and uploads it with class statistics. The server then aggregates these relations in a reliability-aware manner that down-weights weakly supported ones, and broadcasts the global topology to clients. The global topology guides local training by emphasizing topology-similar negative classes. Experiments on three datasets under eight heterogeneous backbones show that FedTopo consistently outperforms parameter-, distillation-, and prototype-sharing baselines, with low communication and no inference overhead. Our code is available at https://github.com/Zhaoyang-Ma/FedTopo.

Related papers

• FedADB: Class Anchor-Driven Dual-Branch Federated Learning for Mitigating Forgetting [23.09070623080108]
  FedADB is a Class Anchor-Driven Dual-Branch FL framework.<n>It balances class-wise global consistency and local optimization objectives without proxy datasets.<n>It achieves significant improvements in both accuracy and convergence speed.
  arXiv  Detail & Related papers  (2026-08-15T16:28:23Z)
• FedSKC: Federated Learning with Non-IID Data via Structural Knowledge Collaboration [43.25824181502647]
  Key idea of FedSKC is to extract and transfer domain preferences from interclient data distributions.<n>FedSKC comprises three components: contrastive learning, global discrepancy aggregation, and global period review.
  arXiv  Detail & Related papers  (2025-05-25T05:24:49Z)
• Federated Class-Incremental Learning: A Hybrid Approach Using Latent Exemplars and Data-Free Techniques to Address Local and Global Forgetting [10.061328213032088]
  Federated Class-Incremental Learning (FCIL) refers to a scenario where a dynamically changing number of clients collaboratively learn an ever-increasing number of incoming tasks.<n>We develop a mathematical framework for FCIL that formulates local and global forgetting.<n>We propose an approach called Hybrid Rehearsal which utilizes latent exemplars and data-free techniques to address local and global forgetting.
  arXiv  Detail & Related papers  (2025-01-26T01:08:01Z)
• Federated Learning with Bilateral Curation for Partially Class-Disjoint Data [47.55180390473258]
  Partially class-disjoint data (PCDD), a common yet under-explored data formation, severely challenges the performance of federated algorithms. We propose a novel approach called FedGELA where the ETF is globally fixed as a simplex ETF while locally adapted to the personal distributions. We conduct extensive experiments on a range of datasets to demonstrate that our FedGELA achieves promising performance.
  arXiv  Detail & Related papers  (2024-05-29T10:34:44Z)
• Rethinking Client Drift in Federated Learning: A Logit Perspective [125.35844582366441]
  Federated Learning (FL) enables multiple clients to collaboratively learn in a distributed way, allowing for privacy protection. We find that the difference in logits between the local and global models increases as the model is continuously updated. We propose a new algorithm, named FedCSD, a Class prototype Similarity Distillation in a federated framework to align the local and global models.
  arXiv  Detail & Related papers  (2023-08-20T04:41:01Z)
• Towards Instance-adaptive Inference for Federated Learning [80.38701896056828]
  Federated learning (FL) is a distributed learning paradigm that enables multiple clients to learn a powerful global model by aggregating local training. In this paper, we present a novel FL algorithm, i.e., FedIns, to handle intra-client data heterogeneity by enabling instance-adaptive inference in the FL framework. Our experiments show that our FedIns outperforms state-of-the-art FL algorithms, e.g., a 6.64% improvement against the top-performing method with less than 15% communication cost on Tiny-ImageNet.
  arXiv  Detail & Related papers  (2023-08-11T09:58:47Z)
• Fusion of Global and Local Knowledge for Personalized Federated Learning [75.20751492913892]
  In this paper, we explore personalized models with low-rank and sparse decomposition. We propose a two-stage-based algorithm named textbfFederated learning with mixed textbfSparse and textbfRank representation. Under proper assumptions, we show that the GKR trained by FedSLR can at least sub-linearly converge to a stationary point of the regularized problem.
  arXiv  Detail & Related papers  (2023-02-21T23:09:45Z)
• Towards Understanding and Mitigating Dimensional Collapse in Heterogeneous Federated Learning [112.69497636932955]
  Federated learning aims to train models across different clients without the sharing of data for privacy considerations. We study how data heterogeneity affects the representations of the globally aggregated models. We propose sc FedDecorr, a novel method that can effectively mitigate dimensional collapse in federated learning.
  arXiv  Detail & Related papers  (2022-10-01T09:04:17Z)
• FedILC: Weighted Geometric Mean and Invariant Gradient Covariance for Federated Learning on Non-IID Data [69.0785021613868]
  Federated learning is a distributed machine learning approach which enables a shared server model to learn by aggregating the locally-computed parameter updates with the training data from spatially-distributed client silos. We propose the Federated Invariant Learning Consistency (FedILC) approach, which leverages the gradient covariance and the geometric mean of Hessians to capture both inter-silo and intra-silo consistencies. This is relevant to various fields such as medical healthcare, computer vision, and the Internet of Things (IoT)
  arXiv  Detail & Related papers  (2022-05-19T03:32:03Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.