Horizontal and Vertical Federated Causal Structure Learning via Higher-order Cumulants

• URL: http://arxiv.org/abs/2507.06888v1
• Date: Wed, 09 Jul 2025 14:25:51 GMT
• Title: Horizontal and Vertical Federated Causal Structure Learning via Higher-order Cumulants
• Authors: Wei Chen, Wanyang Gu, Linjun Peng, Ruichu Cai, Zhifeng Hao, Kun Zhang,
• Abstract summary: In a single client, the incomplete set of variables can easily lead to spurious causal relationships.<n>We provide the identification theories and methods for learning causal structure in the horizontal and vertical federal setting.<n>Our algorithm demonstrates superior performance in experiments conducted on both synthetic data and real-world data.
• Score: 26.960249050737588
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Federated causal discovery aims to uncover the causal relationships between entities while protecting data privacy, which has significant importance and numerous applications in real-world scenarios. Existing federated causal structure learning methods primarily focus on horizontal federated settings. However, in practical situations, different clients may not necessarily contain data on the same variables. In a single client, the incomplete set of variables can easily lead to spurious causal relationships, thereby affecting the information transmitted to other clients. To address this issue, we comprehensively consider causal structure learning methods under both horizontal and vertical federated settings. We provide the identification theories and methods for learning causal structure in the horizontal and vertical federal setting via higher-order cumulants. Specifically, we first aggregate higher-order cumulant information from all participating clients to construct global cumulant estimates. These global estimates are then used for recursive source identification, ultimately yielding a global causal strength matrix. Our approach not only enables the reconstruction of causal graphs but also facilitates the estimation of causal strength coefficients. Our algorithm demonstrates superior performance in experiments conducted on both synthetic data and real-world data.

Related papers

• FedSKC: Federated Learning with Non-IID Data via Structural Knowledge Collaboration [43.25824181502647]
  Key idea of FedSKC is to extract and transfer domain preferences from interclient data distributions.<n>FedSKC comprises three components: contrastive learning, global discrepancy aggregation, and global period review.
  arXiv  Detail & Related papers  (2025-05-25T05:24:49Z)
• Federated Out-of-Distribution Generalization: A Causal Augmentation View [1.1484701120095695]
  This paper proposes a Federated Causal Augmentation method, termed FedCAug.<n>It employs causality-inspired data augmentation to break the spurious correlation between attributes and categories.<n>Experiments conducted on three datasets reveal that FedCAug markedly reduces the model's reliance on background to predict sample labels.
  arXiv  Detail & Related papers  (2025-04-28T15:13:48Z)
• Beyond the Federation: Topology-aware Federated Learning for Generalization to Unseen Clients [10.397502254316645]
  Federated learning is widely employed to tackle distributed sensitive data. Topology-aware Federated Learning (TFL) trains robust models against out-of-federation (OOF) data. We formulate a novel optimization problem for TFL, consisting of two key modules: Client Topology Learning and Learning on Client Topology. Empirical evaluation on a variety of real-world datasets verifies TFL's superior OOF robustness and scalability.
  arXiv  Detail & Related papers  (2024-07-06T03:57:05Z)
• An Aggregation-Free Federated Learning for Tackling Data Heterogeneity [50.44021981013037]
  Federated Learning (FL) relies on the effectiveness of utilizing knowledge from distributed datasets. Traditional FL methods adopt an aggregate-then-adapt framework, where clients update local models based on a global model aggregated by the server from the previous training round. We introduce FedAF, a novel aggregation-free FL algorithm.
  arXiv  Detail & Related papers  (2024-04-29T05:55:23Z)
• Discovery of the Hidden World with Large Language Models [95.58823685009727]
  This paper presents Causal representatiOn AssistanT (COAT) that introduces large language models (LLMs) to bridge the gap. LLMs are trained on massive observations of the world and have demonstrated great capability in extracting key information from unstructured data. COAT also adopts CDs to find causal relations among the identified variables as well as to provide feedback to LLMs to iteratively refine the proposed factors.
  arXiv  Detail & Related papers  (2024-02-06T12:18:54Z)
• Towards Practical Federated Causal Structure Learning [9.74796970978203]
  FedC2SL is a constraint-based causal structure learning scheme that learns causal graphs using a conditional independence test. The study evaluates FedC2SL using both synthetic datasets and real-world data against existing solutions.
  arXiv  Detail & Related papers  (2023-06-15T18:23:58Z)
• Evaluating and Incentivizing Diverse Data Contributions in Collaborative Learning [89.21177894013225]
  For a federated learning model to perform well, it is crucial to have a diverse and representative dataset. We show that the statistical criterion used to quantify the diversity of the data, as well as the choice of the federated learning algorithm used, has a significant effect on the resulting equilibrium. We leverage this to design simple optimal federated learning mechanisms that encourage data collectors to contribute data representative of the global population.
  arXiv  Detail & Related papers  (2023-06-08T23:38:25Z)
• PGFed: Personalize Each Client's Global Objective for Federated Learning [7.810284483002312]
  We propose a novel personalized FL framework that enables each client to personalize its own global objective. To avoid massive (O(N2)) communication overhead and potential privacy leakage, each client's risk is estimated through a first-order approximation for other clients' adaptive risk aggregation. Our experiments on four datasets under different federated settings show consistent improvements of PGFed over previous state-of-the-art methods.
  arXiv  Detail & Related papers  (2022-12-02T21:16:39Z)
• Straggler-Resilient Personalized Federated Learning [55.54344312542944]
  Federated learning allows training models from samples distributed across a large network of clients while respecting privacy and communication restrictions. We develop a novel algorithmic procedure with theoretical speedup guarantees that simultaneously handles two of these hurdles. Our method relies on ideas from representation learning theory to find a global common representation using all clients' data and learn a user-specific set of parameters leading to a personalized solution for each client.
  arXiv  Detail & Related papers  (2022-06-05T01:14:46Z)
• Federated Causal Discovery [74.37739054932733]
  This paper develops a gradient-based learning framework named DAG-Shared Federated Causal Discovery (DS-FCD) It can learn the causal graph without directly touching local data and naturally handle the data heterogeneity. Extensive experiments on both synthetic and real-world datasets verify the efficacy of the proposed method.
  arXiv  Detail & Related papers  (2021-12-07T08:04:12Z)
• Local Learning Matters: Rethinking Data Heterogeneity in Federated Learning [61.488646649045215]
  Federated learning (FL) is a promising strategy for performing privacy-preserving, distributed learning with a network of clients (i.e., edge devices)
  arXiv  Detail & Related papers  (2021-11-28T19:03:39Z)
• Toward Understanding the Influence of Individual Clients in Federated Learning [52.07734799278535]
  Federated learning allows clients to jointly train a global model without sending their private data to a central server. We defined a new notion called em-Influence, quantify this influence over parameters, and proposed an effective efficient model to estimate this metric.
  arXiv  Detail & Related papers  (2020-12-20T14:34:36Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.