Stable Causal Discovery via Directed Acyclic Graph Aggregation
- URL: http://arxiv.org/abs/2605.18633v1
- Date: Mon, 18 May 2026 16:41:31 GMT
- Title: Stable Causal Discovery via Directed Acyclic Graph Aggregation
- Abstract summary: Directed Acyclic Graphs (DAGs) are central to uncovering causal structure in complex systems.<n>We propose DAGgr, a model averaging framework that aggregates multiple candidate DAGs into a single stable representation.<n>We show that DAGgr matches or exceeds the best individual candidate while consistently outperforming bootstrap-aggregation baselines.
- Score: 7.490209955333202
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Directed Acyclic Graphs (DAGs) are central to uncovering causal structure in complex systems, yet learning a single DAG from data is often challenging: model uncertainty, finite samples, and a combinatorially large search space frequently yield unstable estimates. We propose DAGgr, a model averaging framework that aggregates multiple candidate DAGs into a single stable representation. Candidate graphs are weighted by their out-of-sample predictive likelihood across repeated data splits, and a thresholding rule on the resulting edge-importance scores guarantees that the aggregated graph is itself acyclic. We establish a finite-sample risk bound, prove that the procedure preserves acyclicity, and show that edge selection is consistent under mild conditions on the weights. Simulations across random, hub, and chain structures, together with an analysis of the Sachs et al. (2005) protein-signaling network, show that DAGgr matches or exceeds the best individual candidate while consistently outperforming bootstrap-aggregation baselines across structural recovery metrics.
Related papers
- Imputation Meets Clustering: Exploiting Latent Subgroup Structure for Missing Data Recovery [52.29866804948133]
We propose CAGI (Cluster-Aware Generative Imputation), a framework that reformulates clustering and imputation as a mutually reinforcing co-optimization process.<n>Experiments on 14 benchmark datasets with 15 representative baselines demonstrate the superiority of CAGI.
arXiv Detail & Related papers (2026-07-08T02:50:02Z) - SEED: Targeted Data Selection by Weighted Independent Set [76.92528228676969]
We develop a robust and scalable data selection pipeline dubbed SEED.<n>SEED consistently outperforms state-of-the-art methods on instruction tuning, visual instruction tuning, and semantic segmentation.
arXiv Detail & Related papers (2026-05-15T07:26:54Z) - Leveraging heterogeneity for identifiability: Bayesian order-based learning of multiple DAGs [0.5801044612920815]
We propose a joint order-based scoring framework for causal structure learning of directed acyclic graph (DAG) models.<n>Building on this framework, we propose an order-based Bayesian method for Gaussian DAG models.<n>An application to single-nucleus RNA sequencing data from major depressive disorder demonstrates practical utility.
arXiv Detail & Related papers (2026-05-15T05:43:59Z) - A Topological Sorting Criterion for Random Causal Directed Acyclic Graphs [44.42106270319047]
We show that in DAGs, the set of nodes reachable via open paths, termed relatives, increases monotonically along the causal order.<n>We demonstrate that it can be exploited for causal order recovery via sorting by the estimated number of relatives.<n>We propose sampling time-series DAGs as a possible alternative and discuss implications for causal discovery algorithms and their evaluation on synthetic data.
arXiv Detail & Related papers (2026-05-07T13:56:40Z) - Balanced Aggregation: Understanding and Fixing Aggregation Bias in GRPO [70.38763678943648]
Reinforcement learning with verifiable rewards (RLVR) has become a central paradigm for improving reasoning and code generation in large language models.<n>Standard GRPO uses sequence aggregation, while recent work has advocated token aggregation as a better alternative.<n>We show that these two rules induce different optimization biases; token aggregation introduces sign-length coupling, while sequence aggregation implicitly downweights longer responses.
arXiv Detail & Related papers (2026-04-14T09:48:46Z) - DAG DECORation: Continuous Optimization for Structure Learning under Hidden Confounding [0.0]
We study structure learning for linear Gaussian SEMs in the presence of latent confounding.<n>We propose textscDECOR, a single likelihood-based estimator that jointly learns a DAG and a correlated noise model.
arXiv Detail & Related papers (2025-10-02T15:23:30Z) - Kernel-Based Differentiable Learning of Non-Parametric Directed Acyclic Graphical Models [17.52142371968811]
Causal discovery amounts to learning a directed acyclic graph (DAG) that encodes a causal model.
Recent research has sought to bypass the search by reformulating causal discovery as a continuous optimization problem.
arXiv Detail & Related papers (2024-08-20T16:09:40Z) - Last-Iterate Convergence of Adaptive Riemannian Gradient Descent for Equilibrium Computation [52.73824786627612]
This paper establishes new convergence results for textitgeodesic strongly monotone games.<n>Our key result shows that RGD attains last-iterate linear convergence in a textitgeometry-agnostic fashion.<n>Overall, this paper presents the first geometry-agnostic last-iterate convergence analysis for games beyond the Euclidean settings.
arXiv Detail & Related papers (2023-06-29T01:20:44Z) - Graph Signal Sampling for Inductive One-Bit Matrix Completion: a
Closed-form Solution [112.3443939502313]
We propose a unified graph signal sampling framework which enjoys the benefits of graph signal analysis and processing.
The key idea is to transform each user's ratings on the items to a function (signal) on the vertices of an item-item graph.
For the online setting, we develop a Bayesian extension, i.e., BGS-IMC which considers continuous random Gaussian noise in the graph Fourier domain.
arXiv Detail & Related papers (2023-02-08T08:17:43Z) - Reinforcement Causal Structure Learning on Order Graph [18.344249064559087]
We propose Reinforcement Causal Structure Learning on Order Graph (RCL-OG) to model different DAG topological orderings.
RCL-OG first defines reinforcement learning with a new reward mechanism to approximate the posterior distribution of orderings.
It computes the posterior probability of different orderings.
arXiv Detail & Related papers (2022-11-22T10:29:25Z) - BCDAG: An R package for Bayesian structure and Causal learning of
Gaussian DAGs [77.34726150561087]
We introduce the R package for causal discovery and causal effect estimation from observational data.
Our implementation scales efficiently with the number of observations and, whenever the DAGs are sufficiently sparse, the number of variables in the dataset.
We then illustrate the main functions and algorithms on both real and simulated datasets.
arXiv Detail & Related papers (2022-01-28T09:30:32Z) - BCD Nets: Scalable Variational Approaches for Bayesian Causal Discovery [97.79015388276483]
A structural equation model (SEM) is an effective framework to reason over causal relationships represented via a directed acyclic graph (DAG)
Recent advances enabled effective maximum-likelihood point estimation of DAGs from observational data.
We propose BCD Nets, a variational framework for estimating a distribution over DAGs characterizing a linear-Gaussian SEM.
arXiv Detail & Related papers (2021-12-06T03:35:21Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.