Latent Hierarchical Causal Structure Discovery with Rank Constraints
- URL: http://arxiv.org/abs/2210.01798v1
- Date: Sat, 1 Oct 2022 03:27:54 GMT
- Title: Latent Hierarchical Causal Structure Discovery with Rank Constraints
- Authors: Biwei Huang, Charles Jia Han Low, Feng Xie, Clark Glymour, Kun Zhang
- Abstract summary: We consider a challenging scenario for causal structure identification, where some variables are latent and they form a hierarchical graph structure.
We propose an estimation procedure that can efficiently locate latent variables, determine their cardinalities, and identify the latent hierarchical structure.
- Score: 19.61598654735681
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Most causal discovery procedures assume that there are no latent confounders
in the system, which is often violated in real-world problems. In this paper,
we consider a challenging scenario for causal structure identification, where
some variables are latent and they form a hierarchical graph structure to
generate the measured variables; the children of latent variables may still be
latent and only leaf nodes are measured, and moreover, there can be multiple
paths between every pair of variables (i.e., it is beyond tree structure). We
propose an estimation procedure that can efficiently locate latent variables,
determine their cardinalities, and identify the latent hierarchical structure,
by leveraging rank deficiency constraints over the measured variables. We show
that the proposed algorithm can find the correct Markov equivalence class of
the whole graph asymptotically under proper restrictions on the graph
structure.
Related papers
- Identifying General Mechanism Shifts in Linear Causal Representations [58.6238439611389]
We consider the linear causal representation learning setting where we observe a linear mixing of $d$ unknown latent factors.
Recent work has shown that it is possible to recover the latent factors as well as the underlying structural causal model over them.
We provide a surprising identifiability result that it is indeed possible, under some very mild standard assumptions, to identify the set of shifted nodes.
arXiv Detail & Related papers (2024-10-31T15:56:50Z) - Learning Discrete Latent Variable Structures with Tensor Rank Conditions [30.292492090200984]
Unobserved discrete data are ubiquitous in many scientific disciplines, and how to learn the causal structure of these latent variables is crucial for uncovering data patterns.
Most studies focus on the linear latent variable model or impose strict constraints on latent structures, which fail to address cases in discrete data involving non-linear relationships or complex latent structures.
We explore a tensor rank condition on contingency tables for an observed variable set $mathbfX_p$, showing that the rank is determined by the minimum support of a specific conditional set.
One can locate the latent variable through probing the rank on different observed variables
arXiv Detail & Related papers (2024-06-11T07:25:17Z) - Nonparametric Partial Disentanglement via Mechanism Sparsity: Sparse
Actions, Interventions and Sparse Temporal Dependencies [58.179981892921056]
This work introduces a novel principle for disentanglement we call mechanism sparsity regularization.
We propose a representation learning method that induces disentanglement by simultaneously learning the latent factors.
We show that the latent factors can be recovered by regularizing the learned causal graph to be sparse.
arXiv Detail & Related papers (2024-01-10T02:38:21Z) - A Versatile Causal Discovery Framework to Allow Causally-Related Hidden
Variables [28.51579090194802]
We introduce a novel framework for causal discovery that accommodates the presence of causally-related hidden variables almost everywhere in the causal network.
We develop a Rank-based Latent Causal Discovery algorithm, RLCD, that can efficiently locate hidden variables, determine their cardinalities, and discover the entire causal structure over both measured and hidden ones.
Experimental results on both synthetic and real-world personality data sets demonstrate the efficacy of the proposed approach in finite-sample cases.
arXiv Detail & Related papers (2023-12-18T07:57:39Z) - Identification for Tree-shaped Structural Causal Models in Polynomial
Time [1.5151556900495786]
Identifying causal parameters from correlations between nodes is an open problem in artificial intelligence.
In this paper, we study SCMs whose directed component forms a tree.
We present a randomized-time algorithm, which solves the identification problem for tree-shaped SCMs.
arXiv Detail & Related papers (2023-11-23T15:26:29Z) - Identification of Nonlinear Latent Hierarchical Models [38.925635086396596]
We develop an identification criterion in the form of novel identifiability guarantees for an elementary latent variable model.
To the best of our knowledge, our work is the first to establish identifiability guarantees for both causal structures and latent variables in nonlinear latent hierarchical models.
arXiv Detail & Related papers (2023-06-13T17:19:37Z) - Differentiable and Transportable Structure Learning [73.84540901950616]
We introduce D-Struct, which recovers transportability in the discovered structures through a novel architecture and loss function.
Because D-Struct remains differentiable, our method can be easily adopted in existing differentiable architectures.
arXiv Detail & Related papers (2022-06-13T17:50:53Z) - Effect Identification in Cluster Causal Diagrams [51.42809552422494]
We introduce a new type of graphical model called cluster causal diagrams (for short, C-DAGs)
C-DAGs allow for the partial specification of relationships among variables based on limited prior knowledge.
We develop the foundations and machinery for valid causal inferences over C-DAGs.
arXiv Detail & Related papers (2022-02-22T21:27:31Z) - Variational Causal Networks: Approximate Bayesian Inference over Causal
Structures [132.74509389517203]
We introduce a parametric variational family modelled by an autoregressive distribution over the space of discrete DAGs.
In experiments, we demonstrate that the proposed variational posterior is able to provide a good approximation of the true posterior.
arXiv Detail & Related papers (2021-06-14T17:52:49Z) - A Recursive Markov Boundary-Based Approach to Causal Structure Learning [22.38302412440357]
We propose a novel recursion-based method for causal structure learning.
It significantly reduces the required number of conditional independence tests.
Our experimental results show that the proposed algorithm outperforms state-of-the-art both on synthetic and real-world structures.
arXiv Detail & Related papers (2020-10-10T13:26:22Z) - An Integer Linear Programming Framework for Mining Constraints from Data [81.60135973848125]
We present a general framework for mining constraints from data.
In particular, we consider the inference in structured output prediction as an integer linear programming (ILP) problem.
We show that our approach can learn to solve 9x9 Sudoku puzzles and minimal spanning tree problems from examples without providing the underlying rules.
arXiv Detail & Related papers (2020-06-18T20:09:53Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.