A Simulation-Based Test of Identifiability for Bayesian Causal Inference
- URL: http://arxiv.org/abs/2102.11761v1
- Date: Tue, 23 Feb 2021 15:42:06 GMT
- Title: A Simulation-Based Test of Identifiability for Bayesian Causal Inference
- Authors: Sam Witty, David Jensen, Vikash Mansinghka
- Abstract summary: We present a fully automated identification test based on a particle optimization scheme with simulated observations.
We show that SBI agrees with known results in graph-based identification as well as with widely-held intuitions for designs in which graph-based methods are inconclusive.
- Score: 9.550238260901121
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: This paper introduces a procedure for testing the identifiability of Bayesian
models for causal inference. Although the do-calculus is sound and complete
given a causal graph, many practical assumptions cannot be expressed in terms
of graph structure alone, such as the assumptions required by instrumental
variable designs, regression discontinuity designs, and within-subjects
designs. We present simulation-based identifiability (SBI), a fully automated
identification test based on a particle optimization scheme with simulated
observations. This approach expresses causal assumptions as priors over
functions in a structural causal model, including flexible priors using
Gaussian processes. We prove that SBI is asymptotically sound and complete, and
produces practical finite-sample bounds. We also show empirically that SBI
agrees with known results in graph-based identification as well as with
widely-held intuitions for designs in which graph-based methods are
inconclusive.
Related papers
- Estimating Causal Effects from Learned Causal Networks [56.14597641617531]
We propose an alternative paradigm for answering causal-effect queries over discrete observable variables.
We learn the causal Bayesian network and its confounding latent variables directly from the observational data.
We show that this emphmodel completion learning approach can be more effective than estimand approaches.
arXiv Detail & Related papers (2024-08-26T08:39:09Z) - The Foundations of Tokenization: Statistical and Computational Concerns [51.370165245628975]
Tokenization is a critical step in the NLP pipeline.
Despite its recognized importance as a standard representation method in NLP, the theoretical underpinnings of tokenization are not yet fully understood.
The present paper contributes to addressing this theoretical gap by proposing a unified formal framework for representing and analyzing tokenizer models.
arXiv Detail & Related papers (2024-07-16T11:12:28Z) - Algorithmic syntactic causal identification [0.8901073744693314]
Causal identification in causal Bayes nets (CBNs) is an important tool in causal inference.
Most existing formulations of causal identification using techniques such as d-separation and do-calculus are expressed within the mathematical language of classical probability theory.
We show that this restriction can be lifted by replacing the use of classical probability theory with the alternative axiomatic foundation of symmetric monoidal categories.
arXiv Detail & Related papers (2024-03-14T17:14:53Z) - Partially Specified Causal Simulations [0.0]
Many causal inference literature tend to design over-restricted or misspecified studies.
We introduce partially randomized causal simulation (PARCS), a simulation framework that meets those desiderata.
We reproduce and extend the simulation studies of two well-known causal discovery and missing data analysis papers.
arXiv Detail & Related papers (2023-09-19T10:50:35Z) - Learning Robust Statistics for Simulation-based Inference under Model
Misspecification [23.331522354991527]
We propose the first general approach to handle model misspecification that works across different classes of simulation-based inference methods.
We show that our method yields robust inference in misspecified scenarios, whilst still being accurate when the model is well-specified.
arXiv Detail & Related papers (2023-05-25T09:06:26Z) - Validation Diagnostics for SBI algorithms based on Normalizing Flows [55.41644538483948]
This work proposes easy to interpret validation diagnostics for multi-dimensional conditional (posterior) density estimators based on NF.
It also offers theoretical guarantees based on results of local consistency.
This work should help the design of better specified models or drive the development of novel SBI-algorithms.
arXiv Detail & Related papers (2022-11-17T15:48:06Z) - Investigating the Impact of Model Misspecification in Neural
Simulation-based Inference [1.933681537640272]
We study the behaviour of neural SBI algorithms in the presence of various forms of model misspecification.
We find that misspecification can have a profoundly deleterious effect on performance.
We conclude that new approaches are required to address model misspecification if neural SBI algorithms are to be relied upon to derive accurate conclusions.
arXiv Detail & Related papers (2022-09-05T09:08:16Z) - Causality and Generalizability: Identifiability and Learning Methods [0.0]
This thesis contributes to the research areas concerning the estimation of causal effects, causal structure learning, and distributionally robust prediction methods.
We present novel and consistent linear and non-linear causal effects estimators in instrumental variable settings that employ data-dependent mean squared prediction error regularization.
We propose a general framework for distributional robustness with respect to intervention-induced distributions.
arXiv Detail & Related papers (2021-10-04T13:12:11Z) - Estimation of Bivariate Structural Causal Models by Variational Gaussian
Process Regression Under Likelihoods Parametrised by Normalising Flows [74.85071867225533]
Causal mechanisms can be described by structural causal models.
One major drawback of state-of-the-art artificial intelligence is its lack of explainability.
arXiv Detail & Related papers (2021-09-06T14:52:58Z) - Sinkhorn Natural Gradient for Generative Models [125.89871274202439]
We propose a novel Sinkhorn Natural Gradient (SiNG) algorithm which acts as a steepest descent method on the probability space endowed with the Sinkhorn divergence.
We show that the Sinkhorn information matrix (SIM), a key component of SiNG, has an explicit expression and can be evaluated accurately in complexity that scales logarithmically.
In our experiments, we quantitatively compare SiNG with state-of-the-art SGD-type solvers on generative tasks to demonstrate its efficiency and efficacy of our method.
arXiv Detail & Related papers (2020-11-09T02:51:17Z) - Structural Causal Models Are (Solvable by) Credal Networks [70.45873402967297]
Causal inferences can be obtained by standard algorithms for the updating of credal nets.
This contribution should be regarded as a systematic approach to represent structural causal models by credal networks.
Experiments show that approximate algorithms for credal networks can immediately be used to do causal inference in real-size problems.
arXiv Detail & Related papers (2020-08-02T11:19:36Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.