Invariant Causal Prediction with Local Models
- URL: http://arxiv.org/abs/2401.05218v2
- Date: Fri, 30 Aug 2024 14:27:33 GMT
- Title: Invariant Causal Prediction with Local Models
- Authors: Alexander Mey, Rui Manuel Castro,
- Abstract summary: We consider the task of identifying the causal parents of a target variable among a set of candidates from observational data.
We introduce a practical method called L-ICP ($textbfL$ocalized $textbfI$nvariant $textbfCa$usal $textbfP$rediction), which is based on a hypothesis test for parent identification using a ratio of minimum and maximum statistics.
- Score: 52.161513027831646
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: We consider the task of identifying the causal parents of a target variable among a set of candidates from observational data. Our main assumption is that the candidate variables are observed in different environments which may, under certain assumptions, be regarded as interventions on the observed system. We assume a linear relationship between target and candidates, which can be different in each environment with the only restriction that the causal structure is invariant across environments. Within our proposed setting we provide sufficient conditions for identifiability of the causal parents and introduce a practical method called L-ICP ($\textbf{L}$ocalized $\textbf{I}$nvariant $\textbf{Ca}$usal $\textbf{P}$rediction), which is based on a hypothesis test for parent identification using a ratio of minimum and maximum statistics. We then show in a simplified setting that the statistical power of L-ICP converges exponentially fast in the sample size, and finally we analyze the behavior of L-ICP experimentally in more general settings.
Related papers
- Efficient Identification of Direct Causal Parents via Invariance and Minimum Error Testing [8.40704222803588]
We propose MMSE-ICP and fastICP, two approaches which employ an error inequality to address the identifiability problem of ICP.
The inequality states that the minimum prediction error of the predictor using causal parents is the smallest among all predictors.
MMSE-ICP and fastICP not only outperform competitive baselines in many simulations but also achieve state-the-art result on a large scale real data benchmark.
arXiv Detail & Related papers (2024-09-19T14:07:31Z) - On the Identification of Temporally Causal Representation with Instantaneous Dependence [50.14432597910128]
Temporally causal representation learning aims to identify the latent causal process from time series observations.
Most methods require the assumption that the latent causal processes do not have instantaneous relations.
We propose an textbfIDentification framework for instantanetextbfOus textbfLatent dynamics.
arXiv Detail & Related papers (2024-05-24T08:08:05Z) - Local Discovery by Partitioning: Polynomial-Time Causal Discovery Around Exposure-Outcome Pairs [18.31538168213386]
We propose local discovery by partitioning (LDP) for causal inference tasks.
LDP is a constraint-based procedure that returns a VAS for an exposure-outcome pair under latent confounding.
Adjustment sets from LDP yield less biased and more precise average treatment effect estimates than baseline discovery algorithms.
arXiv Detail & Related papers (2023-10-25T14:53:10Z) - Nonparametric Identifiability of Causal Representations from Unknown
Interventions [63.1354734978244]
We study causal representation learning, the task of inferring latent causal variables and their causal relations from mixtures of the variables.
Our goal is to identify both the ground truth latents and their causal graph up to a set of ambiguities which we show to be irresolvable from interventional data.
arXiv Detail & Related papers (2023-06-01T10:51:58Z) - Reinterpreting causal discovery as the task of predicting unobserved
joint statistics [15.088547731564782]
We argue that causal discovery can help inferring properties of the unobserved joint distributions'
We define a learning scenario where the input is a subset of variables and the label is some statistical property of that subset.
arXiv Detail & Related papers (2023-05-11T15:30:54Z) - Invariant Ancestry Search [6.583725235299022]
We introduce the concept of minimal invariance and propose invariant ancestry search (IAS)
In its population version, IAS outputs a set which contains only ancestors of the response and is the output of ICP.
We develop scalable algorithms and perform experiments on simulated and real data.
arXiv Detail & Related papers (2022-02-02T08:28:00Z) - Variance Minimization in the Wasserstein Space for Invariant Causal
Prediction [72.13445677280792]
In this work, we show that the approach taken in ICP may be reformulated as a series of nonparametric tests that scales linearly in the number of predictors.
Each of these tests relies on the minimization of a novel loss function that is derived from tools in optimal transport theory.
We prove under mild assumptions that our method is able to recover the set of identifiable direct causes, and we demonstrate in our experiments that it is competitive with other benchmark causal discovery algorithms.
arXiv Detail & Related papers (2021-10-13T22:30:47Z) - Typing assumptions improve identification in causal discovery [123.06886784834471]
Causal discovery from observational data is a challenging task to which an exact solution cannot always be identified.
We propose a new set of assumptions that constrain possible causal relationships based on the nature of the variables.
arXiv Detail & Related papers (2021-07-22T14:23:08Z) - A One-step Approach to Covariate Shift Adaptation [82.01909503235385]
A default assumption in many machine learning scenarios is that the training and test samples are drawn from the same probability distribution.
We propose a novel one-step approach that jointly learns the predictive model and the associated weights in one optimization.
arXiv Detail & Related papers (2020-07-08T11:35:47Z) - Active Invariant Causal Prediction: Experiment Selection through
Stability [4.56877715768796]
In this work we propose a new active learning (i.e. experiment selection) framework (A-ICP) based on Invariant Causal Prediction (ICP)
For general structural causal models, we characterize the effect of interventions on so-called stable sets.
We propose several intervention selection policies for A-ICP which quickly reveal the direct causes of a response variable in the causal graph.
Empirically, we analyze the performance of the proposed policies in both population and finite-regime experiments.
arXiv Detail & Related papers (2020-06-10T07:07:27Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.