Disentangled Representation Learning for Causal Inference with Instruments
- URL: http://arxiv.org/abs/2412.04641v1
- Date: Thu, 05 Dec 2024 22:18:48 GMT
- Title: Disentangled Representation Learning for Causal Inference with Instruments
- Authors: Debo Cheng, Jiuyong Li, Lin Liu, Ziqi Xu, Weijia Zhang, Jixue Liu, Thuc Duy Le,
- Abstract summary: Existing IV based estimators need a known IV or other strong assumptions, such as the existence of two or more IVs in the system.
In this paper, we consider a relaxed requirement, which assumes there is an IV proxy in the system without knowing which variable is the proxy.
We propose a Variational AutoEncoder (VAE) based disentangled representation learning method to learn an IV representation from a dataset with latent confounders.
- Score: 31.67220687652054
- License:
- Abstract: Latent confounders are a fundamental challenge for inferring causal effects from observational data. The instrumental variable (IV) approach is a practical way to address this challenge. Existing IV based estimators need a known IV or other strong assumptions, such as the existence of two or more IVs in the system, which limits the application of the IV approach. In this paper, we consider a relaxed requirement, which assumes there is an IV proxy in the system without knowing which variable is the proxy. We propose a Variational AutoEncoder (VAE) based disentangled representation learning method to learn an IV representation from a dataset with latent confounders and then utilise the IV representation to obtain an unbiased estimation of the causal effect from the data. Extensive experiments on synthetic and real-world data have demonstrated that the proposed algorithm outperforms the existing IV based estimators and VAE-based estimators.
Related papers
- Optimality and Adaptivity of Deep Neural Features for Instrumental Variable Regression [57.40108516085593]
Deep feature instrumental variable (DFIV) regression is a nonparametric approach to IV regression using data-adaptive features learned by deep neural networks.
We prove that the DFIV algorithm achieves the minimax optimal learning rate when the target structural function lies in a Besov space.
arXiv Detail & Related papers (2025-01-09T01:22:22Z) - Geometry-Aware Instrumental Variable Regression [56.16884466478886]
We propose a transport-based IV estimator that takes into account the geometry of the data manifold through data-derivative information.
We provide a simple plug-and-play implementation of our method that performs on par with related estimators in standard settings.
arXiv Detail & Related papers (2024-05-19T17:49:33Z) - Regularized DeepIV with Model Selection [72.17508967124081]
Regularized DeepIV (RDIV) regression can converge to the least-norm IV solution.
Our method matches the current state-of-the-art convergence rate.
arXiv Detail & Related papers (2024-03-07T05:38:56Z) - Learning Conditional Instrumental Variable Representation for Causal
Effect Estimation [20.546911588972737]
We propose a novel method, named DVAE.CIV, for learning and disentangling the representations of CIV and the conditioning set for causal effect estimation.
arXiv Detail & Related papers (2023-06-21T02:27:15Z) - Instrumental Variable Learning for Chest X-ray Classification [52.68170685918908]
We propose an interpretable instrumental variable (IV) learning framework to eliminate the spurious association and obtain accurate causal representation.
Our approach's performance is demonstrated using the MIMIC-CXR, NIH ChestX-ray 14, and CheXpert datasets.
arXiv Detail & Related papers (2023-05-20T03:12:23Z) - Instrumental Variables in Causal Inference and Machine Learning: A
Survey [26.678154268037595]
Causal inference is a process of using assumptions to draw conclusions about the causal relationships between variables based on data.
A growing literature in both causal inference and machine learning proposes to use Instrumental Variables (IV)
This paper serves as the first effort to systematically and comprehensively introduce and discuss the IV methods and their applications in both causal inference and machine learning.
arXiv Detail & Related papers (2022-12-12T08:59:04Z) - Causal Inference with Conditional Instruments using Deep Generative
Models [21.771832598942677]
A standard IV is expected to be related to the treatment variable and independent of all other variables in the system.
conditional IV (CIV) method has been proposed to allow a variable to be an instrument conditioning on a set of variables.
We propose to learn the representations of a CIV and its conditioning set from data with latent confounders for average causal effect estimation.
arXiv Detail & Related papers (2022-11-29T14:31:54Z) - Discovering Ancestral Instrumental Variables for Causal Inference from
Observational Data [0.0]
Instrumental variable (IV) is a powerful approach to inferring the causal effect of a treatment on an outcome of interest from observational data.
Existing IV methods require that an IV is selected and justified with domain knowledge.
In this paper, we study and design a data-driven algorithm to discover valid IVs from data under mild assumptions.
arXiv Detail & Related papers (2022-06-04T07:48:13Z) - Ancestral Instrument Method for Causal Inference without Complete
Knowledge [0.0]
Unobserved confounding is the main obstacle to causal effect estimation from observational data.
Conditional IVs have been proposed to relax the requirement of standard IVs by conditioning on a set of observed variables.
We develop an algorithm for unbiased causal effect estimation with a given ancestral IV and observational data.
arXiv Detail & Related papers (2022-01-11T07:02:16Z) - Instrumental Variable Value Iteration for Causal Offline Reinforcement Learning [107.70165026669308]
In offline reinforcement learning (RL) an optimal policy is learned solely from a priori collected observational data.
We study a confounded Markov decision process where the transition dynamics admit an additive nonlinear functional form.
We propose a provably efficient IV-aided Value Iteration (IVVI) algorithm based on a primal-dual reformulation of the conditional moment restriction.
arXiv Detail & Related papers (2021-02-19T13:01:40Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.