Auto IV: Counterfactual Prediction via Automatic Instrumental Variable Decomposition

• URL: http://arxiv.org/abs/2107.05884v1
• Date: Tue, 13 Jul 2021 07:30:21 GMT
• Title: Auto IV: Counterfactual Prediction via Automatic Instrumental Variable Decomposition
• Authors: Junkun Yuan, Anpeng Wu, Kun Kuang, Bo Li, Runze Wu, Fei Wu, Lanfen Lin
• Abstract summary: Instrumental variables (IVs) play an important role in causal inference with unobserved confounders. Existing IV-based counterfactual prediction methods need well-predefined IVs. We propose a novel algorithm to automatically generate representations serving the role of IVs from observed variables.
• Score: 21.90157954233519
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Instrumental variables (IVs), sources of treatment randomization that are conditionally independent of the outcome, play an important role in causal inference with unobserved confounders. However, the existing IV-based counterfactual prediction methods need well-predefined IVs, while it's an art rather than science to find valid IVs in many real-world scenes. Moreover, the predefined hand-made IVs could be weak or erroneous by violating the conditions of valid IVs. These thorny facts hinder the application of the IV-based counterfactual prediction methods. In this paper, we propose a novel Automatic Instrumental Variable decomposition (AutoIV) algorithm to automatically generate representations serving the role of IVs from observed variables (IV candidates). Specifically, we let the learned IV representations satisfy the relevance condition with the treatment and exclusion condition with the outcome via mutual information maximization and minimization constraints, respectively. We also learn confounder representations by encouraging them to be relevant to both the treatment and the outcome. The IV and confounder representations compete for the information with their constraints in an adversarial game, which allows us to get valid IV representations for IV-based counterfactual prediction. Extensive experiments demonstrate that our method generates valid IV representations for accurate IV-based counterfactual prediction.

Related papers

• Estimating Heterogeneous Treatment Effects by Combining Weak Instruments and Observational Data [44.31792000298105]
  Accurately predicting conditional average treatment effects (CATEs) is crucial in personalized medicine and digital platform analytics. We develop a novel approach to combine IV and observational data to enable reliable CATE estimation.
  arXiv  Detail & Related papers  (2024-06-10T16:40:55Z)
• Geometry-Aware Instrumental Variable Regression [56.16884466478886]
  We propose a transport-based IV estimator that takes into account the geometry of the data manifold through data-derivative information. We provide a simple plug-and-play implementation of our method that performs on par with related estimators in standard settings.
  arXiv  Detail & Related papers  (2024-05-19T17:49:33Z)
• Regularized DeepIV with Model Selection [72.17508967124081]
  Regularized DeepIV (RDIV) regression can converge to the least-norm IV solution. Our method matches the current state-of-the-art convergence rate.
  arXiv  Detail & Related papers  (2024-03-07T05:38:56Z)
• Learning Conditional Instrumental Variable Representation for Causal Effect Estimation [20.546911588972737]
  We propose a novel method, named DVAE.CIV, for learning and disentangling the representations of CIV and the conditioning set for causal effect estimation.
  arXiv  Detail & Related papers  (2023-06-21T02:27:15Z)
• Instrumental Variable Learning for Chest X-ray Classification [52.68170685918908]
  We propose an interpretable instrumental variable (IV) learning framework to eliminate the spurious association and obtain accurate causal representation. Our approach's performance is demonstrated using the MIMIC-CXR, NIH ChestX-ray 14, and CheXpert datasets.
  arXiv  Detail & Related papers  (2023-05-20T03:12:23Z)
• Instrumental Variables in Causal Inference and Machine Learning: A Survey [26.678154268037595]
  Causal inference is a process of using assumptions to draw conclusions about the causal relationships between variables based on data. A growing literature in both causal inference and machine learning proposes to use Instrumental Variables (IV) This paper serves as the first effort to systematically and comprehensively introduce and discuss the IV methods and their applications in both causal inference and machine learning.
  arXiv  Detail & Related papers  (2022-12-12T08:59:04Z)
• Causal Inference with Conditional Instruments using Deep Generative Models [21.771832598942677]
  A standard IV is expected to be related to the treatment variable and independent of all other variables in the system. conditional IV (CIV) method has been proposed to allow a variable to be an instrument conditioning on a set of variables. We propose to learn the representations of a CIV and its conditioning set from data with latent confounders for average causal effect estimation.
  arXiv  Detail & Related papers  (2022-11-29T14:31:54Z)
• VL4Pose: Active Learning Through Out-Of-Distribution Detection For Pose Estimation [79.50280069412847]
  We introduce VL4Pose, a first principles approach for active learning through out-of-distribution detection. Our solution involves modelling the pose through a simple parametric Bayesian network trained via maximum likelihood estimation. We perform qualitative and quantitative experiments on three datasets: MPII, LSP and ICVL, spanning human and hand pose estimation.
  arXiv  Detail & Related papers  (2022-10-12T09:03:55Z)
• Discovering Ancestral Instrumental Variables for Causal Inference from Observational Data [0.0]
  Instrumental variable (IV) is a powerful approach to inferring the causal effect of a treatment on an outcome of interest from observational data. Existing IV methods require that an IV is selected and justified with domain knowledge. In this paper, we study and design a data-driven algorithm to discover valid IVs from data under mild assumptions.
  arXiv  Detail & Related papers  (2022-06-04T07:48:13Z)
• Ancestral Instrument Method for Causal Inference without Complete Knowledge [0.0]
  Unobserved confounding is the main obstacle to causal effect estimation from observational data. Conditional IVs have been proposed to relax the requirement of standard IVs by conditioning on a set of observed variables. We develop an algorithm for unbiased causal effect estimation with a given ancestral IV and observational data.
  arXiv  Detail & Related papers  (2022-01-11T07:02:16Z)
• Instrumental Variable Value Iteration for Causal Offline Reinforcement Learning [107.70165026669308]
  In offline reinforcement learning (RL) an optimal policy is learned solely from a priori collected observational data. We study a confounded Markov decision process where the transition dynamics admit an additive nonlinear functional form. We propose a provably efficient IV-aided Value Iteration (IVVI) algorithm based on a primal-dual reformulation of the conditional moment restriction.
  arXiv  Detail & Related papers  (2021-02-19T13:01:40Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.