Conditional Instrumental Variable Regression with Representation Learning for Causal Inference

• URL: http://arxiv.org/abs/2310.01865v1
• Date: Tue, 3 Oct 2023 08:08:09 GMT
• Title: Conditional Instrumental Variable Regression with Representation Learning for Causal Inference
• Authors: Debo Cheng, Ziqi Xu, Jiuyong Li, Lin Liu, Jixue Liu and Thuc Duy Le (UniSA STEM, University of South Australia, Australia)
• Abstract summary: This paper studies the challenging problem of estimating causal effects from observational data, in the presence of unobserved confounders. We propose a non-linear regression with Confounding Balancing Representation Learning, CBRL.CIV, for jointly eliminating the confounding bias from unobserved confounders and balancing the observed confounders.
• Score: 20.454641170078812
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: This paper studies the challenging problem of estimating causal effects from observational data, in the presence of unobserved confounders. The two-stage least square (TSLS) method and its variants with a standard instrumental variable (IV) are commonly used to eliminate confounding bias, including the bias caused by unobserved confounders, but they rely on the linearity assumption. Besides, the strict condition of unconfounded instruments posed on a standard IV is too strong to be practical. To address these challenging and practical problems of the standard IV method (linearity assumption and the strict condition), in this paper, we use a conditional IV (CIV) to relax the unconfounded instrument condition of standard IV and propose a non-linear CIV regression with Confounding Balancing Representation Learning, CBRL.CIV, for jointly eliminating the confounding bias from unobserved confounders and balancing the observed confounders, without the linearity assumption. We theoretically demonstrate the soundness of CBRL.CIV. Extensive experiments on synthetic and two real-world datasets show the competitive performance of CBRL.CIV against state-of-the-art IV-based estimators and superiority in dealing with the non-linear situation.

Related papers

• Estimating Heterogeneous Treatment Effects by Combining Weak Instruments and Observational Data [44.31792000298105]
  Accurately predicting conditional average treatment effects (CATEs) is crucial in personalized medicine and digital platform analytics. We develop a novel approach to combine IV and observational data to enable reliable CATE estimation.
  arXiv  Detail & Related papers  (2024-06-10T16:40:55Z)
• Geometry-Aware Instrumental Variable Regression [56.16884466478886]
  We propose a transport-based IV estimator that takes into account the geometry of the data manifold through data-derivative information. We provide a simple plug-and-play implementation of our method that performs on par with related estimators in standard settings.
  arXiv  Detail & Related papers  (2024-05-19T17:49:33Z)
• Regularized DeepIV with Model Selection [72.17508967124081]
  Regularized DeepIV (RDIV) regression can converge to the least-norm IV solution. Our method matches the current state-of-the-art convergence rate.
  arXiv  Detail & Related papers  (2024-03-07T05:38:56Z)
• Learning Conditional Instrumental Variable Representation for Causal Effect Estimation [20.546911588972737]
  We propose a novel method, named DVAE.CIV, for learning and disentangling the representations of CIV and the conditioning set for causal effect estimation.
  arXiv  Detail & Related papers  (2023-06-21T02:27:15Z)
• Causal Inference with Conditional Instruments using Deep Generative Models [21.771832598942677]
  A standard IV is expected to be related to the treatment variable and independent of all other variables in the system. conditional IV (CIV) method has been proposed to allow a variable to be an instrument conditioning on a set of variables. We propose to learn the representations of a CIV and its conditioning set from data with latent confounders for average causal effect estimation.
  arXiv  Detail & Related papers  (2022-11-29T14:31:54Z)
• Confounder Balancing for Instrumental Variable Regression with Latent Variable [29.288045682505615]
  This paper studies the confounding effects from the unmeasured confounders and the imbalance of observed confounders in IV regression. We propose a Confounder Balanced IV Regression (CB-IV) algorithm to remove the bias from the unmeasured confounders and the imbalance of observed confounders.
  arXiv  Detail & Related papers  (2022-11-18T03:13:53Z)
• Causal Inference via Nonlinear Variable Decorrelation for Healthcare Applications [60.26261850082012]
  We introduce a novel method with a variable decorrelation regularizer to handle both linear and nonlinear confounding. We employ association rules as new representations using association rule mining based on the original features to increase model interpretability.
  arXiv  Detail & Related papers  (2022-09-29T17:44:14Z)
• On the instrumental variable estimation with many weak and invalid instruments [1.837552179215311]
  We discuss the fundamental issue of computation in instrumental variable (IV) models with unknown IV validity. With the assumption of the "sparsest properties", which is is equivalent to a sparse penalty structure, we investigate and prove the advantages of a surrogate-step identification method. We propose a surrogate-step selection estimation method that aligns with the sparse identification condition.
  arXiv  Detail & Related papers  (2022-07-07T01:31:34Z)
• Ancestral Instrument Method for Causal Inference without Complete Knowledge [0.0]
  Unobserved confounding is the main obstacle to causal effect estimation from observational data. Conditional IVs have been proposed to relax the requirement of standard IVs by conditioning on a set of observed variables. We develop an algorithm for unbiased causal effect estimation with a given ancestral IV and observational data.
  arXiv  Detail & Related papers  (2022-01-11T07:02:16Z)
• Instrumental Variable Value Iteration for Causal Offline Reinforcement Learning [107.70165026669308]
  In offline reinforcement learning (RL) an optimal policy is learned solely from a priori collected observational data. We study a confounded Markov decision process where the transition dynamics admit an additive nonlinear functional form. We propose a provably efficient IV-aided Value Iteration (IVVI) algorithm based on a primal-dual reformulation of the conditional moment restriction.
  arXiv  Detail & Related papers  (2021-02-19T13:01:40Z)
• On Disentangled Representations Learned From Correlated Data [59.41587388303554]
  We bridge the gap to real-world scenarios by analyzing the behavior of the most prominent disentanglement approaches on correlated data. We show that systematically induced correlations in the dataset are being learned and reflected in the latent representations. We also demonstrate how to resolve these latent correlations, either using weak supervision during training or by post-hoc correcting a pre-trained model with a small number of labels.
  arXiv  Detail & Related papers  (2020-06-14T12:47:34Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.