Contrastive representations of high-dimensional, structured treatments

• URL: http://arxiv.org/abs/2411.19245v1
• Date: Thu, 28 Nov 2024 16:33:31 GMT
• Title: Contrastive representations of high-dimensional, structured treatments
• Authors: Oriol Corcoll Andreu, Athanasios Vlontzos, Michael O'Riordan, Ciaran M. Gilligan-Lee,
• Abstract summary: In many real-world settings, treatments can be structured, high-dimensional objects, such as text, video, or audio. We show in this paper that using such structure can lead to biased causal effect estimation. We devise a novel contrastive approach to learn a representation of the high-dimensional treatments, and prove that it identifies underlying causal factors and discards non-causally relevant factors.
• Score: 3.174882428337822
• License:
• Abstract: Estimating causal effects is vital for decision making. In standard causal effect estimation, treatments are usually binary- or continuous-valued. However, in many important real-world settings, treatments can be structured, high-dimensional objects, such as text, video, or audio. This provides a challenge to traditional causal effect estimation. While leveraging the shared structure across different treatments can help generalize to unseen treatments at test time, we show in this paper that using such structure blindly can lead to biased causal effect estimation. We address this challenge by devising a novel contrastive approach to learn a representation of the high-dimensional treatments, and prove that it identifies underlying causal factors and discards non-causally relevant factors. We prove that this treatment representation leads to unbiased estimates of the causal effect, and empirically validate and benchmark our results on synthetic and real-world datasets.

Related papers

• Higher-Order Causal Message Passing for Experimentation with Complex Interference [6.092214762701847]
  We introduce a new class of estimators based on causal message-passing, specifically designed for settings with pervasive, unknown interference. Our estimator draws on information from the sample mean and variance of unit outcomes and treatments over time, enabling efficient use of observed data.
  arXiv  Detail & Related papers  (2024-11-01T18:00:51Z)
• The Blessings of Multiple Treatments and Outcomes in Treatment Effect Estimation [53.81860494566915]
  Existing studies leveraged proxy variables or multiple treatments to adjust for confounding bias. In many real-world scenarios, there is greater interest in studying the effects on multiple outcomes. We show that parallel studies of multiple outcomes involved in this setting can assist each other in causal identification.
  arXiv  Detail & Related papers  (2023-09-29T14:33:48Z)
• Treatment Effects in Extreme Regimes [31.069635076539367]
  We propose a new framework based on extreme value theory for estimating treatment effects in extreme regimes. We quantify these effects using variations in tail decay rates of potential outcomes in the presence and absence of treatments.
  arXiv  Detail & Related papers  (2023-06-20T17:22:23Z)
• Data-Driven Estimation of Heterogeneous Treatment Effects [15.140272661540655]
  Estimating how a treatment affects different individuals, known as heterogeneous treatment effect estimation, is an important problem in empirical sciences. We provide a survey of state-of-the-art data-driven methods for heterogeneous treatment effect estimation using machine learning.
  arXiv  Detail & Related papers  (2023-01-16T21:36:49Z)
• Interpretable Deep Causal Learning for Moderation Effects [0.0]
  We address the problem of interpretability and targeted regularization in causal machine learning models. We propose a novel deep counterfactual learning architecture for estimating individual treatment effects.
  arXiv  Detail & Related papers  (2022-06-21T11:21:09Z)
• Benchmarking Heterogeneous Treatment Effect Models through the Lens of Interpretability [82.29775890542967]
  Estimating personalized effects of treatments is a complex, yet pervasive problem. Recent developments in the machine learning literature on heterogeneous treatment effect estimation gave rise to many sophisticated, but opaque, tools. We use post-hoc feature importance methods to identify features that influence the model's predictions.
  arXiv  Detail & Related papers  (2022-06-16T17:59:05Z)
• Deep Treatment-Adaptive Network for Causal Inference [15.695128606661294]
  Causal inference is capable of estimating the treatment effect (i.e., the causal effect of treatment on the outcome) One fundamental challenge in this research is that the treatment assignment bias in observational data.
  arXiv  Detail & Related papers  (2021-12-27T04:11:23Z)
• Disentangled Counterfactual Recurrent Networks for Treatment Effect Inference over Time [71.30985926640659]
  We introduce the Disentangled Counterfactual Recurrent Network (DCRN), a sequence-to-sequence architecture that estimates treatment outcomes over time. With an architecture that is completely inspired by the causal structure of treatment influence over time, we advance forecast accuracy and disease understanding. We demonstrate that DCRN outperforms current state-of-the-art methods in forecasting treatment responses, on both real and simulated data.
  arXiv  Detail & Related papers  (2021-12-07T16:40:28Z)
• SurvITE: Learning Heterogeneous Treatment Effects from Time-to-Event Data [83.50281440043241]
  We study the problem of inferring heterogeneous treatment effects from time-to-event data. We propose a novel deep learning method for treatment-specific hazard estimation based on balancing representations.
  arXiv  Detail & Related papers  (2021-10-26T20:13:17Z)
• On Inductive Biases for Heterogeneous Treatment Effect Estimation [91.3755431537592]
  We investigate how to exploit structural similarities of an individual's potential outcomes (POs) under different treatments. We compare three end-to-end learning strategies to overcome this problem.
  arXiv  Detail & Related papers  (2021-06-07T16:30:46Z)
• Learning Decomposed Representation for Counterfactual Inference [53.36586760485262]
  The fundamental problem in treatment effect estimation from observational data is confounder identification and balancing. Most of the previous methods realized confounder balancing by treating all observed pre-treatment variables as confounders, ignoring further identifying confounders and non-confounders. We propose a synergistic learning framework to 1) identify confounders by learning representations of both confounders and non-confounders, 2) balance confounder with sample re-weighting technique, and simultaneously 3) estimate the treatment effect in observational studies via counterfactual inference.
  arXiv  Detail & Related papers  (2020-06-12T09:50:42Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.