COSTAR: Improved Temporal Counterfactual Estimation with Self-Supervised Learning

• URL: http://arxiv.org/abs/2311.00886v2
• Date: Mon, 12 Feb 2024 07:38:58 GMT
• Title: COSTAR: Improved Temporal Counterfactual Estimation with Self-Supervised Learning
• Authors: Chuizheng Meng, Yihe Dong, Sercan \"O. Ar{\i}k, Yan Liu, Tomas Pfister
• Abstract summary: We introduce Counterfactual Self-Supervised Transformer (COSTAR), a novel approach that integrates self-supervised learning for improved historical representations. COSTAR yields superior performance in estimation accuracy and generalization to out-of-distribution data compared to existing models.
• Score: 35.119957381211236
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Estimation of temporal counterfactual outcomes from observed history is crucial for decision-making in many domains such as healthcare and e-commerce, particularly when randomized controlled trials (RCTs) suffer from high cost or impracticality. For real-world datasets, modeling time-dependent confounders is challenging due to complex dynamics, long-range dependencies and both past treatments and covariates affecting the future outcomes. In this paper, we introduce Counterfactual Self-Supervised Transformer (COSTAR), a novel approach that integrates self-supervised learning for improved historical representations. We propose a component-wise contrastive loss tailored for temporal treatment outcome observations and explain its effectiveness from the view of unsupervised domain adaptation. COSTAR yields superior performance in estimation accuracy and generalization to out-of-distribution data compared to existing models, as validated by empirical results on both synthetic and real-world datasets.

Related papers

• Deep State-Space Generative Model For Correlated Time-to-Event Predictions [54.3637600983898]
  We propose a deep latent state-space generative model to capture the interactions among different types of correlated clinical events. Our method also uncovers meaningful insights about the latent correlations among mortality and different types of organ failures.
  arXiv  Detail & Related papers  (2024-07-28T02:42:36Z)
• Causal Contrastive Learning for Counterfactual Regression Over Time [3.3523758554338734]
  This paper introduces a unique approach to counterfactual regression over time, emphasizing long-term predictions. Distinguishing itself from existing models like Causal Transformer, our approach highlights the efficacy of employing RNNs for long-term forecasting. Our method achieves state-of-the-art counterfactual estimation results using both synthetic and real-world data.
  arXiv  Detail & Related papers  (2024-06-01T19:07:25Z)
• Estimating Treatment Effects from Irregular Time Series Observations with Hidden Confounders [15.41689729746877]
  Real-world time series can include large-scale, irregular, and intermittent time series observations. existence of hidden confounders can lead to biased treatment estimates. In continuous time settings with irregular samples, it is challenging to directly handle the dynamics of causality.
  arXiv  Detail & Related papers  (2023-03-04T04:55:34Z)
• Estimating Treatment Effects in Continuous Time with Hidden Confounders [8.292249583600809]
  Estimating treatment effects in the longitudinal setting in the presence of hidden confounders remains an extremely challenging problem. Recent advancements in neural differential equations to build a latent factor model using a controlled differential equation and Lipschitz constrained convolutional operation. Experiments on both synthetic and real-world datasets highlight the promise of continuous time methods for estimating treatment effects in the presence of hidden confounders.
  arXiv  Detail & Related papers  (2023-02-19T00:28:20Z)
• Continuous-Time Modeling of Counterfactual Outcomes Using Neural Controlled Differential Equations [84.42837346400151]
  Estimating counterfactual outcomes over time has the potential to unlock personalized healthcare. Existing causal inference approaches consider regular, discrete-time intervals between observations and treatment decisions. We propose a controllable simulation environment based on a model of tumor growth for a range of scenarios.
  arXiv  Detail & Related papers  (2022-06-16T17:15:15Z)
• Disentangled Counterfactual Recurrent Networks for Treatment Effect Inference over Time [71.30985926640659]
  We introduce the Disentangled Counterfactual Recurrent Network (DCRN), a sequence-to-sequence architecture that estimates treatment outcomes over time. With an architecture that is completely inspired by the causal structure of treatment influence over time, we advance forecast accuracy and disease understanding. We demonstrate that DCRN outperforms current state-of-the-art methods in forecasting treatment responses, on both real and simulated data.
  arXiv  Detail & Related papers  (2021-12-07T16:40:28Z)
• Deep Bayesian Estimation for Dynamic Treatment Regimes with a Long Follow-up Time [28.11470886127216]
  Causal effect estimation for dynamic treatment regimes (DTRs) contributes to sequential decision making. We combine outcome regression models with treatment models for high dimensional features using uncensored subjects that are small in sample size. Also, the developed deep Bayesian models can model uncertainty and output the prediction variance which is essential for the safety-aware applications, such as self-driving cars and medical treatment design.
  arXiv  Detail & Related papers  (2021-09-20T13:21:39Z)
• DeepRite: Deep Recurrent Inverse TreatmEnt Weighting for Adjusting Time-varying Confounding in Modern Longitudinal Observational Data [68.29870617697532]
  We propose Deep Recurrent Inverse TreatmEnt weighting (DeepRite) for time-varying confounding in longitudinal data. DeepRite is shown to recover the ground truth from synthetic data, and estimate unbiased treatment effects from real data.
  arXiv  Detail & Related papers  (2020-10-28T15:05:08Z)
• Estimating Individual Treatment Effects with Time-Varying Confounders [9.784193264717098]
  Estimating individual treatment effect (ITE) from observational data is meaningful and practical in healthcare. Existing work mainly relies on the strong ignorability assumption that no hidden confounders exist. We propose Deep Sequential Weighting (DSW) for estimating ITE with time-varying confounders.
  arXiv  Detail & Related papers  (2020-08-27T02:21:56Z)
• Decomposed Adversarial Learned Inference [118.27187231452852]
  We propose a novel approach, Decomposed Adversarial Learned Inference (DALI) DALI explicitly matches prior and conditional distributions in both data and code spaces. We validate the effectiveness of DALI on the MNIST, CIFAR-10, and CelebA datasets.
  arXiv  Detail & Related papers  (2020-04-21T20:00:35Z)
• Estimating Counterfactual Treatment Outcomes over Time Through Adversarially Balanced Representations [114.16762407465427]
  We introduce the Counterfactual Recurrent Network (CRN) to estimate treatment effects over time. CRN uses domain adversarial training to build balancing representations of the patient history. We show how our model achieves lower error in estimating counterfactuals and in choosing the correct treatment and timing of treatment.
  arXiv  Detail & Related papers  (2020-02-10T20:47:36Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.