A Reinforcement Learning Framework for Dynamic Mediation Analysis

• URL: http://arxiv.org/abs/2301.13348v2
• Date: Sun, 3 Sep 2023 02:42:47 GMT
• Title: A Reinforcement Learning Framework for Dynamic Mediation Analysis
• Authors: Lin Ge, Jitao Wang, Chengchun Shi, Zhenke Wu, Rui Song
• Abstract summary: We propose a reinforcement learning framework to evaluate dynamic mediation effects in settings with infinite horizons. We decompose the average treatment effect into an immediate direct effect, an immediate mediation effect, a delayed direct effect, and a delayed mediation effect. We develop robust and semi-parametrically efficient estimators under the RL framework to infer these causal effects.
• Score: 16.284199152492487
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Mediation analysis learns the causal effect transmitted via mediator variables between treatments and outcomes and receives increasing attention in various scientific domains to elucidate causal relations. Most existing works focus on point-exposure studies where each subject only receives one treatment at a single time point. However, there are a number of applications (e.g., mobile health) where the treatments are sequentially assigned over time and the dynamic mediation effects are of primary interest. Proposing a reinforcement learning (RL) framework, we are the first to evaluate dynamic mediation effects in settings with infinite horizons. We decompose the average treatment effect into an immediate direct effect, an immediate mediation effect, a delayed direct effect, and a delayed mediation effect. Upon the identification of each effect component, we further develop robust and semi-parametrically efficient estimators under the RL framework to infer these causal effects. The superior performance of the proposed method is demonstrated through extensive numerical studies, theoretical results, and an analysis of a mobile health dataset.

Related papers

• Higher-Order Causal Message Passing for Experimentation with Complex Interference [6.092214762701847]
  We introduce a new class of estimators based on causal message-passing, specifically designed for settings with pervasive, unknown interference. Our estimator draws on information from the sample mean and variance of unit outcomes and treatments over time, enabling efficient use of observed data.
  arXiv  Detail & Related papers  (2024-11-01T18:00:51Z)
• Causal Message Passing for Experiments with Unknown and General Network Interference [5.294604210205507]
  We introduce a new framework to accommodate complex and unknown network interference. Our framework, termed causal message-passing, is grounded in high-dimensional approximate message passing methodology. We demonstrate the effectiveness of this approach across five numerical scenarios.
  arXiv  Detail & Related papers  (2023-11-14T17:31:50Z)
• The Blessings of Multiple Treatments and Outcomes in Treatment Effect Estimation [53.81860494566915]
  Existing studies leveraged proxy variables or multiple treatments to adjust for confounding bias. In many real-world scenarios, there is greater interest in studying the effects on multiple outcomes. We show that parallel studies of multiple outcomes involved in this setting can assist each other in causal identification.
  arXiv  Detail & Related papers  (2023-09-29T14:33:48Z)
• Temporal Causal Mediation through a Point Process: Direct and Indirect Effects of Healthcare Interventions [5.107614397012659]
  Causal mediation analysis lets us distinguish between direct and indirect effects of the intervention. Existing approaches to dynamic causal mediation analysis are limited to regular measurement intervals. We propose a non-parametric mediator--outcome model where the mediator is assumed to be a temporal point process that interacts with the outcome process.
  arXiv  Detail & Related papers  (2023-06-16T07:23:28Z)
• Causal Mediation Analysis with Multi-dimensional and Indirectly Observed Mediators [22.68115322836635]
  Causal mediation analysis is a powerful method to dissect the total effect of a treatment into direct and mediated effects. Most CMA methods assume that the mediator is one-dimensional and observable, which oversimplifies real-world scenarios. We introduce a CMA framework that can handle complex and indirectly observed mediators based on the identifiable variational autoencoder (iVAE) architecture.
  arXiv  Detail & Related papers  (2023-06-13T17:22:59Z)
• Zero-shot causal learning [64.9368337542558]
  CaML is a causal meta-learning framework which formulates the personalized prediction of each intervention's effect as a task. We show that CaML is able to predict the personalized effects of novel interventions that do not exist at the time of training.
  arXiv  Detail & Related papers  (2023-01-28T20:14:11Z)
• TCFimt: Temporal Counterfactual Forecasting from Individual Multiple Treatment Perspective [50.675845725806724]
  We propose a comprehensive framework of temporal counterfactual forecasting from an individual multiple treatment perspective (TCFimt) TCFimt constructs adversarial tasks in a seq2seq framework to alleviate selection and time-varying bias and designs a contrastive learning-based block to decouple a mixed treatment effect into separated main treatment effects and causal interactions. The proposed method shows satisfactory performance in predicting future outcomes with specific treatments and in choosing optimal treatment type and timing than state-of-the-art methods.
  arXiv  Detail & Related papers  (2022-12-17T15:01:05Z)
• Disentangled Counterfactual Recurrent Networks for Treatment Effect Inference over Time [71.30985926640659]
  We introduce the Disentangled Counterfactual Recurrent Network (DCRN), a sequence-to-sequence architecture that estimates treatment outcomes over time. With an architecture that is completely inspired by the causal structure of treatment influence over time, we advance forecast accuracy and disease understanding. We demonstrate that DCRN outperforms current state-of-the-art methods in forecasting treatment responses, on both real and simulated data.
  arXiv  Detail & Related papers  (2021-12-07T16:40:28Z)
• SurvITE: Learning Heterogeneous Treatment Effects from Time-to-Event Data [83.50281440043241]
  We study the problem of inferring heterogeneous treatment effects from time-to-event data. We propose a novel deep learning method for treatment-specific hazard estimation based on balancing representations.
  arXiv  Detail & Related papers  (2021-10-26T20:13:17Z)
• Generalization Bounds and Representation Learning for Estimation of Potential Outcomes and Causal Effects [61.03579766573421]
  We study estimation of individual-level causal effects, such as a single patient's response to alternative medication. We devise representation learning algorithms that minimize our bound, by regularizing the representation's induced treatment group distance. We extend these algorithms to simultaneously learn a weighted representation to further reduce treatment group distances.
  arXiv  Detail & Related papers  (2020-01-21T10:16:33Z)
• Nonparametric inference for interventional effects with multiple mediators [0.0]
  We provide theory that allows for more flexible, possibly machine learning-based, estimation techniques. We demonstrate multiple robustness properties of the proposed estimators. Our work thus provides a means of leveraging modern statistical learning techniques in estimation of interventional mediation effects.
  arXiv  Detail & Related papers  (2020-01-16T19:05:00Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.