Dynamic Regularized CBDT: Variance-Calibrated Causal Boosting for Interpretable Heterogeneous Treatment Effects

• URL: http://arxiv.org/abs/2504.13733v1
• Date: Fri, 18 Apr 2025 15:02:06 GMT
• Title: Dynamic Regularized CBDT: Variance-Calibrated Causal Boosting for Interpretable Heterogeneous Treatment Effects
• Authors: Yichen Liu,
• Abstract summary: We propose Dynamic Regularized Causal Boosted Decision Trees (CBDT)<n>CBDT integrates variance regularization and average treatment effect calibration into the loss function of gradient boosted decision trees.<n>We show thatCBDT significantly improves estimation accuracy while maintaining reliable coverage of true treatment effects.
• Score: 3.390322732093844
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Heterogeneous treatment effect estimation in high-stakes applications demands models that simultaneously optimize precision, interpretability, and calibration. Many existing tree-based causal inference techniques, however, exhibit high estimation errors when applied to observational data because they struggle to capture complex interactions among factors and rely on static regularization schemes. In this work, we propose Dynamic Regularized Causal Boosted Decision Trees (CBDT), a novel framework that integrates variance regularization and average treatment effect calibration into the loss function of gradient boosted decision trees. Our approach dynamically updates the regularization parameters using gradient statistics to better balance the bias-variance tradeoff. Extensive experiments on standard benchmark datasets and real-world clinical data demonstrate that the proposed method significantly improves estimation accuracy while maintaining reliable coverage of true treatment effects. In an intensive care unit patient triage study, the method successfully identified clinically actionable rules and achieved high accuracy in treatment effect estimation. The results validate that dynamic regularization can effectively tighten error bounds and enhance both predictive performance and model interpretability.

Related papers

• C-XGBoost: A tree boosting model for causal effect estimation [8.246161706153805]
  Causal effect estimation aims at estimating the Average Treatment Effect as well as the Conditional Average Treatment Effect of a treatment to an outcome from the available data. We propose a new causal inference model, named C-XGBoost, for the prediction of potential outcomes.
  arXiv  Detail & Related papers  (2024-03-31T17:43:37Z)
• Efficient adjustment for complex covariates: Gaining efficiency with DOPE [56.537164957672715]
  We propose a framework that accommodates adjustment for any subset of information expressed by the covariates. Based on our theoretical results, we propose the Debiased Outcome-adapted Propensity Estorimator (DOPE) for efficient estimation of the average treatment effect (ATE) Our results show that the DOPE provides an efficient and robust methodology for ATE estimation in various observational settings.
  arXiv  Detail & Related papers  (2024-02-20T13:02:51Z)
• Causal Dynamic Variational Autoencoder for Counterfactual Regression in Longitudinal Data [3.3523758554338734]
  Estimating treatment effects over time is relevant in many real-world applications, such as precision medicine, epidemiology, economy, and marketing.<n>We take a different perspective by assuming unobserved risk factors, i.e., adjustment variables that affect only the sequence of outcomes.<n>We address the challenges posed by time-varying effects and unobserved adjustment variables.
  arXiv  Detail & Related papers  (2023-10-16T16:32:35Z)
• B-Learner: Quasi-Oracle Bounds on Heterogeneous Causal Effects Under Hidden Confounding [51.74479522965712]
  We propose a meta-learner called the B-Learner, which can efficiently learn sharp bounds on the CATE function under limits on hidden confounding. We prove its estimates are valid, sharp, efficient, and have a quasi-oracle property with respect to the constituent estimators under more general conditions than existing methods.
  arXiv  Detail & Related papers  (2023-04-20T18:07:19Z)
• Benchmarking Heterogeneous Treatment Effect Models through the Lens of Interpretability [82.29775890542967]
  Estimating personalized effects of treatments is a complex, yet pervasive problem. Recent developments in the machine learning literature on heterogeneous treatment effect estimation gave rise to many sophisticated, but opaque, tools. We use post-hoc feature importance methods to identify features that influence the model's predictions.
  arXiv  Detail & Related papers  (2022-06-16T17:59:05Z)
• Covariate-Balancing-Aware Interpretable Deep Learning models for Treatment Effect Estimation [15.465045049754336]
  We propose an upper bound for the bias of average treatment estimation under the strong ignorability assumption. We implement this upper bound as an objective function being minimized by leveraging a novel additive neural network architecture. The proposed method is illustrated by re-examining the benchmark datasets for causal inference, and it outperforms the state-of-art.
  arXiv  Detail & Related papers  (2022-03-07T07:42:40Z)
• Assessment of Treatment Effect Estimators for Heavy-Tailed Data [70.72363097550483]
  A central obstacle in the objective assessment of treatment effect (TE) estimators in randomized control trials (RCTs) is the lack of ground truth (or validation set) to test their performance. We provide a novel cross-validation-like methodology to address this challenge. We evaluate our methodology across 709 RCTs implemented in the Amazon supply chain.
  arXiv  Detail & Related papers  (2021-12-14T17:53:01Z)
• Causal Effect Variational Autoencoder with Uniform Treatment [50.895390968371665]
  Causal effect variational autoencoder (CEVAE) are trained to predict the outcome given observational treatment data. Uniform treatment variational autoencoders (UTVAE) are trained with uniform treatment distribution using importance sampling.
  arXiv  Detail & Related papers  (2021-11-16T17:40:57Z)
• Efficient Causal Inference from Combined Observational and Interventional Data through Causal Reductions [68.6505592770171]
  Unobserved confounding is one of the main challenges when estimating causal effects. We propose a novel causal reduction method that replaces an arbitrary number of possibly high-dimensional latent confounders. We propose a learning algorithm to estimate the parameterized reduced model jointly from observational and interventional data.
  arXiv  Detail & Related papers  (2021-03-08T14:29:07Z)
• Estimating heterogeneous survival treatment effect in observational data using machine learning [9.951103976634407]
  Methods for estimating heterogeneous treatment effect in observational data have largely focused on continuous or binary outcomes. Using flexible machine learning methods in the counterfactual framework is a promising approach to address challenges due to complex individual characteristics.
  arXiv  Detail & Related papers  (2020-08-17T01:02:14Z)
• Estimating Treatment Effect under Additive Hazards Models with High-dimensional Covariates [0.3481985817302898]
  We propose a new score method for treatment effect estimation and inference.<n>We provide valid inference for the conditional treatment effect under the high-dimensional additive hazards model.<n>We apply our methods to study the treatment effect of radical prostatectomy versus conservative management for prostate cancer patients.
  arXiv  Detail & Related papers  (2019-06-29T22:15:59Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.