Measuring Variable Importance in Heterogeneous Treatment Effects with Confidence

• URL: http://arxiv.org/abs/2408.13002v2
• Date: Fri, 07 Feb 2025 17:35:23 GMT
• Title: Measuring Variable Importance in Heterogeneous Treatment Effects with Confidence
• Authors: Joseph Paillard, Angel Reyero Lobo, Vitaliy Kolodyazhniy, Bertrand Thirion, Denis A. Engemann,
• Abstract summary: Causal machine learning holds promise for estimating individual treatment effects from complex data. We propose PermuCATE, an algorithm based on the Conditional Permutation Importance (CPI) method. We empirically demonstrate the benefits of PermuCATE in simulated and real-world health datasets.
• Score: 33.12963161545068
• License:
• Abstract: Causal machine learning (ML) holds promise for estimating individual treatment effects from complex data. For successful real-world applications using machine learning methods, it is of paramount importance to obtain reliable insights into which variables drive heterogeneity in the response to treatment. We propose PermuCATE, an algorithm based on the Conditional Permutation Importance (CPI) method, for statistically rigorous global variable importance assessment in the estimation of the Conditional Average Treatment Effect (CATE). Theoretical analysis of the finite sample regime and empirical studies show that PermuCATE has lower variance than the Leave-One-Covariate-Out (LOCO) reference method and provides a reliable measure of variable importance. This property increases statistical power, which is crucial for causal inference in the limited-data regime common to biomedical applications. We empirically demonstrate the benefits of PermuCATE in simulated and real-world health datasets, including settings with up to hundreds of correlated variables.

Related papers

• Estimating Individual Dose-Response Curves under Unobserved Confounders from Observational Data [6.166869525631879]
  We present ContiVAE, a novel framework for estimating causal effects of continuous treatments, measured by individual dose-response curves. We show that ContiVAE outperforms existing methods by up to 62%, demonstrating its robustness and flexibility.
  arXiv  Detail & Related papers  (2024-10-21T07:24:26Z)
• Interpretable Causal Inference for Analyzing Wearable, Sensor, and Distributional Data [62.56890808004615]
  We develop an interpretable method for distributional data analysis that ensures trustworthy and robust decision-making. We demonstrate ADD MALTS' utility by studying the effectiveness of continuous glucose monitors in mitigating diabetes risks.
  arXiv  Detail & Related papers  (2023-12-17T00:42:42Z)
• Causal Dynamic Variational Autoencoder for Counterfactual Regression in Longitudinal Data [3.662229789022107]
  Estimating treatment effects over time is relevant in many real-world applications, such as precision medicine, epidemiology, economy, and marketing. We take a different perspective by assuming unobserved risk factors, i.e., adjustment variables that affect only the sequence of outcomes. We address the challenges posed by time-varying effects and unobserved adjustment variables.
  arXiv  Detail & Related papers  (2023-10-16T16:32:35Z)
• Proximal Causal Learning of Conditional Average Treatment Effects [0.0]
  We propose a tailored two-stage loss function for learning heterogeneous treatment effects. Our proposed estimator can be implemented by off-the-shelf loss-minimizing machine learning methods.
  arXiv  Detail & Related papers  (2023-01-26T02:56:36Z)
• Comparison of meta-learners for estimating multi-valued treatment heterogeneous effects [2.294014185517203]
  Conditional Average Treatment Effects (CATE) estimation is one of the main challenges in causal inference with observational data. Nonparametric estimators called meta-learners have been developed to estimate the CATE with the main advantage of not restraining the estimation to a specific supervised learning method. This paper looks into meta-learners for estimating the heterogeneous effects of multi-valued treatments.
  arXiv  Detail & Related papers  (2022-05-29T16:46:21Z)
• Assessment of Treatment Effect Estimators for Heavy-Tailed Data [70.72363097550483]
  A central obstacle in the objective assessment of treatment effect (TE) estimators in randomized control trials (RCTs) is the lack of ground truth (or validation set) to test their performance. We provide a novel cross-validation-like methodology to address this challenge. We evaluate our methodology across 709 RCTs implemented in the Amazon supply chain.
  arXiv  Detail & Related papers  (2021-12-14T17:53:01Z)
• Causal Effect Variational Autoencoder with Uniform Treatment [50.895390968371665]
  Causal effect variational autoencoder (CEVAE) are trained to predict the outcome given observational treatment data. Uniform treatment variational autoencoders (UTVAE) are trained with uniform treatment distribution using importance sampling.
  arXiv  Detail & Related papers  (2021-11-16T17:40:57Z)
• SurvITE: Learning Heterogeneous Treatment Effects from Time-to-Event Data [83.50281440043241]
  We study the problem of inferring heterogeneous treatment effects from time-to-event data. We propose a novel deep learning method for treatment-specific hazard estimation based on balancing representations.
  arXiv  Detail & Related papers  (2021-10-26T20:13:17Z)
• Estimating heterogeneous survival treatment effect in observational data using machine learning [9.951103976634407]
  Methods for estimating heterogeneous treatment effect in observational data have largely focused on continuous or binary outcomes. Using flexible machine learning methods in the counterfactual framework is a promising approach to address challenges due to complex individual characteristics.
  arXiv  Detail & Related papers  (2020-08-17T01:02:14Z)
• Enabling Counterfactual Survival Analysis with Balanced Representations [64.17342727357618]
  Survival data are frequently encountered across diverse medical applications, i.e., drug development, risk profiling, and clinical trials. We propose a theoretically grounded unified framework for counterfactual inference applicable to survival outcomes.
  arXiv  Detail & Related papers  (2020-06-14T01:15:00Z)
• Localized Debiased Machine Learning: Efficient Inference on Quantile Treatment Effects and Beyond [69.83813153444115]
  We consider an efficient estimating equation for the (local) quantile treatment effect ((L)QTE) in causal inference. Debiased machine learning (DML) is a data-splitting approach to estimating high-dimensional nuisances. We propose localized debiased machine learning (LDML), which avoids this burdensome step.
  arXiv  Detail & Related papers  (2019-12-30T14:42:52Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.