Splitting the Difference: Interpretable Causal Forests for Treatment Effect Heterogeneity and Bias
- URL: http://arxiv.org/abs/2609.16971v1
- Date: Tue, 15 Sep 2026 10:43:57 GMT
- Title: Splitting the Difference: Interpretable Causal Forests for Treatment Effect Heterogeneity and Bias
- Abstract summary: We introduce an algorithm based on decision trees and random forests for estimating individual treatment effects.<n>Our algorithm is simple: it operates exactly like a standard random forest, but with a different splitting criterion.<n>It handles observational studies with varying treatment propensities without requiring separate estimation of the full propensity function.
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: In various fields, such as medicine and marketing, accurately predicting individual treatment effects holds significant promise. However, achieving reliable predictions alone is often insufficient for making informed decisions; it is equally important to understand why the treatment effect is higher for some individuals than for others. To address this two-fold challenge of prediction and interpretation, we introduce an algorithm based on decision trees and random forests for estimating individual treatment effects. Our algorithm is simple: it operates exactly like a standard random forest, but with a different splitting criterion, and requires no additional workarounds such as double machine learning or orthogonalization as used in Generalized random forests. It handles observational studies with varying treatment propensities without requiring separate estimation of the full propensity function. This is achieved by combining two splitting criteria---one targeting heterogeneity in the treatment effect, the other targeting bias correction for the average treatment effect---which together improve split point selection and automatically distinguish confounders from features responsible for heterogeneity. As a result, interpretation follows directly from the fitted tree structure itself, that is, from which features the trees split on and with which split statistics, without requiring separate post-hoc analysis. For the theoretical analysis of this algorithm, we consider a change point model with step functions for potential outcomes and treatment propensity and provide insights into the theoretical underpinnings of our approach. Simulation studies show that our simple algorithm achieves comparable, and often better, prediction accuracy than existing methods, while substantially improving interpretability.
Related papers
- Learning heterogeneous treatment effects under principal stratification [4.965155763091777]
We study the identification and estimation of the conditional principal causal effects under principal ignorability.<n>We propose a novel doubly cross-fit doubly robust machine that resolves the nested nuisance structure inherent to principal stratification.
arXiv Detail & Related papers (2026-06-27T20:27:17Z) - Causal Inference with Categorical Unobserved Confounder via Mixture Learning [20.542714966688656]
We show that causal effects are identifiable when the unobserved confounder is categorical under suitable conditions.<n>We propose an estimation procedure based on tensor decomposition, which allows consistent recovery of the latent structure.
arXiv Detail & Related papers (2026-05-18T18:28:16Z) - Doubly Robust Proxy Causal Learning with Neural Mean Embeddings [58.8808794752741]
We develop a neural doubly robust framework for proxy causal learning with continuous and structured treatments.<n>The framework covers population, heterogeneous, and conditional dose-response functions, yielding full response-curve estimators.<n>Across synthetic and image-valued benchmarks, the proposed estimators outperform existing baselines and single-bridge neural estimators.
arXiv Detail & Related papers (2026-05-10T12:50:25Z) - An Orthogonal Learner for Individualized Outcomes in Markov Decision Processes [55.93922317950527]
We develop a novel meta-learner called DRQ-learner.<n>Our DRQ-learner is applicable to settings with both discrete and continuous state spaces.
arXiv Detail & Related papers (2025-09-30T15:49:29Z) - Structured Radial Basis Function Network: Modelling Diversity for
Multiple Hypotheses Prediction [51.82628081279621]
Multi-modal regression is important in forecasting nonstationary processes or with a complex mixture of distributions.
A Structured Radial Basis Function Network is presented as an ensemble of multiple hypotheses predictors for regression problems.
It is proved that this structured model can efficiently interpolate this tessellation and approximate the multiple hypotheses target distribution.
arXiv Detail & Related papers (2023-09-02T01:27:53Z) - Nonparametric Identifiability of Causal Representations from Unknown
Interventions [63.1354734978244]
We study causal representation learning, the task of inferring latent causal variables and their causal relations from mixtures of the variables.
Our goal is to identify both the ground truth latents and their causal graph up to a set of ambiguities which we show to be irresolvable from interventional data.
arXiv Detail & Related papers (2023-06-01T10:51:58Z) - What Makes Forest-Based Heterogeneous Treatment Effect Estimators Work? [1.1050303097572156]
We show that both methods can be understood in terms of the same parameters and confounding assumptions under L2 loss.
In the randomized setting, both approaches performed akin to the new blended versions in a benchmark study.
arXiv Detail & Related papers (2022-06-21T12:45:07Z) - Generalized Causal Tree for Uplift Modeling [7.614863322262727]
Uplift modeling is crucial in various applications ranging from marketing and policy-making to personalized recommendations.
The main objective is to learn optimal treatment allocations for a heterogeneous population.
We propose a generalization of tree-based approaches to tackle multiple discrete and continuous-valued treatments.
arXiv Detail & Related papers (2022-02-04T22:27:49Z) - Achieving Reliable Causal Inference with Data-Mined Variables: A Random
Forest Approach to the Measurement Error Problem [1.5749416770494704]
A common empirical strategy involves the application of predictive modeling techniques to'mine' variables of interest from available data.
Recent work highlights that, because the predictions from machine learning models are inevitably imperfect, econometric analyses based on the predicted variables are likely to suffer from bias due to measurement error.
We propose a novel approach to mitigate these biases, leveraging the ensemble learning technique known as the random forest.
arXiv Detail & Related papers (2020-12-19T21:48:23Z) - Double Robust Representation Learning for Counterfactual Prediction [68.78210173955001]
We propose a novel scalable method to learn double-robust representations for counterfactual predictions.
We make robust and efficient counterfactual predictions for both individual and average treatment effects.
The algorithm shows competitive performance with the state-of-the-art on real world and synthetic data.
arXiv Detail & Related papers (2020-10-15T16:39:26Z) - Almost-Matching-Exactly for Treatment Effect Estimation under Network
Interference [73.23326654892963]
We propose a matching method that recovers direct treatment effects from randomized experiments where units are connected in an observed network.
Our method matches units almost exactly on counts of unique subgraphs within their neighborhood graphs.
arXiv Detail & Related papers (2020-03-02T15:21:20Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.