Causal Risk Minimization for High-Dimensional Treatments
- URL: http://arxiv.org/abs/2605.27281v1
- Date: Tue, 26 May 2026 16:58:39 GMT
- Title: Causal Risk Minimization for High-Dimensional Treatments
- Abstract summary: We adapt a well-known approach of recasting causal inference as a learning problem to address high-dimensional treatment spaces.<n>We show that causal error decomposes into a series of moment-balancing errors of increasing order, and design objectives that directly improve causal estimation.
- Score: 16.452129563607553
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Predicting the effect of interventions with many possible variations, e.g., therapeutic content that affects mental health outcomes or an earnings call transcript that drives movement in share price, is useful across several domains. However, classical causal estimators tend to assume that all possible interventions are observed, which is infeasible when interventions vary widely, for instance, in the space of all text strings. We adapt a well-known approach of recasting causal inference as a learning problem, to address high-dimensional treatment spaces. Specifically, under standard assumptions like no unobserved confounding, we show that causal error decomposes into a series of moment-balancing errors of increasing order, and design objectives that directly improve causal estimation. We also show how to project the effect of a high-dimensional treatment onto lower-dimensional treatment attributes, which allows a single model to answer several causal questions without additional attribute-specific training. We empirically evaluate our estimators in settings with high-dimensional continuous, discrete, and text treatments, the last of which used a semi-synthetic dataset of Amazon Reviews. Our experiments demonstrate the benefit of higher-order balance error optimization and competitive performance of projected causal estimates with attribute-specific estimators.
Related papers
- Deconfounding Scores and Representation Learning for Causal Effect Estimation with Weak Overlap [75.41420283374737]
Overlap is a key condition for causal treatment effect estimation.<n>We propose a class of feature representations called deconfounding scores.<n>We show that prognostic scores are overlap-optimal within this class.
arXiv Detail & Related papers (2026-04-01T12:19:42Z) - Beyond the ATE: Interpretable Modelling of Treatment Effects over Dose and Time [46.2482873419289]
We propose a framework for modelling treatment effect trajectories as smooth surfaces over dose and time.<n>Our approach decouples the estimation of trajectory shape from the specification of clinically relevant properties.<n>We show that our method yields accurate, interpretable, and editable models of treatment dynamics.
arXiv Detail & Related papers (2025-07-09T20:33:33Z) - Deep Disentangled Representation Network for Treatment Effect Estimation [17.787544758117377]
Estimating individual-level treatment effect from observational data is a fundamental problem in causal inference.<n>We propose a novel treatment effect estimation algorithm that incorporates a mixture of experts with multi-head attention.<n>We conduct extensive experiments on both public semi-synthetic and real-world production datasets.
arXiv Detail & Related papers (2025-07-09T08:29:37Z) - Black Box Causal Inference: Effect Estimation via Meta Prediction [56.277798874118425]
We frame causal inference as a dataset-level prediction problem, offloading algorithm design to the learning process.<n>We introduce, called black box causal inference (BBCI), builds estimators in a black-box manner by learning to predict causal effects from sampled dataset-effect pairs.<n>We demonstrate accurate estimation of average treatment effects (ATEs) and conditional average treatment effects (CATEs) with BBCI across several causal inference problems.
arXiv Detail & Related papers (2025-03-07T23:43:19Z) - Higher-Order Causal Message Passing for Experimentation with Complex Interference [6.092214762701847]
We introduce a new class of estimators based on causal message-passing, specifically designed for settings with pervasive, unknown interference.<n>Our estimator draws on information from the sample mean and variance of unit outcomes and treatments over time, enabling efficient use of observed data.
arXiv Detail & Related papers (2024-11-01T18:00:51Z) - Flexible Nonparametric Inference for Causal Effects under the Front-Door Model [2.6900047294457683]
We develop novel one-step and targeted minimum loss-based estimators for both the average treatment effect and the average treatment effect on the treated under front-door assumptions.<n>Our estimators are built on multiple parameterizations of the observed data distribution, including approaches that avoid mediator density entirely.<n>We show how these constraints can be leveraged to improve the efficiency of causal effect estimators.
arXiv Detail & Related papers (2023-12-15T22:04:53Z) - Causal Dynamic Variational Autoencoder for Counterfactual Regression in Longitudinal Data [5.766786445424951]
Current methods for estimating treatment effects over time assume that all confounders are observed or attempt to infer unobserved ones.<n>Our approach focuses on unobserved adjustment variables, which specifically have a causal effect on the outcome sequence.<n>Our proposed Causal Dynamic Variational Autoencoder (CDVAE) is grounded in theoretical guarantees concerning the validity of latent adjustment variables.
arXiv Detail & Related papers (2023-10-16T16:32:35Z) - Neighborhood Adaptive Estimators for Causal Inference under Network Interference [109.17155002599978]
We consider the violation of the classical no-interference assumption with units connected by a network.<n>For tractability, we consider a known network that describes how interference may spread.
arXiv Detail & Related papers (2022-12-07T14:53:47Z) - Benchmarking Heterogeneous Treatment Effect Models through the Lens of
Interpretability [82.29775890542967]
Estimating personalized effects of treatments is a complex, yet pervasive problem.
Recent developments in the machine learning literature on heterogeneous treatment effect estimation gave rise to many sophisticated, but opaque, tools.
We use post-hoc feature importance methods to identify features that influence the model's predictions.
arXiv Detail & Related papers (2022-06-16T17:59:05Z) - SurvITE: Learning Heterogeneous Treatment Effects from Time-to-Event
Data [83.50281440043241]
We study the problem of inferring heterogeneous treatment effects from time-to-event data.
We propose a novel deep learning method for treatment-specific hazard estimation based on balancing representations.
arXiv Detail & Related papers (2021-10-26T20:13:17Z) - Efficient Causal Inference from Combined Observational and
Interventional Data through Causal Reductions [68.6505592770171]
Unobserved confounding is one of the main challenges when estimating causal effects.
We propose a novel causal reduction method that replaces an arbitrary number of possibly high-dimensional latent confounders.
We propose a learning algorithm to estimate the parameterized reduced model jointly from observational and interventional data.
arXiv Detail & Related papers (2021-03-08T14:29:07Z) - Generalization Bounds and Representation Learning for Estimation of
Potential Outcomes and Causal Effects [61.03579766573421]
We study estimation of individual-level causal effects, such as a single patient's response to alternative medication.
We devise representation learning algorithms that minimize our bound, by regularizing the representation's induced treatment group distance.
We extend these algorithms to simultaneously learn a weighted representation to further reduce treatment group distances.
arXiv Detail & Related papers (2020-01-21T10:16:33Z) - Estimating Treatment Effect under Additive Hazards Models with High-dimensional Covariates [0.3481985817302898]
We propose a new score method for treatment effect estimation and inference.<n>We provide valid inference for the conditional treatment effect under the high-dimensional additive hazards model.<n>We apply our methods to study the treatment effect of radical prostatectomy versus conservative management for prostate cancer patients.
arXiv Detail & Related papers (2019-06-29T22:15:59Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.