Two Layers of Instability in Causal Estimation

• URL: http://arxiv.org/abs/2606.21185v1
• Date: Fri, 19 Jun 2026 07:51:06 GMT
• Title: Two Layers of Instability in Causal Estimation
• Abstract summary: We show that estimators can jump discontinuously in the data distribution.<n>This defines a taxonomy of estimators that admits a decision-theoretic reading.
• Score: 17.478674884251173
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: There is a precise sense in which drawing causal inferences from observational data is hard, even when identifiability is assumed. In particular, Robins and Ritov (1997) and Robins et al. (2003) showed that causal effects can be discontinuous as a function of the data distribution: two arbitrarily close data distributions might correspond to different causal effects. This is a fact independent of the choice of estimator; however, not all estimators are equally unstable. Our contribution is to surface a second layer of instability that depends on the choice of estimator. We show that many standard point estimates can be read as point summaries of multimodal distributions over the space of structural causal models. As such, estimators can jump discontinuously in the data distribution. This defines a taxonomy of estimators that admits a decision-theoretic reading: stability depends on whether the implicit loss function an estimator optimizes is aligned with the causal effect itself. Specifically, inverse propensity weighted estimators and regression estimators are examples of discontinuous summaries, while explicit posterior means and medians are shown to be continuous.

Related papers

• Conditional Distribution Estimation for Functional Responses with Random Forests [0.0]
  We show that conditional laws of functional outcomes can be estimated and evaluated in a practical nonparametric framework.<n>We introduce functional distributional random forests, which estimate each conditional law as a co-dependent distribution over sampled functions.<n>This supports inference on arbitrary functionals of the conditional distribution while keeping predictive samples tied to realistic curves.
  arXiv  Detail & Related papers  (2026-08-08T17:19:20Z)
• The conditional-mean barrier: From deterministic regression to conditional distribution learning [6.160113667162026]
  This tutorial develops a self-contained module centered on the conditional-mean barrier.<n>Adding latent randomness to a squared-loss predictor collapses it back to the conditional mean.<n>We briefly organize common distributional objectives, including negative log-likelihood, moment and observable matching, variational objectives, adversarial divergences, and score matching.
  arXiv  Detail & Related papers  (2026-05-27T07:31:42Z)
• Disentangled Feature Importance [0.0]
  We introduce emphDisentangled Feature Importance (DFI), a nonparametric generalization of the classical $R2$ decomposition via optimal transport.<n>DFI correlated features into independent latent variables using a transport map, eliminating correlation distortion.<n>DFI provides a principled decomposition of importance scores that sum to the total predictive variability for latent additive models.
  arXiv  Detail & Related papers  (2025-06-30T20:54:48Z)
• Towards Self-Supervised Covariance Estimation in Deep Heteroscedastic Regression [102.24287051757469]
  We study self-supervised covariance estimation in deep heteroscedastic regression.<n>We derive an upper bound on the 2-Wasserstein distance between normal distributions.<n>Experiments over a wide range of synthetic and real datasets demonstrate that the proposed 2-Wasserstein bound coupled with pseudo label annotations results in a computationally cheaper yet accurate deep heteroscedastic regression.
  arXiv  Detail & Related papers  (2025-02-14T22:37:11Z)
• TIC-TAC: A Framework for Improved Covariance Estimation in Deep Heteroscedastic Regression [109.69084997173196]
  Deepscedastic regression involves jointly optimizing the mean and covariance of the predicted distribution using the negative log-likelihood. Recent works show that this may result in sub-optimal convergence due to the challenges associated with covariance estimation. We study two questions: (1) Does the predicted covariance truly capture the randomness of the predicted mean? Our results show that not only does TIC accurately learn the covariance, it additionally facilitates an improved convergence of the negative log-likelihood.
  arXiv  Detail & Related papers  (2023-10-29T09:54:03Z)
• A Stable and Efficient Covariate-Balancing Estimator for Causal Survival Effects [33.62020029799266]
  We address the problem of estimating survival causal effects in data with conditionally-independent censoring. This addresses the use of inverses of small estimated probabilities and the resulting amplification of estimation error. We validate our theoretical results in experiments on synthetic and semi-synthetic data.
  arXiv  Detail & Related papers  (2023-10-01T00:04:29Z)
• Causal inference for the expected number of recurrent events in the presence of a terminal event [0.2446672595462589]
  We develop a multiply robust estimation framework for causal inference in recurrent event data with a terminal failure event.<n>We show that the estimand can be identified under a weaker condition than conditionally independent censoring.
  arXiv  Detail & Related papers  (2023-06-28T21:31:25Z)
• Advancing Counterfactual Inference through Nonlinear Quantile Regression [77.28323341329461]
  We propose a framework for efficient and effective counterfactual inference implemented with neural networks. The proposed approach enhances the capacity to generalize estimated counterfactual outcomes to unseen data. Empirical results conducted on multiple datasets offer compelling support for our theoretical assertions.
  arXiv  Detail & Related papers  (2023-06-09T08:30:51Z)
• Nonparametric Identifiability of Causal Representations from Unknown Interventions [63.1354734978244]
  We study causal representation learning, the task of inferring latent causal variables and their causal relations from mixtures of the variables. Our goal is to identify both the ground truth latents and their causal graph up to a set of ambiguities which we show to be irresolvable from interventional data.
  arXiv  Detail & Related papers  (2023-06-01T10:51:58Z)
• Data-Driven Influence Functions for Optimization-Based Causal Inference [105.5385525290466]
  We study a constructive algorithm that approximates Gateaux derivatives for statistical functionals by finite differencing. We study the case where probability distributions are not known a priori but need to be estimated from data.
  arXiv  Detail & Related papers  (2022-08-29T16:16:22Z)
• Gaussian and Non-Gaussian Universality of Data Augmentation [6.51882364384472]
  We quantify how data augmentation affects the variance and limiting distribution of estimates through simple surrogates.<n>Data augmentation may increase rather than decrease the uncertainty of estimates, such as the empirical prediction risk.<n>As our main theoretical tool, we develop an adaptation of Lindeberg's technique for block dependence.
  arXiv  Detail & Related papers  (2022-02-18T11:32:41Z)
• Multivariate Probabilistic Regression with Natural Gradient Boosting [63.58097881421937]
  We propose a Natural Gradient Boosting (NGBoost) approach based on nonparametrically modeling the conditional parameters of the multivariate predictive distribution. Our method is robust, works out-of-the-box without extensive tuning, is modular with respect to the assumed target distribution, and performs competitively in comparison to existing approaches.
  arXiv  Detail & Related papers  (2021-06-07T17:44:49Z)
• Latent Causal Invariant Model [128.7508609492542]
  Current supervised learning can learn spurious correlation during the data-fitting process. We propose a Latent Causal Invariance Model (LaCIM) which pursues causal prediction.
  arXiv  Detail & Related papers  (2020-11-04T10:00:27Z)
• The Vector Poisson Channel: On the Linearity of the Conditional Mean Estimator [82.5577471797883]
  This work studies properties of the conditional mean estimator in vector Poisson noise. The first result shows that the conditional mean estimator cannot be linear when the dark current parameter of the Poisson noise is non-zero. The second result produces a quantitative refinement of the first result.
  arXiv  Detail & Related papers  (2020-03-19T18:21:33Z)
• Estimation of Accurate and Calibrated Uncertainties in Deterministic models [0.8702432681310401]
  We devise a method to transform a deterministic prediction into a probabilistic one. We show that for doing so, one has to compromise between the accuracy and the reliability (calibration) of such a model. We show several examples both with synthetic data, where the underlying hidden noise can accurately be recovered, and with large real-world datasets.
  arXiv  Detail & Related papers  (2020-03-11T04:02:56Z)
• Finite sample properties of parametric MMD estimation: robustness to misspecification and dependence [7.011897575776511]
  We show that the estimator is robust to both dependence and to the presence of outliers in the dataset.<n>We provide a theoretical study of the gradient descent algorithm used to compute the estimator.
  arXiv  Detail & Related papers  (2019-12-12T02:28:13Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.