Bayesian Sensitivity of Causal Inference Estimators under Evidence-Based Priors

• URL: http://arxiv.org/abs/2605.07993v1
• Date: Fri, 08 May 2026 16:50:05 GMT
• Title: Bayesian Sensitivity of Causal Inference Estimators under Evidence-Based Priors
• Abstract summary: Causal inference relies on untestable assumptions about the true data-generating process.<n>We extend the s-value framework with a new sensitivity analysis criterion: Bayesian Sensitivity Value.<n>We illustrate its applicability in an observational study on the effect of diabetes treatments on weight loss.
• Score: 18.804635963262736
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Causal inference, especially in observational studies, relies on untestable assumptions about the true data-generating process. Sensitivity analysis helps us determine how robust our conclusions are when we alter these underlying assumptions. Existing frameworks for sensitivity analysis are concerned with worst-case changes in assumptions. In this work, we argue that using such pessimistic criteria can often become uninformative or lead to conclusions contradicting our prior knowledge about the world. To demonstrate this claim, we generalize the recent s-value framework (Gupta & Rothenhäusler, 2023) to estimate the sensitivity of three different common assumptions in causal inference. Empirically, we find that, indeed, worst-case conclusions about sensitivity can rely on unrealistic changes in the data-generating process. To overcome this, we extend the s-value framework with a new sensitivity analysis criterion: Bayesian Sensitivity Value (BSV), which computes the expected sensitivity of an estimate to assumption violations under priors constructed from real-world evidence. We use Monte Carlo approximations to estimate this quantity and illustrate its applicability in an observational study on the effect of diabetes treatments on weight loss.

Related papers

• Amortizing Causal Sensitivity Analysis via Prior Data-Fitted Networks [43.927835161998026]
  Causal sensitivity analysis aims to provide bounds for causal effect estimates in the presence of unobserved confounding.<n>Existing methods for causal sensitivity analysis are per-instance procedures, meaning that changes to the dataset, causal query, sensitivity level, or treatment require new computation.<n>Here, we propose an amortized approach to causal sensitivity analysis based on prior-data fitted networks.
  arXiv  Detail & Related papers  (2026-05-11T13:59:22Z)
• Do-PFN: In-Context Learning for Causal Effect Estimation [75.62771416172109]
  We show that Prior-data fitted networks (PFNs) can be pre-trained on synthetic data to predict outcomes.<n>Our approach allows for the accurate estimation of causal effects without knowledge of the underlying causal graph.
  arXiv  Detail & Related papers  (2025-06-06T12:43:57Z)
• Data Fusion for Partial Identification of Causal Effects [62.56890808004615]
  We propose a novel partial identification framework that enables researchers to answer key questions.<n>Is the causal effect positive or negative? and How severe must assumption violations be to overturn this conclusion?<n>We apply our framework to the Project STAR study, which investigates the effect of classroom size on students' third-grade standardized test performance.
  arXiv  Detail & Related papers  (2025-05-30T07:13:01Z)
• Challenges and Considerations in the Evaluation of Bayesian Causal Discovery [49.0053848090947]
  Representing uncertainty in causal discovery is a crucial component for experimental design, and more broadly, for safe and reliable causal decision making. Unlike non-Bayesian causal discovery, which relies on a single estimated causal graph and model parameters for assessment, causal discovery presents challenges due to the nature of its quantity. No consensus on the most suitable metric for evaluation.
  arXiv  Detail & Related papers  (2024-06-05T12:45:23Z)
• A Neural Framework for Generalized Causal Sensitivity Analysis [78.71545648682705]
  We propose NeuralCSA, a neural framework for causal sensitivity analysis. We provide theoretical guarantees that NeuralCSA is able to infer valid bounds on the causal query of interest.
  arXiv  Detail & Related papers  (2023-11-27T17:40:02Z)
• Advancing Counterfactual Inference through Nonlinear Quantile Regression [77.28323341329461]
  We propose a framework for efficient and effective counterfactual inference implemented with neural networks. The proposed approach enhances the capacity to generalize estimated counterfactual outcomes to unseen data. Empirical results conducted on multiple datasets offer compelling support for our theoretical assertions.
  arXiv  Detail & Related papers  (2023-06-09T08:30:51Z)
• Sharp Bounds for Generalized Causal Sensitivity Analysis [30.77874108094485]
  We propose a unified framework for causal sensitivity analysis under unobserved confounding. This includes (conditional) average treatment effects, effects for mediation analysis and path analysis, and distributional effects. Our bounds for (conditional) average treatment effects coincide with recent optimality results for causal sensitivity analysis.
  arXiv  Detail & Related papers  (2023-05-26T14:44:32Z)
• On the Relation between Sensitivity and Accuracy in In-context Learning [41.27837171531926]
  In-context learning (ICL) suffers from oversensitivity to the prompt, making it unreliable in real-world scenarios. We study the sensitivity of ICL with respect to multiple perturbation types. We propose textscSenSel, a few-shot selective prediction method that abstains from sensitive predictions.
  arXiv  Detail & Related papers  (2022-09-16T00:52:34Z)
• Excess risk analysis for epistemic uncertainty with application to variational inference [110.4676591819618]
  We present a novel EU analysis in the frequentist setting, where data is generated from an unknown distribution. We show a relation between the generalization ability and the widely used EU measurements, such as the variance and entropy of the predictive distribution. We propose new variational inference that directly controls the prediction and EU evaluation performances based on the PAC-Bayesian theory.
  arXiv  Detail & Related papers  (2022-06-02T12:12:24Z)
• Partial Identification of Dose Responses with Hidden Confounders [25.468473751289036]
  Inferring causal effects of continuous-valued treatments from observational data is a crucial task. We present novel methodology to bound both average and conditional average continuous-valued treatment-effect estimates. We apply our method to a real-world observational case study to demonstrate the value of identifying dose-dependent causal effects.
  arXiv  Detail & Related papers  (2022-04-24T07:02:21Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.