Bayesian X-Learner: Calibrated Posterior Inference for Heterogeneous Treatment Effects under Heavy-Tailed Outcomes

• URL: http://arxiv.org/abs/2604.27394v1
• Date: Thu, 30 Apr 2026 04:07:11 GMT
• Title: Bayesian X-Learner: Calibrated Posterior Inference for Heterogeneous Treatment Effects under Heavy-Tailed Outcomes
• Abstract summary: We present X-Learner, an X-Learner built on cross-fitted doubly robust pseudo-outcomes.<n>On contaminated "whale" DGPs with up to 20-25% tail density, a one-flag extension (contamination_severity) that selects a Huber-$$ loss per Huber's minimax-$$ relation recovers $(x)$ with tight credible intervals.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Conditional Average Treatment Effect (CATE) estimation in practice demands three properties simultaneously: heterogeneous effects $τ(x)$, calibrated uncertainty over them, and robustness to the heavy tails that contaminate real outcome data. Meta-learners (Künzel et al., 2019) give (i); causal forests and BART give (i)-(ii) with Gaussian-tail assumptions; no widely used tool gives all three. We present Bayesian X-Learner, an X-Learner built on cross-fitted doubly robust pseudo-outcomes (Kennedy, 2020) with a full MCMC posterior over $τ(x)$ via a Welsch redescending pseudo-likelihood. On Hill's IHDP benchmark the default configuration attains mean $\sqrt{\varepsilon_{\mathrm{PEHE}}} = 0.56$ on 5 replications (lowest mean; differences from S-/T-/X-learners, full-config Causal BART, and a causal forest baseline are not significant at $α=0.05$, and rank ordering is unstable at 10 replications -- IHDP comparisons are competitive rather than dominant). On contaminated "whale" DGPs with up to 20-25% tail density, a one-flag extension (contamination_severity) that selects a Huber-$δ$ nuisance loss per Huber's minimax-$δ$ relation recovers RMSE $\approx 0.13$ with tight credible intervals (single-cross-fit 30-seed coverage 83% [Wilson 66%, 93%] at 20% density; modular-Bayes pooling with Bayesian-bootstrap nuisance draws restores nominal 95% coverage).

Related papers

• Not All Relations Are Equal: Relation-Balanced and Calibrated Graph Learning for Provenance-Based Intrusion Detection [66.44527094471619]
  We present RECAL, an unsupervised framework using relation-balanced masked graph learning to better capture rare interaction patterns.<n>On three DARPA E3 datasets, RECAL achieves F1 scores of 99.99%, 99.93%, and 99.99%, outperforming the best baseline on each dataset by 0.88, 0.82, and 0.42 percentage points, respectively.
  arXiv  Detail & Related papers  (2026-09-15T00:31:01Z)
• SANE: State Anomaly Neutralization for Stable Extreme-Context Delta-Rule Models [53.86918766240095]
  Delta-Rule recurrent models maintain a fixed-size state, enabling $O(1)$ inference memory but potentially becoming unstable under extreme-context extrapolation.<n>We propose textbfState Anomaly Neutralization (SANE), which applies adaptive $tanh$ compression at chunk boundaries while preserving the intra-chunk parallel structure.
  arXiv  Detail & Related papers  (2026-08-23T10:41:07Z)
• Denoised Variance-Based Pruning with Optimal Brain Bias Compensation [45.88028371034407]
  Variance-Based Pruning (VBP) introduced a promising paradigm by selecting neurons based on activation variance.<n>We introduce Denoised Variance-Based Pruning with Optimal Brain Bias Compensation (DVBP + OB$2$C)<n>It achieves state-of-the-art training-free performance; at 50% pruning, it retains over 90% of the original Top-1 accuracy.
  arXiv  Detail & Related papers  (2026-08-18T11:23:49Z)
• The Growing Pains of Frontier Models: When Leaderboards Stop Separating and What to Measure Next [0.0]
  Leaderboards rank frontier models on independent axes but do not reveal whether capabilities reinforce or trade off across releases.<n>We decompose paired SWE-bench and GPQA Diamond scores into a population coupling trend and per-release residual.<n>We provide a three-level playbook (locate, diagnose, rotate), a per-lab measurement-priority table, and seven falsifiable predictions.
  arXiv  Detail & Related papers  (2026-05-13T03:19:38Z)
• SHIFT: Robust Double Machine Learning for Average Dose-Response Functions under Heavy-Tailed Contamination [0.0]
  SHIFT (Self-calibrated Heavy-tail Inlier-Fit with Tempering) is a robust DML estimator.<n>It combines cross-fit nuisanceization with a kernel-local Welsch-loss second stage optimized by Graduated Non-Convexity.<n>It has competitive worst-case shape recovery across 1,400 mainsweep fits.
  arXiv  Detail & Related papers  (2026-04-30T19:51:35Z)
• Smart Ensemble Learning Framework for Predicting Groundwater Heavy Metal Pollution [0.0]
  Groundwater in the Densu Basin is increasingly threatened by heavy metal contamination.<n>A key challenge is modelling the Heavy Metal Pollution Index (HPI), which is typically skewed and affected by correlated contaminants.<n>This study develops a framework integrating response transformations with nested cross-validated ensemble machine learning.
  arXiv  Detail & Related papers  (2026-04-29T21:40:18Z)
• Benchmarking the Utility of Privacy-Preserving Cox Regression Under Data-Driven Clipping Bounds: A Multi-Dataset Simulation Study [0.0]
  Differential privacy (DP) is a mathematical framework that guarantees individual privacy.<n>This study systematically evaluated the impact of DP mechanisms with data-driven clipping bounds on the Cox proportional hazards model.
  arXiv  Detail & Related papers  (2026-04-23T09:53:15Z)
• Why Training-Free Token Reduction Collapses: The Inherent Instability of Pairwise Scoring Signals [0.0]
  Training-free token reduction methods for Vision Transformers employ different scoring mechanisms, yet they share a closely matched cliff-like collapse at high compression.<n>We develop a diagnostic framework with two tools, ranking consistency $_s$ and off-diagonal correlation $_textoff$, that decomposes the collapse into (1)a signal-agnostic error amplifier inherent to layer-wise reduction.<n>We construct CATIS as a constructive validation: unary signals raise the trigger threshold, triage suppresses the gain.
  arXiv  Detail & Related papers  (2026-04-17T23:26:27Z)
• Geometric Properties of the Voronoi Tessellation in Latent Semantic Manifolds of Large Language Models [0.0]
  Voronoi tessellation over representation manifold investigated on Qwen3.5-4B-Base.<n>We show that Voronoi tessellation is reshapable through margin refinement procedures.
  arXiv  Detail & Related papers  (2026-04-08T07:36:04Z)
• Reinforcement Learning from Multi-Source Imperfect Preferences: Best-of-Both-Regimes Regret [71.69884486156359]
  We study episodic RL from emphmulti-source imperfect preferences through a cumulative imperfection budget.<n>We propose a unified algorithm with regret $tildeO(sqrtK/M+)$, which exhibits a best-of-both-regimes behavior.
  arXiv  Detail & Related papers  (2026-03-20T19:34:53Z)
• SA-CycleGAN-2.5D: Self-Attention CycleGAN with Tri-Planar Context for Multi-Site MRI Harmonization [3.5109108807229403]
  We propose SA-CycleGAN-2.5D, a domain adaptation framework motivated by the $HH$-divergence bound of Ben-David et al.<n>By bridging 2D efficiency and 3D consistency, our framework yields voxel-level harmonized images that preserve tumor pathophysiology.
  arXiv  Detail & Related papers  (2026-03-17T23:49:46Z)
• When Does Margin Clamping Affect Training Variance? Dataset-Dependent Effects in Contrastive Forward-Forward Learning [0.0]
  Contrastive Forward-Forward (CFF) learning trains Vision Transformers layer by layer against supervised contrastive objectives.<n>We focus on one implementation detail: the positive-pair margin in the contrastive loss is applied through saturating similarity clamping.<n>We prove that an alternative formulation, subtracting the margin after the log-probability, is gradient-neutral under the mean-over-positives reduction.
  arXiv  Detail & Related papers  (2026-03-01T07:00:38Z)
• Optimal Unconstrained Self-Distillation in Ridge Regression: Strict Improvements, Precise Asymptotics, and One-Shot Tuning [61.07540493350384]
  Self-distillation (SD) is the process of retraining a student on a mixture of ground-truth and the teacher's own predictions.<n>We show that for any prediction risk, the optimally mixed student improves upon the ridge teacher for every regularization level.<n>We propose a consistent one-shot tuning method to estimate $star$ without grid search, sample splitting, or refitting.
  arXiv  Detail & Related papers  (2026-02-19T17:21:15Z)
• Federated Learning Resilient to Byzantine Attacks and Data Heterogeneity [59.17297282373628]
  This paper addresses Gradient learning (FL) in the context of malicious attacks on data.<n>We introduce a novel Average Robust Algorithm (RAGA) which uses the median for both convergence analysis and loss functions.
  arXiv  Detail & Related papers  (2024-03-20T08:15:08Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.