Proper Scoring Rules for Right-Censored Survival Data
- URL: http://arxiv.org/abs/2606.06393v1
- Date: Thu, 04 Jun 2026 17:00:29 GMT
- Title: Proper Scoring Rules for Right-Censored Survival Data
- Abstract summary: We propose a framework for proper scoring of right-censored survival outcomes.<n>We map the predictive distribution through the censoring mechanism, then apply the underlying proper score on the induced observed-data law.<n>This yields localized scores for fixed censoring times and marginalized scores when the censoring time is random or only partially observed.
- Score: 3.10349618301124
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Proper scoring rules provide a rigorous theoretical basis for the training and evaluation of probabilistic forecasts. However, in the presence of right censoring, the event time is only partially observed, rendering conventional scoring rules inapplicable in their standard form. We propose a framework for proper scoring of right-censored survival outcomes based on a simple idea: first, map the predictive distribution through the censoring mechanism, then apply the underlying proper score on the induced observed-data law. This yields localized scores for fixed censoring times and marginalized scores when the censoring time is random or only partially observed. The resulting construction recovers familiar right-censored likelihood and IPCW-type criteria within a coherent framework, while also yielding right-censored versions of the CRPS, pinball loss, Brier score, and energy score. We show that the marginalized score is proper under conditional independent censoring and strictly proper on the identifiable region. The same principle also leads to censored engression, a sample-based learning objective for multivariate right-censored survival modeling. In experiments, our scores correctly rank the oracle forecast across several censoring regimes, whereas forecast-dependent plug-in weighted scores can exhibit ranking reversals. Censored engression likewise substantially improves over naive training on censored outcomes.
Related papers
- Null-Calibrated Conformal Selection via Target-Membership Scores [0.6599344783327052]
Conformal selection aims to identify test candidates whose unknown responses fall in a target region while controlling the false discovery rate.<n>We argue that the natural score for selection is instead the target-membership probability.<n>We study membership-score-based conformal selection and isolate one conformal calibration route, Null-Calibrated Conformal Selection.
arXiv Detail & Related papers (2026-06-21T05:03:04Z) - Rethinking Reward Supervision: Rubric-Conditioned Self-Distillation [60.55792673956761]
We propose textbfRubric-Conditioned Self-Distillation, a framework that incorporates rubrics as structured, fine-grained feedback for on-policy self-distillation.<n>We evaluate on a diverse suite of science reasoning benchmarks and results show that rubric-conditioned self-distillation effectively converts rubric-level criteria into token-level guidance.
arXiv Detail & Related papers (2026-06-17T17:54:04Z) - Tailoring Strictly Proper Scoring Rules for Downstream Tasks: An Application to Causal Inference [48.78219918881965]
We propose a principled framework for deriving task-specific strictly proper scoring rules by matching the local curvature of the downstream error metric.<n>We apply this to the Average Treatment Effect (ATE) estimation, deriving a closed-form loss and its corresponding canonical probability mapping.
arXiv Detail & Related papers (2026-06-02T08:41:25Z) - Proper Scoring Rules for Agentic Uncertainty Quantification [0.038379177968040606]
Trajectory Proper Score (TPS) is a predictor-agnostic family of strictly proper trajectory-level scoring rules.<n>Trajectory ECE is resolution-blind, while scalarized Trajectory Brier elicits only the collapsed scalar, not the full trace.
arXiv Detail & Related papers (2026-05-23T22:22:00Z) - \mathsf{VISTA}: Decentralized Machine Learning in Adversary Dominated Environments [21.69919643934826]
Decentralized machine learning often relies on outsourcing computations, such as evaluations, to untrusted worker nodes.<n>We study this adversary-dominated setting through an incentive-oriented framework in which reports are accepted and rewarded only when they are mutually consistent up to a threshold.<n>We propose mathsfVISTA, an adaptive algorithm that tunes the acceptance threshold using the optimization history.
arXiv Detail & Related papers (2026-05-08T15:07:15Z) - Probability-Entropy Calibration: An Elastic Indicator for Adaptive Fine-tuning [55.2818264614932]
RankTuner introduces a probability--entropy calibration signal, the Relative Rank Indicator, which compares the rank of the ground-truth token with its expected rank under the prediction distribution.<n>The inverse indicator is used as a token-wise Relative Scale to reweight the fine-tuning objective, focusing updates on truly under-learned tokens.
arXiv Detail & Related papers (2026-02-02T07:27:19Z) - Overcoming Dependent Censoring in the Evaluation of Survival Models [4.795126873893598]
We introduce three new evaluation metrics for survival analysis based on Archimedean copulas.<n>We also develop a framework to generate realistic, semi-synthetic datasets with dependent censoring.
arXiv Detail & Related papers (2025-02-26T10:28:44Z) - Conformal Prediction Sets with Improved Conditional Coverage using Trust Scores [52.92618442300405]
It is impossible to achieve exact, distribution-free conditional coverage in finite samples.<n>We propose an alternative conformal prediction algorithm that targets coverage where it matters most.
arXiv Detail & Related papers (2025-01-17T12:01:56Z) - Examining marginal properness in the external validation of survival models with squared and logarithmic losses [0.0]
We survey common squared and logarithmic scoring rules for survival analysis.<n>We show that both the Integrated Survival Brier Score (ISBS) and the Right-Censored Log-Likelihood (RCLL) are theoretically improper.<n>We advocate for both the RCLL and ISBS in external validation of models, including in automated procedures.
arXiv Detail & Related papers (2022-12-10T10:34:35Z) - A copula-based boosting model for time-to-event prediction with
dependent censoring [0.0]
This paper introduces Clayton-boost, a boosting approach built upon the accelerated failure time model.
It uses a Clayton copula to handle the dependency between the event and censoring distributions.
It shows a strong ability to remove prediction bias at the presence of dependent censoring.
arXiv Detail & Related papers (2022-10-10T17:38:00Z) - Deconfounding Scores: Feature Representations for Causal Effect
Estimation with Weak Overlap [140.98628848491146]
We introduce deconfounding scores, which induce better overlap without biasing the target of estimation.
We show that deconfounding scores satisfy a zero-covariance condition that is identifiable in observed data.
In particular, we show that this technique could be an attractive alternative to standard regularizations.
arXiv Detail & Related papers (2021-04-12T18:50:11Z) - Censored Quantile Regression Forest [81.9098291337097]
We develop a new estimating equation that adapts to censoring and leads to quantile score whenever the data do not exhibit censoring.
The proposed procedure named it censored quantile regression forest, allows us to estimate quantiles of time-to-event without any parametric modeling assumption.
arXiv Detail & Related papers (2020-01-08T23:20:23Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.