Off-Policy Evaluation and Learning for Survival Outcomes under Censoring

• URL: http://arxiv.org/abs/2603.22900v1
• Date: Tue, 24 Mar 2026 07:50:38 GMT
• Title: Off-Policy Evaluation and Learning for Survival Outcomes under Censoring
• Abstract summary: Off-Policy Evaluation(OPE) provides a powerful framework for assessing such decision-making policies.<n>We propose a novel framework for OPE and Off-Policy Learning(OPL) tailored for survival outcomes under censoring.
• Score: 15.67394295485524
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Optimizing survival outcomes, such as patient survival or customer retention, is a critical objective in data-driven decision-making. Off-Policy Evaluation~(OPE) provides a powerful framework for assessing such decision-making policies using logged data alone, without the need for costly or risky online experiments in high-stakes applications. However, typical estimators are not designed to handle right-censored survival outcomes, as they ignore unobserved survival times beyond the censoring time, leading to systematic underestimation of the true policy performance. To address this issue, we propose a novel framework for OPE and Off-Policy Learning~(OPL) tailored for survival outcomes under censoring. Specifically, we introduce IPCW-IPS and IPCW-DR, which employ the Inverse Probability of Censoring Weighting technique to explicitly deal with censoring bias. We theoretically establish that our estimators are unbiased and that IPCW-DR achieves double robustness, ensuring consistency if either the propensity score or the outcome model is correct. Furthermore, we extend this framework to constrained OPL to optimize policy value under budget constraints. We demonstrate the effectiveness of our proposed methods through simulation studies and illustrate their practical impacts using public real-world data for both evaluation and learning tasks.

Related papers

• Off-Policy Evaluation for Ranking Policies under Deterministic Logging Policies [17.672063433232196]
  Off-Policy Evaluation (OPE) is an important practical problem in ranking systems.<n>The goal is to estimate the expected performance of a new ranking policy using only logged offline data collected under a different, logging policy.<n>We propose novel estimators, Click-based Inverse Propensity Score (CIPS), exploiting the intrinsicity of user click behavior to address this challenge.
  arXiv  Detail & Related papers  (2026-03-23T02:13:39Z)
• DOLCE: Decomposing Off-Policy Evaluation/Learning into Lagged and Current Effects [0.0]
  Off-policy evaluation (OPE) and off-policy learning (OPL) for contextual bandit policies leverage historical data to evaluate and optimize a target policy.<n>We propose DOLCE: Decomposing Off-policy evaluation/learning into Lagged and Current Effects, a novel estimator that leverages contextual information from multiple time points to decompose rewards into lagged and current effects.<n>Our experiments demonstrate that DOLCE achieves substantial improvements in OPE and OPL, particularly as the proportion of individuals outside the common support assumption increases.
  arXiv  Detail & Related papers  (2025-05-02T02:32:28Z)
• Efficient and Sharp Off-Policy Learning under Unobserved Confounding [25.068617118126824]
  We develop a novel method for personalized off-policy learning in scenarios with unobserved confounding.<n>Our method is highly relevant for decision-making where unobserved confounding can be problematic.
  arXiv  Detail & Related papers  (2025-02-18T16:42:24Z)
• Conformal Off-Policy Evaluation in Markov Decision Processes [53.786439742572995]
  Reinforcement Learning aims at identifying and evaluating efficient control policies from data. Most methods for this learning task, referred to as Off-Policy Evaluation (OPE), do not come with accuracy and certainty guarantees. We present a novel OPE method based on Conformal Prediction that outputs an interval containing the true reward of the target policy with a prescribed level of certainty.
  arXiv  Detail & Related papers  (2023-04-05T16:45:11Z)
• Uncertainty-Aware Instance Reweighting for Off-Policy Learning [63.31923483172859]
  We propose a Uncertainty-aware Inverse Propensity Score estimator (UIPS) for improved off-policy learning. Experiment results on synthetic and three real-world recommendation datasets demonstrate the advantageous sample efficiency of the proposed UIPS estimator.
  arXiv  Detail & Related papers  (2023-03-11T11:42:26Z)
• Improved Policy Evaluation for Randomized Trials of Algorithmic Resource Allocation [54.72195809248172]
  We present a new estimator leveraging our proposed novel concept, that involves retrospective reshuffling of participants across experimental arms at the end of an RCT. We prove theoretically that such an estimator is more accurate than common estimators based on sample means.
  arXiv  Detail & Related papers  (2023-02-06T05:17:22Z)
• Off-Policy Evaluation with Policy-Dependent Optimization Response [90.28758112893054]
  We develop a new framework for off-policy evaluation with a textitpolicy-dependent linear optimization response. We construct unbiased estimators for the policy-dependent estimand by a perturbation method. We provide a general algorithm for optimizing causal interventions.
  arXiv  Detail & Related papers  (2022-02-25T20:25:37Z)
• Doubly Robust Interval Estimation for Optimal Policy Evaluation in Online Learning [8.736154600219685]
  Policy evaluation in online learning attracts increasing attention. Yet, such a problem is particularly challenging due to the dependent data generated in the online environment. We develop the doubly robust interval estimation (DREAM) method to infer the value under the estimated optimal policy in online learning.
  arXiv  Detail & Related papers  (2021-10-29T02:38:54Z)
• Post-Contextual-Bandit Inference [57.88785630755165]
  Contextual bandit algorithms are increasingly replacing non-adaptive A/B tests in e-commerce, healthcare, and policymaking. They can both improve outcomes for study participants and increase the chance of identifying good or even best policies. To support credible inference on novel interventions at the end of the study, we still want to construct valid confidence intervals on average treatment effects, subgroup effects, or value of new policies.
  arXiv  Detail & Related papers  (2021-06-01T12:01:51Z)
• Reliable Off-policy Evaluation for Reinforcement Learning [53.486680020852724]
  In a sequential decision-making problem, off-policy evaluation estimates the expected cumulative reward of a target policy. We propose a novel framework that provides robust and optimistic cumulative reward estimates using one or multiple logged data.
  arXiv  Detail & Related papers  (2020-11-08T23:16:19Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.