Optimized Certainty Equivalent Risk-Controlling Prediction Sets

• URL: http://arxiv.org/abs/2602.13660v1
• Date: Sat, 14 Feb 2026 08:03:27 GMT
• Title: Optimized Certainty Equivalent Risk-Controlling Prediction Sets
• Abstract summary: This paper introduces optimized certainty equivalent RCPS (OCE-RCPS), a novel framework that provides high-probability guarantees on general optimized certainty equivalent (OCE) risk measures.<n> Experiments on image segmentation demonstrate that OCE-RCPS consistently meets target satisfaction rates across various risk measures and reliability configurations.
• Score: 29.939616090267975
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In safety-critical applications such as medical image segmentation, prediction systems must provide reliability guarantees that extend beyond conventional expected loss control. While risk-controlling prediction sets (RCPS) offer probabilistic guarantees on the expected risk, they fail to capture tail behavior and worst-case scenarios that are crucial in high-stakes settings. This paper introduces optimized certainty equivalent RCPS (OCE-RCPS), a novel framework that provides high-probability guarantees on general optimized certainty equivalent (OCE) risk measures, including conditional value-at-risk (CVaR) and entropic risk. OCE-RCPS leverages upper confidence bounds to identify prediction set parameters that satisfy user-specified risk tolerance levels with provable reliability. We establish theoretical guarantees showing that OCE-RCPS satisfies the desired probabilistic constraint for loss functions such as miscoverage and false negative rate. Experiments on image segmentation demonstrate that OCE-RCPS consistently meets target satisfaction rates across various risk measures and reliability configurations, while OCE-CRC fails to provide probabilistic guarantees.

Related papers

• Conformal Risk-Averse Decision Making with Optimized Certainty Equivalent Risk Control [31.006941545235396]
  We study risk-averse decision making in which an agent selects actions while being uncertain about the true system state.<n>We characterize the optimal policy under known distributions, and show that it reduces to a prediction set-based solution for the CVaR.<n>For unknown distributions, we develop a data-driven calibration strategy, based on a synthetic model for the likelihood and held-out calibration data.
  arXiv  Detail & Related papers  (2026-08-28T10:45:23Z)
• Conformal Changepoint Localization and Root Cause Analysis with Corrupted Observations [55.76952683833966]
  This paper proposes weighted CONCH (W-CONCH) and weighted CROC (W-CROC) to reduce confidence set size when data may be corrupted.<n>Experiments on image-based and real-world changepoint and root-cause benchmarks show that uncertainty-based weighting substantially reduces confidence set size.
  arXiv  Detail & Related papers  (2026-07-29T05:16:59Z)
• Distribution-Free Risk-Aware Planning and Control Under Uncertainty Using Conformal Spectral Risk Control [1.9551668880584971]
  We propose a risk-aware model predictive control (RA-MPC) framework that incorporates prediction sets to guarantee risk control below a user-specified threshold.<n>We show that incorporating the prediction sets into the MPC framework provides statistical safety guarantees in terms of spectral risk constraint satisfaction even under uncertainty misspecification.
  arXiv  Detail & Related papers  (2026-06-02T20:07:56Z)
• Action-Conditioned Risk Gating for Safety-Critical Control under Partial Observability [79.08785366532287]
  We propose a lightweight risk-gated reinforcement learning approximation for risk-sensitive control under partial observability.<n>We evaluate the approach in two safety-critical partially observable domains: automated glucose regulation and safety-constrained navigation.
  arXiv  Detail & Related papers  (2026-05-14T01:23:09Z)
• Risk-Constrained Belief-Space Optimization for Safe Control under Latent Uncertainty [5.99447754429793]
  Many safety-critical control systems must operate under latent uncertainty that sensors cannot directly resolve at decision time.<n>Standard methods optimize expected performance and offer limited protection against rare but severe outcomes.<n>We consider partially observed dynamical systems whose dynamics, costs, and safety constraints depend on a latent parameter maintained as a belief distribution.
  arXiv  Detail & Related papers  (2026-04-04T21:22:44Z)
• Conformal Prediction Assessment: A Framework for Conditional Coverage Evaluation and Selection [8.778189690708578]
  Conformal Prediction Assessment (CPA) is a framework that reframes the evaluation of conditional coverage as a supervised learning task.<n> Conditional Validity Index (CVI) decomposes reliability into safety (undercoverage risk) and efficiency (overcoverage cost)
  arXiv  Detail & Related papers  (2026-03-28T08:30:17Z)
• Selective Conformal Risk Control [0.38106124526091323]
  We propose textitSelective Conformal Risk Control (SCRC), a unified framework that integrates conformal prediction with selective classification.<n>The framework formulates uncertainty control as a two-stage problem: the first stage selects confident samples for prediction, and the second stage applies conformal risk control on the selected subset to construct calibrated prediction sets.<n>Experiments show that both methods achieve the target coverage and risk levels, with nearly identical performance, while SCRC-I exhibits slightly more conservative risk control but superior computational practicality.
  arXiv  Detail & Related papers  (2025-12-14T21:18:28Z)
• Conformal Risk Training: End-to-End Optimization of Conformal Risk Control [41.45834526675908]
  We introduce "conformal risk training," an end-to-end approach that differentiates through conformal OCE risk control during model training or fine-tuning.<n>Our method achieves provable risk guarantees while demonstrating significantly improved average-case performance over post-hoc approaches.
  arXiv  Detail & Related papers  (2025-10-09T19:05:45Z)
• CCE: Confidence-Consistency Evaluation for Time Series Anomaly Detection [56.302586730134806]
  We introduce Confidence-Consistency Evaluation (CCE), a novel evaluation metric.<n>CCE simultaneously measures prediction confidence and uncertainty consistency.<n>We also establish RankEval, a benchmark for comparing the ranking capabilities of various metrics.
  arXiv  Detail & Related papers  (2025-09-01T03:38:38Z)
• COIN: Uncertainty-Guarding Selective Question Answering for Foundation Models with Provable Risk Guarantees [51.5976496056012]
  COIN is an uncertainty-guarding selection framework that calibrates statistically valid thresholds to filter a single generated answer per question.<n>COIN estimates the empirical error rate on a calibration set and applies confidence interval methods to establish a high-probability upper bound on the true error rate.<n>We demonstrate COIN's robustness in risk control, strong test-time power in retaining admissible answers, and predictive efficiency under limited calibration data.
  arXiv  Detail & Related papers  (2025-06-25T07:04:49Z)
• SConU: Selective Conformal Uncertainty in Large Language Models [59.25881667640868]
  We propose a novel approach termed Selective Conformal Uncertainty (SConU)<n>We develop two conformal p-values that are instrumental in determining whether a given sample deviates from the uncertainty distribution of the calibration set at a specific manageable risk level.<n>Our approach not only facilitates rigorous management of miscoverage rates across both single-domain and interdisciplinary contexts, but also enhances the efficiency of predictions.
  arXiv  Detail & Related papers  (2025-04-19T03:01:45Z)
• Conditional Conformal Risk Adaptation [9.559062601251464]
  We develop a new score function for creating adaptive prediction sets that significantly improve conditional risk control for segmentation tasks.<n>We introduce a specialized probability calibration framework that enhances the reliability of pixel-wise inclusion estimates.<n>Our experiments on polyp segmentation demonstrate that all three methods provide valid marginal risk control and deliver more consistent conditional risk control.
  arXiv  Detail & Related papers  (2025-04-10T10:01:06Z)
• Beyond Confidence: Adaptive Abstention in Dual-Threshold Conformal Prediction for Autonomous System Perception [0.4124847249415279]
  Safety-critical perception systems require reliable uncertainty quantification and principled abstention mechanisms to maintain safety.<n>We present a novel dual-threshold conformalization framework that provides statistically-guaranteed uncertainty estimates while enabling selective prediction in high-risk scenarios.
  arXiv  Detail & Related papers  (2025-02-11T04:45:31Z)
• Confidence-aware Fine-tuning of Sequential Recommendation Systems via Conformal Prediction [46.76846936581471]
  In Sequential Recommendation Systems (SRecsys), traditional training approaches that rely on Cross-Entropy (CE) loss often prioritize accuracy but fail to align well with user satisfaction metrics.<n>We propose textbfCPFT, a novel fine-tuning framework that integrates Conformal Prediction (CP)-based losses with CE loss to optimize accuracy alongside confidence that better aligns with widely used top-$K$ metrics.
  arXiv  Detail & Related papers  (2024-02-14T06:43:02Z)
• Cross-Validation Conformal Risk Control [40.2365781482563]
  Conformal risk control (CRC) is a recently proposed technique that applies post-hoc to a conventional point predictor to provide calibration guarantees. In this paper, a novel CRC method is introduced that is based on cross-validation, rather than on validation as the original CRC. CV-CRC is proved to offer theoretical guarantees on the average risk of the set predictor.
  arXiv  Detail & Related papers  (2024-01-22T14:26:02Z)
• Forking Uncertainties: Reliable Prediction and Model Predictive Control with Sequence Models via Conformal Risk Control [40.918012779935246]
  We introduce a novel post-hoc calibration procedure that operates on the predictions produced by any pre-designed probabilistic forecaster to yield reliable error bars. Unlike the state of the art, PTS-CRC can satisfy reliability definitions beyond coverage. We experimentally validate the performance of PTS-CRC prediction and control by studying a number of use cases in the context of wireless networking.
  arXiv  Detail & Related papers  (2023-10-16T11:35:41Z)
• Incorporating Recklessness to Collaborative Filtering based Recommender Systems [42.956580283193176]
  recklessness takes into account the variance of the output probability distribution of the predicted ratings. Experimental results demonstrate that recklessness not only allows for risk regulation but also improves the quantity and quality of predictions.
  arXiv  Detail & Related papers  (2023-08-03T21:34:00Z)
• Safe Deployment for Counterfactual Learning to Rank with Exposure-Based Risk Minimization [63.93275508300137]
  We introduce a novel risk-aware Counterfactual Learning To Rank method with theoretical guarantees for safe deployment. Our experimental results demonstrate the efficacy of our proposed method, which is effective at avoiding initial periods of bad performance when little data is available.
  arXiv  Detail & Related papers  (2023-04-26T15:54:23Z)
• Learning Bounds for Risk-sensitive Learning [86.50262971918276]
  In risk-sensitive learning, one aims to find a hypothesis that minimizes a risk-averse (or risk-seeking) measure of loss. We study the generalization properties of risk-sensitive learning schemes whose optimand is described via optimized certainty equivalents.
  arXiv  Detail & Related papers  (2020-06-15T05:25:02Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.