Conformal Risk-Averse Decision Making with Optimized Certainty Equivalent Risk Control

• URL: http://arxiv.org/abs/2608.28179v1
• Date: Fri, 28 Aug 2026 10:45:23 GMT
• Title: Conformal Risk-Averse Decision Making with Optimized Certainty Equivalent Risk Control
• Abstract summary: We study risk-averse decision making in which an agent selects actions while being uncertain about the true system state.<n>We characterize the optimal policy under known distributions, and show that it reduces to a prediction set-based solution for the CVaR.<n>For unknown distributions, we develop a data-driven calibration strategy, based on a synthetic model for the likelihood and held-out calibration data.
• Score: 31.006941545235396
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: We study risk-averse decision making, in which an agent selects actions while being uncertain about the true system state. The risk is measured via optimized certainty equivalent (OCE) metrics, which generalize popular criteria such as mean-variance risk and conditional value-at-risk (CVaR). We characterize the optimal policy under known distributions, and show that it reduces to a prediction set-based solution for the CVaR. This provides an operational interpretation of conformal prediction-type prediction sets. For unknown distributions, we develop a data-driven calibration strategy, based on a synthetic model for the likelihood and held-out calibration data, yielding high-probability control of the OCE risk. The approach is evaluated on two wireless beamforming settings.

Related papers

• Conformal Selective Prediction with General Risk Control [8.936337121607677]
  We propose a new framework for deriving such decisions for any trained model and any user-defined, bounded and continuously-valued risk.<n>SCoRE offers two types of guarantees on the risk among positive'' cases in which the system opts to trust the model.<n>We evaluate the proposed methods with simulations and demonstrate their efficacy through applications to error management in drug discovery, health risk prediction, and large language models.
  arXiv  Detail & Related papers  (2026-03-25T18:29:23Z)
• Constrained Language Model Policy Optimization via Risk-aware Stepwise Alignment [49.2305683068875]
  We propose Risk-aware Stepwise Alignment (RSA), a novel alignment method that incorporates risk awareness into the policy optimization process.<n> RSA mitigates risks induced by excessive model shift away from a reference policy, and it explicitly suppresses low-probability yet high-impact harmful behaviors.<n> Experimental results demonstrate that our method achieves high levels of helpfulness while ensuring strong safety.
  arXiv  Detail & Related papers  (2025-12-30T14:38:02Z)
• Conformal Risk Training: End-to-End Optimization of Conformal Risk Control [41.45834526675908]
  We introduce "conformal risk training," an end-to-end approach that differentiates through conformal OCE risk control during model training or fine-tuning.<n>Our method achieves provable risk guarantees while demonstrating significantly improved average-case performance over post-hoc approaches.
  arXiv  Detail & Related papers  (2025-10-09T19:05:45Z)
• Performative Risk Control: Calibrating Models for Reliable Deployment under Performativity [18.09405926516524]
  Calibrating machine learning models to achieve risk control is crucial to ensure reliable decision-making.<n>We introduce Performative Risk Control, a framework to calibrate models to achieve risk control under performativity.
  arXiv  Detail & Related papers  (2025-05-30T00:59:25Z)
• Mitigating optimistic bias in entropic risk estimation and optimization with an application to insurance [5.407319151576265]
  The entropic risk measure is widely used to account for tail risks associated with an uncertain loss.<n>To mitigate the bias in the empirical entropic risk estimator, we propose a strongly consistent bootstrapping procedure.<n>We show that our methods suggest a higher (and more accurate) premium to homeowners.
  arXiv  Detail & Related papers  (2024-09-30T04:02:52Z)
• Localized Adaptive Risk Control [35.88667386998423]
  Localized Adaptive Risk Control (L-ARC) is an online calibration scheme that targets statistical localized risk guarantees. L-ARC is demonstrated via experiments to produce prediction sets with risk guarantees across different data subpopulations.
  arXiv  Detail & Related papers  (2024-05-13T17:48:45Z)
• Data-Adaptive Tradeoffs among Multiple Risks in Distribution-Free Prediction [55.77015419028725]
  We develop methods that permit valid control of risk when threshold and tradeoff parameters are chosen adaptively. Our methodology supports monotone and nearly-monotone risks, but otherwise makes no distributional assumptions.
  arXiv  Detail & Related papers  (2024-03-28T17:28:06Z)
• Model-Based Epistemic Variance of Values for Risk-Aware Policy Optimization [59.758009422067]
  We consider the problem of quantifying uncertainty over expected cumulative rewards in model-based reinforcement learning. We propose a new uncertainty Bellman equation (UBE) whose solution converges to the true posterior variance over values. We introduce a general-purpose policy optimization algorithm, Q-Uncertainty Soft Actor-Critic (QU-SAC) that can be applied for either risk-seeking or risk-averse policy optimization.
  arXiv  Detail & Related papers  (2023-12-07T15:55:58Z)
• Likelihood Ratio Confidence Sets for Sequential Decision Making [51.66638486226482]
  We revisit the likelihood-based inference principle and propose to use likelihood ratios to construct valid confidence sequences. Our method is especially suitable for problems with well-specified likelihoods. We show how to provably choose the best sequence of estimators and shed light on connections to online convex optimization.
  arXiv  Detail & Related papers  (2023-11-08T00:10:21Z)
• Efficient Risk-Averse Reinforcement Learning [79.61412643761034]
  In risk-averse reinforcement learning (RL), the goal is to optimize some risk measure of the returns. We prove that under certain conditions this inevitably leads to a local-optimum barrier, and propose a soft risk mechanism to bypass it. We demonstrate improved risk aversion in maze navigation, autonomous driving, and resource allocation benchmarks.
  arXiv  Detail & Related papers  (2022-05-10T19:40:52Z)
• Learning Bounds for Risk-sensitive Learning [86.50262971918276]
  In risk-sensitive learning, one aims to find a hypothesis that minimizes a risk-averse (or risk-seeking) measure of loss. We study the generalization properties of risk-sensitive learning schemes whose optimand is described via optimized certainty equivalents.
  arXiv  Detail & Related papers  (2020-06-15T05:25:02Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.