Distribution-Free Risk-Aware Planning and Control Under Uncertainty Using Conformal Spectral Risk Control
- URL: http://arxiv.org/abs/2606.04185v1
- Date: Tue, 02 Jun 2026 20:07:56 GMT
- Title: Distribution-Free Risk-Aware Planning and Control Under Uncertainty Using Conformal Spectral Risk Control
- Abstract summary: We propose a risk-aware model predictive control (RA-MPC) framework that incorporates prediction sets to guarantee risk control below a user-specified threshold.<n>We show that incorporating the prediction sets into the MPC framework provides statistical safety guarantees in terms of spectral risk constraint satisfaction even under uncertainty misspecification.
- Score: 1.9551668880584971
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Safe navigation in dynamic and uncertain environments often relies on accurate estimation of, or assumptions about, the true underlying uncertainty. However, accurately characterizing the true uncertainty distribution is often difficult due to limited data or imperfect information. An incorrect understanding of the uncertainty and its associated risk may lead to dangerous decisions even under high levels of risk aversion. To address this issue, we propose a risk-aware model predictive control (RA-MPC) framework that incorporates prediction sets to guarantee risk control below a user-specified threshold without requiring assumptions about the underlying uncertainty distribution. To generate the prediction sets, we develop a distribution-free risk quantification framework that extends conformal risk control (CRC) to general spectral risk measures. We then show that incorporating the prediction sets into the MPC framework provides statistical safety guarantees in terms of spectral risk constraint satisfaction even under uncertainty misspecification. We validate the proposed framework in simulated vehicle obstacle avoidance scenarios, demonstrating improved safety and reduced solve time compared to a baseline RA-MPC framework.
Related papers
- Conformal Risk-Averse Decision Making with Optimized Certainty Equivalent Risk Control [31.006941545235396]
We study risk-averse decision making in which an agent selects actions while being uncertain about the true system state.<n>We characterize the optimal policy under known distributions, and show that it reduces to a prediction set-based solution for the CVaR.<n>For unknown distributions, we develop a data-driven calibration strategy, based on a synthetic model for the likelihood and held-out calibration data.
arXiv Detail & Related papers (2026-08-28T10:45:23Z) - Capability Minimization as a Safety Primitive: Risk-Aware Causal Gating for Least-Privilege LLM Agents [0.0]
Risk-Aware Causal Gating (RACG) is a framework that decides whether to act on, defer, or abstain from a model's prediction.<n>RACG models the causal pathway from candidate actions to outcomes and gates each decision according to an estimated counterfactual risk.<n>We show that RACG reduces high-cost errors substantially while preserving most of the utility of an ungated policy.
arXiv Detail & Related papers (2026-06-11T20:19:35Z) - Action-Conditioned Risk Gating for Safety-Critical Control under Partial Observability [79.08785366532287]
We propose a lightweight risk-gated reinforcement learning approximation for risk-sensitive control under partial observability.<n>We evaluate the approach in two safety-critical partially observable domains: automated glucose regulation and safety-constrained navigation.
arXiv Detail & Related papers (2026-05-14T01:23:09Z) - Uncertainty-Aware Vision-based Risk Object Identification via Conformal Risk Tube Prediction [7.840136094141999]
Existing approaches make decisions and ignore uncertainty, which could lead to safety-critical failures.<n>Despite these challenges, current methods lack principled framework to model risk uncertainty jointly across space and time.<n>We propose Conformal Risk Prediction unified formulation that captures principled risk uncertainty, provides coverage guarantees for true risks, and produces calibrated risk scores with uncertainty estimates.
arXiv Detail & Related papers (2026-03-25T04:13:42Z) - Conformal Thinking: Risk Control for Reasoning on a Compute Budget [60.65072883773352]
Reasoning Large Language Models (LLMs) enable test-time scaling, with dataset-level accuracy improving as the token budget increases.<n>We re-frame the budget setting problem as risk control, limiting the error rate while minimizing compute.<n>Our framework introduces an upper threshold that stops reasoning when the model is confident and a novel lower threshold that preemptively stops unsolvable instances.
arXiv Detail & Related papers (2026-02-03T18:17:22Z) - Constrained Language Model Policy Optimization via Risk-aware Stepwise Alignment [49.2305683068875]
We propose Risk-aware Stepwise Alignment (RSA), a novel alignment method that incorporates risk awareness into the policy optimization process.<n> RSA mitigates risks induced by excessive model shift away from a reference policy, and it explicitly suppresses low-probability yet high-impact harmful behaviors.<n> Experimental results demonstrate that our method achieves high levels of helpfulness while ensuring strong safety.
arXiv Detail & Related papers (2025-12-30T14:38:02Z) - Conformal Risk Training: End-to-End Optimization of Conformal Risk Control [41.45834526675908]
We introduce "conformal risk training," an end-to-end approach that differentiates through conformal OCE risk control during model training or fine-tuning.<n>Our method achieves provable risk guarantees while demonstrating significantly improved average-case performance over post-hoc approaches.
arXiv Detail & Related papers (2025-10-09T19:05:45Z) - On Continuous Monitoring of Risk Violations under Unknown Shift [46.65571623109494]
We propose a general framework for the real-time monitoring of risk violations in evolving data streams.<n>Our method operates under minimal assumptions on the nature of encountered shifts.<n>We illustrate the effectiveness of our approach by monitoring risks in outlier detection and set prediction under a variety of shifts.
arXiv Detail & Related papers (2025-06-19T15:52:24Z) - SConU: Selective Conformal Uncertainty in Large Language Models [59.25881667640868]
We propose a novel approach termed Selective Conformal Uncertainty (SConU)<n>We develop two conformal p-values that are instrumental in determining whether a given sample deviates from the uncertainty distribution of the calibration set at a specific manageable risk level.<n>Our approach not only facilitates rigorous management of miscoverage rates across both single-domain and interdisciplinary contexts, but also enhances the efficiency of predictions.
arXiv Detail & Related papers (2025-04-19T03:01:45Z) - Data-Adaptive Tradeoffs among Multiple Risks in Distribution-Free Prediction [55.77015419028725]
We develop methods that permit valid control of risk when threshold and tradeoff parameters are chosen adaptively.
Our methodology supports monotone and nearly-monotone risks, but otherwise makes no distributional assumptions.
arXiv Detail & Related papers (2024-03-28T17:28:06Z) - From Risk to Uncertainty: Generating Predictive Uncertainty Measures via Bayesian Estimation [5.355925496689674]
We build a framework that allows one to generate different predictive uncertainty measures.<n>We validate our method on image datasets by evaluating its performance in detecting out-of-distribution and misclassified instances.
arXiv Detail & Related papers (2024-02-16T14:40:22Z) - Risk Sensitive Model-Based Reinforcement Learning using Uncertainty
Guided Planning [0.0]
In this paper, risk sensitivity is promoted in a model-based reinforcement learning algorithm.
We propose uncertainty guided cross-entropy method planning, which penalises action sequences that result in high variance state predictions.
Experiments display the ability for the agent to identify uncertain regions of the state space during planning and to take actions that maintain the agent within high confidence areas.
arXiv Detail & Related papers (2021-11-09T07:28:00Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.