Learning Material-Aware Hamiltonian Risk Fields for Safe Navigation
- URL: http://arxiv.org/abs/2605.07038v1
- Date: Thu, 07 May 2026 23:33:34 GMT
- Title: Learning Material-Aware Hamiltonian Risk Fields for Safe Navigation
- Abstract summary: Policy should expose evasive degrees of freedom only when the local scene admits a lower-risk feasible maneuver.<n>We show that adding one context-energy term to a port-Hamiltonian navigation policy produces a learned force channel with exactly this falsifiable signature.
- Score: 4.023164329164762
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: Risk-aware navigation should be selective: a policy should expose evasive degrees of freedom only when the local scene admits a lower-risk feasible maneuver, and suppress them when no safer alternative exists. We show that adding one context-energy term to a port-Hamiltonian navigation policy produces a learned force channel with exactly this falsifiable signature. When the local risk field contains a feasible lower-risk direction, the induced context force activates toward it; when the apparent escape is blocked or not yet available, a route-aware gate suppresses lateral force rather than hallucinating an unsafe maneuver. A CVaR tail-risk objective focuses gradient updates on rare but consequential risk transitions. We validate the selectivity signature across four settings. In the primary delayed-required-escape benchmark, route-aware CVaR reduces premature force activation from 0.950 to 0.180 versus DWA while raising success from 0.480 to 0.810 with zero replans. On real off-road terrain (RELLIS-3D), route-aware enrichment achieves correct activation rate 0.837 and false activation rate 0.114, compared to 0.378/0.752 for scalar risk gradients. On static semantic maps (DFC2018), enrichment reduces catastrophic failure from 0.60 to 0.10 and oscillation by 90.7% while preserving path efficiency. In highway traffic, collisions drop from 100% to 0% when a lane escape is feasible; when no escape exists, the policy suppresses the lateral maneuver. The selectivity property follows from the gradient structure of the context energy rather than from training-time tuning.
Related papers
- Decoy Direction Optimization: A Post-Hoc Defense Against LLM Abliteration [37.700303596218184]
Safety guardrails in open-weight language models can be readily bypassed using Refusal Feature Ablation (RFA)<n>We introduce Decoy Direction Optimization (DDO), a fast, post-hoc weight-editing defense that requires no base-model finetuning.<n>We prove a spectral bound formalizing this effect and evaluate DDO across six model families, achieving 10% ASR under standard RFA.
arXiv Detail & Related papers (2026-09-14T18:36:35Z) - Adaptive Cost-Sensitive Machine Learning for Autonomous Robot Navigation Failure Prediction: When Not All Errors Are Equal [0.0]
A near-miss at low speed under reliable sensing is not equivalent to the same event during rapid motion, close obstacle approach or degraded perception.<n>This paper reframes navigation failure prediction as consequence-sensitive forecasting.<n>We evaluate on 2,000 simulated differential-drive episodes using episode-level GroupKFold.
arXiv Detail & Related papers (2026-09-04T17:45:51Z) - DriftGuard: Safety-Aware Multi-Monitor Detection and Selective Adaptation for Evolving Toxicity Moderation [0.6263481844384227]
This paper introduces DriftGuard, a safety-aware adaptive moderation framework that combines multi-monitor drift detection with selective model updating.<n>The framework tracks global text drift, identity-harm drift, model uncertainty, toxic-risk drift, and false-negative-risk drift.
arXiv Detail & Related papers (2026-06-27T04:10:45Z) - AEGIS: A Backup Reflex for Physical AI [0.0]
We introduce AEGIS, a selective escalation method that uses a lightweight probe on a weak policy's frozen activations to detect high-risk steps.<n>When the probe flags a step, control switches to a stronger separate policy, but only for the steps that need it.<n>On LIBERO-Spatial, AEGIS recovers 10.1% of the trajectories the weak policy alone loses, versus 4.6% for budget-matched blind escalation and 5.1% for a random-trigger placebo.
arXiv Detail & Related papers (2026-06-04T19:09:22Z) - SafeSeek: Universal Attribution of Safety Circuits in Language Models [49.59795225914787]
We propose ourmethod, a unified safety interpretability framework.<n>Our method identifies functionally complete safety circuits in Large Language Models.<n>We validate ourmethod in two key scenarios in LLM safety.
arXiv Detail & Related papers (2026-03-24T14:32:53Z) - Principled Steering via Null-space Projection for Jailbreak Defense in Vision-Language Models [71.11171576590134]
Vision-language models can be easily induced by visual jailbreak attacks to generate harmful content.<n>We propose NullSteer, a null-space projected activation defense framework.<n>We show that NullSteer significantly reduces harmful outputs under various jailbreak attacks.
arXiv Detail & Related papers (2026-03-23T15:23:23Z) - Fusing Driver Perceived and Physical Risk for Safety Critical Scenario Screening in Autonomous Driving [20.663269212781426]
We propose a driver risk fusion based hazardous scenario screening method for autonomous driving.<n>During training, the method combines an improved Driver Risk Field with a dynamic cost model to generate high quality risk supervision signals.<n>During inference it directly predicts scenario level risk scores through fast forward passes, avoiding per frame risk computation.
arXiv Detail & Related papers (2026-03-07T13:24:23Z) - RA-Nav: A Risk-Aware Navigation System Based on Semantic Segmentation for Aerial Robots in Unpredictable Environments [7.128475765820446]
Existing aerial robot navigation systems fail to adapt when a static obstacle suddenly moves.<n>We propose RA-Nav, a risk-aware navigation framework based on semantic segmentation.<n> RA-Nav achieves higher success rates than baselines in sudden obstacle state transition scenarios.
arXiv Detail & Related papers (2026-02-19T16:26:43Z) - BadCLIP++: Stealthy and Persistent Backdoors in Multimodal Contrastive Learning [73.46118996284888]
Research on backdoor attacks against multimodal contrastive learning models faces two key challenges: stealthiness and persistence.<n>We propose BadCLIP++, a unified framework that tackles both challenges.<n>For stealthiness, we introduce a semantic-fusion QR micro-trigger that embeds imperceptible patterns near task-relevant regions.<n>For persistence, we stabilize trigger embeddings via radius shrinkage and centroid alignment.
arXiv Detail & Related papers (2026-02-19T08:31:16Z) - Safety Alignment as Continual Learning: Mitigating the Alignment Tax via Orthogonal Gradient Projection [52.551864761088574]
Large Language Models (LLMs) often incur an alignment tax: safety post-training can reduce general utility.<n>We argue that this tax primarily arises from continual-learning-style forgetting in sequential alignment.<n>We propose Orthogonal Gradient Projection for Safety Alignment (OGPSA) to balance plasticity and stability.
arXiv Detail & Related papers (2026-02-08T09:53:46Z) - Risk-Aware Human-in-the-Loop Framework with Adaptive Intrusion Response for Autonomous Vehicles [9.818695109452861]
We present RAIL, a risk-aware human-in-the-loop framework for autonomous vehicles.<n>RAIL fuses three cues into an Intrusion Risk Score (IRS) via a weighted Noisy-OR.<n>On MetaDrive, RAIL achieves a Test Return (TR) of 360.65, a Test Success Rate (TSR) of 0.85, a Test Safety Violation (TSV) of 0.75, and a Disturbance Rate (DR) of 0.0027.
arXiv Detail & Related papers (2026-01-16T21:08:01Z) - Constrained Language Model Policy Optimization via Risk-aware Stepwise Alignment [49.2305683068875]
We propose Risk-aware Stepwise Alignment (RSA), a novel alignment method that incorporates risk awareness into the policy optimization process.<n> RSA mitigates risks induced by excessive model shift away from a reference policy, and it explicitly suppresses low-probability yet high-impact harmful behaviors.<n> Experimental results demonstrate that our method achieves high levels of helpfulness while ensuring strong safety.
arXiv Detail & Related papers (2025-12-30T14:38:02Z) - SafePath: Conformal Prediction for Safe LLM-Based Autonomous Navigation [67.22657932549723]
We introduce SafePath, a framework that augments Large Language Models (LLMs) with formal safety guarantees.<n>In the first stage, we use an LLM that generates a set of diverse candidate paths, exploring possible trajectories based on agent behaviors and environmental cues.<n>In the second stage, SafePath filters out high-risk trajectories while guaranteeing at least one safe option is included with a user-defined probability.<n>In the final stage, our approach selects the path with the lowest expected collision risk when uncertainty is low or delegates control to a human when uncertainty is high.
arXiv Detail & Related papers (2025-05-14T14:28:24Z) - Learn Zero-Constraint-Violation Policy in Model-Free Constrained
Reinforcement Learning [7.138691584246846]
We propose the safe set actor-critic (SSAC) algorithm, which confines the policy update using safety-oriented energy functions.
The safety index is designed to increase rapidly for potentially dangerous actions.
We claim that we can learn the energy function in a model-free manner similar to learning a value function.
arXiv Detail & Related papers (2021-11-25T07:24:30Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.