Dynamic Control Barrier Function Regulation with Vision-Language Models for Safe, Adaptive, and Realtime Visual Navigation

• URL: http://arxiv.org/abs/2603.21142v1
• Date: Sun, 22 Mar 2026 09:35:18 GMT
• Title: Dynamic Control Barrier Function Regulation with Vision-Language Models for Safe, Adaptive, and Realtime Visual Navigation
• Abstract summary: We present AlphaAdj, a vision-to-control navigation framework that uses egocentric RGB input to adapt the conservativeness of a CBF safety filter in real time.<n>Results show that AlphaAdj maintains collision-free navigation while improving efficiency (in terms of path length and time to goal) by up to 18.5% relative to fixed settings.
• Score: 5.268770735910558
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Robots operating in dynamic, unstructured environments must balance safety and efficiency under potentially limited sensing. While control barrier functions (CBFs) provide principled collision avoidance via safety filtering, their behavior is often governed by fixed parameters that can be overly conservative in benign scenes or overly permissive near hazards. We present AlphaAdj, a vision-to-control navigation framework that uses egocentric RGB input to adapt the conservativeness of a CBF safety filter in real time. A vision-language model(VLM) produces a bounded scalar risk estimate from the current camera view, which we map to dynamically update a CBF parameter that modulates how strongly safety constraints are enforced. To address asynchronous inference and non-trivial VLM latency in practice, we combine a geometric, speed-aware dynamic cap and a staleness-gated fusion policy with lightweight implementation choices that reduce end-to-end inference overhead. We evaluate AlphaAdj across multiple static and dynamic obstacle scenarios in a variety of environments, comparing against fixed-parameter and uncapped ablations. Results show that AlphaAdj maintains collision-free navigation while improving efficiency (in terms of path length and time to goal) by up to 18.5% relative to fixed settings and improving robustness and success rate relative to an uncapped baseline.

Related papers

• Safety-Critical Whole-Body Control for Humanoid Robots via Input-to-State Safe Control Barrier Functions [6.59514190732471]
  This paper presents a hierarchical safety-critical whole-body control framework for humanoid robots.<n>The proposed architecture integrates a kinematic-level whole-body controller (KinWBC), an ISSf-CBF safety filter, and a dynamic-level whole-body controller (DynWBC)
  arXiv  Detail & Related papers  (2026-05-25T08:02:30Z)
• Reactive Robot-Centric Safety for Autonomous Navigation in Constrained and Dynamic Environments [14.321190258774358]
  We present a real-time control architecture that integrates a 3D LIDAR perception-based composite control barrier function.<n>We validate the system through multiple field experiments in underground environments.
  arXiv  Detail & Related papers  (2026-05-15T09:42:13Z)
• Robust Cross-Domain WiFi Fall Detection via Physics-Driven Attention-Enhanced Transformers [64.35403680946182]
  Device-free fall detection utilizing WiFi Channel State Information (CSI) has emerged as a promising solution for elderly health monitoring.<n>Existing deep learning approaches suffer from severe performance degradation when deployed in unseen environments.<n>We propose a robust, domain-general framework featuring a novel Attention-Enhanced CNN-Transformer hybrid architecture.
  arXiv  Detail & Related papers  (2026-04-23T03:28:12Z)
• OnFly: Onboard Zero-Shot Aerial Vision-Language Navigation toward Safety and Efficiency [9.769964979769204]
  We propose OnFly, a fully onboard, real-time framework for zero-shot AVLN.<n>OnFly adopts a shared-perception dual-agent architecture that decouples high-frequency target generation from low-frequency progress monitoring.<n>In simulation, OnFly improves task success from 26.4% to 67.8%, compared with the strongest state-of-the-art baseline.
  arXiv  Detail & Related papers  (2026-03-11T11:48:22Z)
• BarrierSteer: LLM Safety via Learning Barrier Steering [83.12893815611052]
  BarrierSteer is a novel framework that formalizes safety by embedding learned non-linear safety constraints directly into the model's latent representation space.<n>We show that BarrierSteer substantially reduces adversarial success rates, decreases unsafe generations, and outperforms existing methods.
  arXiv  Detail & Related papers  (2026-02-23T18:19:46Z)
• Designing Control Barrier Function via Probabilistic Enumeration for Safe Reinforcement Learning Navigation [55.02966123945644]
  We propose a hierarchical control framework leveraging neural network verification techniques to design control barrier functions (CBFs) and policy correction mechanisms.<n>Our approach relies on probabilistic enumeration to identify unsafe regions of operation, which are then used to construct a safe CBF-based control layer.<n>These experiments demonstrate the ability of the proposed solution to correct unsafe actions while preserving efficient navigation behavior.
  arXiv  Detail & Related papers  (2025-04-30T13:47:25Z)
• Soft Actor-Critic-based Control Barrier Adaptation for Robust Autonomous Navigation in Unknown Environments [4.788163807490197]
  We propose a Soft Actor-Critic (SAC)-based policy for adapting Control Barrier Function (CBF) constraint parameters at runtime.<n>We demonstrate that our framework effectively adapts CBF constraints, enabling the robot to reach its final goal without compromising safety.
  arXiv  Detail & Related papers  (2025-03-11T14:33:55Z)
• Multi-Modality Driven LoRA for Adverse Condition Depth Estimation [61.525312117638116]
  We propose Multi-Modality Driven LoRA (MMD-LoRA) for Adverse Condition Depth Estimation.<n>It consists of two core components: Prompt Driven Domain Alignment (PDDA) and Visual-Text Consistent Contrastive Learning (VTCCL)<n>It achieves state-of-the-art performance on the nuScenes and Oxford RobotCar datasets.
  arXiv  Detail & Related papers  (2024-12-28T14:23:58Z)
• ASMA: An Adaptive Safety Margin Algorithm for Vision-Language Drone Navigation via Scene-Aware Control Barrier Functions [9.645098673995317]
  We consider a VLN-operated drone platform and enhance its safety by formulating a novel scene-aware CBF.<n>A CBF-less baseline system uses a Vision-Language with cross-modal attention to convert commands into an ordered sequence of landmarks.<n>ASMA tracks moving objects and performs scene-aware CBF evaluation on-the-fly, which serves as an additional constraint.
  arXiv  Detail & Related papers  (2024-09-16T13:44:50Z)
• BarrierNet: A Safety-Guaranteed Layer for Neural Networks [50.86816322277293]
  BarrierNet allows the safety constraints of a neural controller be adaptable to changing environments. We evaluate them on a series of control problems such as traffic merging and robot navigations in 2D and 3D space.
  arXiv  Detail & Related papers  (2021-11-22T15:38:11Z)
• Learning Robust Output Control Barrier Functions from Safe Expert Demonstrations [50.37808220291108]
  This paper addresses learning safe output feedback control laws from partial observations of expert demonstrations. We first propose robust output control barrier functions (ROCBFs) as a means to guarantee safety. We then formulate an optimization problem to learn ROCBFs from expert demonstrations that exhibit safe system behavior.
  arXiv  Detail & Related papers  (2021-11-18T23:21:00Z)
• Learning Control Barrier Functions from Expert Demonstrations [69.23675822701357]
  We propose a learning based approach to safe controller synthesis based on control barrier functions (CBFs) We analyze an optimization-based approach to learning a CBF that enjoys provable safety guarantees under suitable Lipschitz assumptions on the underlying dynamical system. To the best of our knowledge, these are the first results that learn provably safe control barrier functions from data.
  arXiv  Detail & Related papers  (2020-04-07T12:29:06Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.