High-Speed Vision-Based Flight in Clutter with Safety-Shielded Reinforcement Learning

• URL: http://arxiv.org/abs/2602.08653v1
• Date: Mon, 09 Feb 2026 13:47:02 GMT
• Title: High-Speed Vision-Based Flight in Clutter with Safety-Shielded Reinforcement Learning
• Abstract summary: We propose an end-to-end RL framework augmented with model-based safety mechanisms.<n>During training, we design a physics-informed reward structure that provides global navigational guidance.<n>During deployment, we integrate a real-time safety filter that projects the policy outputs onto a provably safe set to enforce strict collision-avoidance constraints.
• Score: 7.796497371549364
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Quadrotor unmanned aerial vehicles (UAVs) are increasingly deployed in complex missions that demand reliable autonomous navigation and robust obstacle avoidance. However, traditional modular pipelines often incur cumulative latency, whereas purely reinforcement learning (RL) approaches typically provide limited formal safety guarantees. To bridge this gap, we propose an end-to-end RL framework augmented with model-based safety mechanisms. We incorporate physical priors in both training and deployment. During training, we design a physics-informed reward structure that provides global navigational guidance. During deployment, we integrate a real-time safety filter that projects the policy outputs onto a provably safe set to enforce strict collision-avoidance constraints. This hybrid architecture reconciles high-speed flight with robust safety assurances. Benchmark evaluations demonstrate that our method outperforms both traditional planners and recent end-to-end obstacle avoidance approaches based on differentiable physics. Extensive experiments demonstrate strong generalization, enabling reliable high-speed navigation in dense clutter and challenging outdoor forest environments at velocities up to 7.5m/s.

Related papers

• Lightweight Safe Reinforcement Learning for End-to-End UAV Navigation [16.850454229093135]
  We propose a safety-constrained perception-control integrated framework for UAV navigation.<n>A lightweight network encodes sparse observations into collision-risk-aware features using asymmetric and depthwise separable convolutions.<n> Experiments with varying obstacle densities and flight speeds demonstrate higher success rates, improved safety, and better efficiency.
  arXiv  Detail & Related papers  (2026-07-02T07:12:24Z)
• Bridging Performance and Generalization in Reinforcement Learning for Agile Flight [26.465258512733126]
  We propose a framework for zero-shot generalization in agile flight for RL-based drone racing.<n>Our method achieves strong zero-shot performance across a wide range of unseen racetracks in the real world.
  arXiv  Detail & Related papers  (2026-06-25T17:54:36Z)
• Learning Reactive Dexterous Grasping via Hierarchical Task-Space RL Planning and Joint-Space QP Control [50.28263951510334]
  We propose a hybrid hierarchical control framework for reactive dexterous grasping.<n>The proposed framework explicitly decouples high-level spatial intent from low-level joint execution.<n>We extensively validate the proposed framework through a rigorous simulation-to-reality pipeline.
  arXiv  Detail & Related papers  (2026-05-05T04:49:38Z)
• OnFly: Onboard Zero-Shot Aerial Vision-Language Navigation toward Safety and Efficiency [9.769964979769204]
  We propose OnFly, a fully onboard, real-time framework for zero-shot AVLN.<n>OnFly adopts a shared-perception dual-agent architecture that decouples high-frequency target generation from low-frequency progress monitoring.<n>In simulation, OnFly improves task success from 26.4% to 67.8%, compared with the strongest state-of-the-art baseline.
  arXiv  Detail & Related papers  (2026-03-11T11:48:22Z)
• SEA-Nav: Efficient Policy Learning for Safe and Agile Quadruped Navigation in Cluttered Environments [16.354808611554805]
  SEA-Nav is a reinforcement learning framework for quadruped navigation.<n>A differentiable control barrier function (CBF)-based shield constraints the navigation policy to output safe velocity commands.<n> adaptive collision replay mechanism and hazardous exploration rewards are introduced to increase the probability of learning.
  arXiv  Detail & Related papers  (2026-03-10T10:13:49Z)
• BarrierSteer: LLM Safety via Learning Barrier Steering [83.12893815611052]
  BarrierSteer is a novel framework that formalizes safety by embedding learned non-linear safety constraints directly into the model's latent representation space.<n>We show that BarrierSteer substantially reduces adversarial success rates, decreases unsafe generations, and outperforms existing methods.
  arXiv  Detail & Related papers  (2026-02-23T18:19:46Z)
• Learning Agile Quadrotor Flight in the Real World [24.272916786375365]
  Learning-based controllers have achieved impressive performance in agile quadrotor flight but typically rely on massive training in simulation.<n>We propose a self-adaptive framework that eliminates the need for precise system identification or offline Sim2Real transfer.<n>We introduce Adaptive Temporal Scaling (ATS) to actively explore platform physical limits, and employ online residual learning to augment a simple nominal model.
  arXiv  Detail & Related papers  (2026-02-10T18:59:28Z)
• Q-realign: Piggybacking Realignment on Quantization for Safe and Efficient LLM Deployment [55.14890249389052]
  Existing defenses either embed safety recovery into fine-tuning or rely on fine-tuning-derived priors for post-hoc correction.<n>We propose textttQ-realign, a post-hoc defense method based on post-training quantization.<n>Our work provides a practical, turnkey solution for safety-aware deployment.
  arXiv  Detail & Related papers  (2026-01-13T00:07:24Z)
• Mastering Diverse, Unknown, and Cluttered Tracks for Robust Vision-Based Drone Racing [22.63301233637327]
  Most reinforcement learning methods for drone racing target fixed, obstacle-free tracks, leaving the generalization to unknown, cluttered environments largely unaddressed.<n>This challenge stems from the need to balance racing speed and collision avoidance, limited feasible space causing policy exploration trapped in local optima during training.<n>We propose a two-phase learning framework: an initial soft-collision training phase that preserves policy exploration for high-speed flight, followed by a hard-collision refinement phase that enforces robust obstacle avoidance.
  arXiv  Detail & Related papers  (2025-12-10T12:02:48Z)
• Trajectory Design for UAV-Based Low-Altitude Wireless Networks in Unknown Environments: A Digital Twin-Assisted TD3 Approach [62.11847362756054]
  Unmanned aerial vehicles (UAVs) are emerging as key enablers for low-altitude wireless network (LAWN)<n>We propose a digital twin (DT)-assisted training and deployment framework.<n>In this framework, the UAV transmits integrated sensing and communication signals to provide communication services to ground users, while simultaneously collecting echoes that are uploaded to the DT server to progressively construct virtual environments (VEs)<n>These VEs accelerate model training and are continuously updated with real-time UAV sensing data during deployment, supporting decision-making and enhancing flight safety.
  arXiv  Detail & Related papers  (2025-10-28T10:05:53Z)
• UpSafe$^\circ$C: Upcycling for Controllable Safety in Large Language Models [67.91151588917396]
  Large Language Models (LLMs) have achieved remarkable progress across a wide range of tasks, but remain vulnerable to safety risks such as harmful content generation and jailbreak attacks.<n>We propose UpSafe$circ$C, a unified framework for enhancing LLM safety through safety-aware upcycling.<n>Our results highlight a new direction for LLM safety: moving from static alignment toward dynamic, modular, and inference-aware control.
  arXiv  Detail & Related papers  (2025-10-02T16:43:33Z)
• NOVA: Navigation via Object-Centric Visual Autonomy for High-Speed Target Tracking in Unstructured GPS-Denied Environments [56.35569661650558]
  We introduce NOVA, a fully onboard, object-centric framework that enables robust target tracking and collision-aware navigation.<n>Rather than constructing a global map, NOVA formulates perception, estimation, and control entirely in the target's reference frame.<n>We validate NOVA across challenging real-world scenarios, including urban mazes, forest trails, and repeated transitions through buildings with intermittent GPS loss.
  arXiv  Detail & Related papers  (2025-06-23T14:28:30Z)
• Learned Controllers for Agile Quadrotors in Pursuit-Evasion Games [42.74003740156243]
  We address the problem of agile 1v1 quadrotor pursuit-evasion, where a pursuer and an evader learn to outmaneuver each other.<n>We propose an Asynchronous Multi-Stage Population-Based (AMSPB) algorithm to tackle these issues.<n>Within this framework, we train neural network controllers that output either velocity commands or body rates with collective thrust.
  arXiv  Detail & Related papers  (2025-06-03T13:19:23Z)
• Monocular Obstacle Avoidance Based on Inverse PPO for Fixed-wing UAVs [29.207513994002202]
  Fixed-wing Unmanned Aerial Vehicles (UAVs) are one of the most commonly used platforms for the Low-altitude Economy (LAE) and Urban Air Mobility (UAM)<n>Classical obstacle avoidance systems, which rely on prior maps or sophisticated sensors, face limitations in unknown low-altitude environments and small UAV platforms.<n>This paper proposes a lightweight deep reinforcement learning (DRL) based UAV collision avoidance system.
  arXiv  Detail & Related papers  (2024-11-27T03:03:37Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.