Learning Agile Quadrotor Flight in the Real World
- URL: http://arxiv.org/abs/2602.10111v1
- Date: Tue, 10 Feb 2026 18:59:28 GMT
- Title: Learning Agile Quadrotor Flight in the Real World
- Abstract summary: Learning-based controllers have achieved impressive performance in agile quadrotor flight but typically rely on massive training in simulation.<n>We propose a self-adaptive framework that eliminates the need for precise system identification or offline Sim2Real transfer.<n>We introduce Adaptive Temporal Scaling (ATS) to actively explore platform physical limits, and employ online residual learning to augment a simple nominal model.
- Score: 24.272916786375365
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Learning-based controllers have achieved impressive performance in agile quadrotor flight but typically rely on massive training in simulation, necessitating accurate system identification for effective Sim2Real transfer. However, even with precise modeling, fixed policies remain susceptible to out-of-distribution scenarios, ranging from external aerodynamic disturbances to internal hardware degradation. To ensure safety under these evolving uncertainties, such controllers are forced to operate with conservative safety margins, inherently constraining their agility outside of controlled settings. While online adaptation offers a potential remedy, safely exploring physical limits remains a critical bottleneck due to data scarcity and safety risks. To bridge this gap, we propose a self-adaptive framework that eliminates the need for precise system identification or offline Sim2Real transfer. We introduce Adaptive Temporal Scaling (ATS) to actively explore platform physical limits, and employ online residual learning to augment a simple nominal model. {Based on the learned hybrid model, we further propose Real-world Anchored Short-horizon Backpropagation Through Time (RASH-BPTT) to achieve efficient and robust in-flight policy updates. Extensive experiments demonstrate that our quadrotor reliably executes agile maneuvers near actuator saturation limits. The system evolves a conservative base policy with a peak speed of 1.9 m/s to 7.3 m/s within approximately 100 seconds of flight time. These findings underscore that real-world adaptation serves not merely to compensate for modeling errors, but as a practical mechanism for sustained performance improvement in aggressive flight regimes.
Related papers
- DESCENT: Directed Edge Scene Encoding for Airport Surface Movement Prediction [54.94692733670454]
DESCENT is a transformer-based architecture designed to handle heterogeneous dynamics and strict topological constraints.<n>Our approach features a Potential Reachable Set (PRS) context sampling mechanism that adaptively collects airfield environment context.<n>Our evaluations on the Amelia-10 benchmark demonstrate significant performance improvements over state-of-the-art baselines.
arXiv Detail & Related papers (2026-08-26T16:49:50Z) - A Neural Network Based Teleoperation for Remote Controlled Vehicles [98.38733381483934]
Direct teleoperation of vehicles faces critical technical bottlenecks.<n> communication latency and the operator's inability to physically perceive unmodeled environmental disturbances.<n>We propose a tailored unilateral teleoperation framework.
arXiv Detail & Related papers (2026-08-11T01:51:08Z) - Learning to Throw: Agile and Accurate Cable-Suspended Payload Delivery with a Quadrotor [17.676294984292433]
Quadrotors offer the agility needed to rapidly transport suspended payloads during time-critical applications.<n>State-of-the-art approaches typically rely on model-based trajectory optimization and tracking.<n>We propose a hybrid simulation framework that couples a high-fidelity analytical quadrotor model with a physics solver for complex rope and payload interactions.
arXiv Detail & Related papers (2026-06-25T23:30:52Z) - Adaptive Outer-Loop Control of Quadrotors via Reinforcement Learning [7.213232880886576]
We propose a novel adaptive control architecture for quadrotor flight control.<n>First, we train an optimal outer-loop policy, then replace its reliance on ground-truth data with a Residual Dynamics Predictor.<n>For seamless hardware transfer, we introduce a data-efficient linear calibration bridge and an online thrust correction mechanism.
arXiv Detail & Related papers (2026-05-15T14:49:58Z) - Learning Reactive Dexterous Grasping via Hierarchical Task-Space RL Planning and Joint-Space QP Control [50.28263951510334]
We propose a hybrid hierarchical control framework for reactive dexterous grasping.<n>The proposed framework explicitly decouples high-level spatial intent from low-level joint execution.<n>We extensively validate the proposed framework through a rigorous simulation-to-reality pipeline.
arXiv Detail & Related papers (2026-05-05T04:49:38Z) - SLowRL: Safe Low-Rank Adaptation Reinforcement Learning for Locomotion [16.763723249971793]
We introduce SLowRL, a framework that combines Low-Rank Adaptation (LoRA) with training-time safety enforcement via a recovery policy.<n> Experimental results show that our method achieves a $46.5%$ reduction in fine-tuning time and near-zero safety violations.
arXiv Detail & Related papers (2026-03-17T19:26:48Z) - CycleRL: Sim-to-Real Deep Reinforcement Learning for Robust Autonomous Bicycle Control [10.350603824555408]
CycleRL is the first sim-to-real deep reinforcement learning framework for robust autonomous bicycle control.<n>In simulation, CycleRL achieves considerable performance, including a 99.90% balance success rate, a low steering tracking error of 1.15, and a velocity tracking error of 0.18 m/s.
arXiv Detail & Related papers (2026-03-16T09:17:51Z) - Reinforcement Learning-based Fault-Tolerant Control for Quadrotor with Online Transformer Adaptation [0.13499500088995461]
Multirotors play a significant role in diverse field robotics applications.<n>Previous approaches require prior knowledge of the multirotor model or struggle to adapt to new configurations.<n>We propose a novel hybrid RL-based FTC framework integrated with a transformer-based online adaptation module.
arXiv Detail & Related papers (2025-05-13T04:50:29Z) - A General Infrastructure and Workflow for Quadrotor Deep Reinforcement Learning and Reality Deployment [48.90852123901697]
We propose a platform that enables seamless transfer of end-to-end deep reinforcement learning (DRL) policies to quadrotors.<n>Our platform provides rich types of environments including hovering, dynamic obstacle avoidance, trajectory tracking, balloon hitting, and planning in unknown environments.
arXiv Detail & Related papers (2025-04-21T14:25:23Z) - Learning Speed Adaptation for Flight in Clutter [3.8876619768726157]
Animals learn to adapt speed of their movements to their capabilities and the environment they observe.
Mobile robots should also demonstrate this ability to trade-off aggressiveness and safety for efficiently accomplishing tasks.
This work is to endow flight vehicles with the ability of speed adaptation in prior unknown and partially observable cluttered environments.
arXiv Detail & Related papers (2024-03-07T15:30:54Z) - SAFE-SIM: Safety-Critical Closed-Loop Traffic Simulation with Diffusion-Controllable Adversaries [94.84458417662407]
We introduce SAFE-SIM, a controllable closed-loop safety-critical simulation framework.
Our approach yields two distinct advantages: 1) generating realistic long-tail safety-critical scenarios that closely reflect real-world conditions, and 2) providing controllable adversarial behavior for more comprehensive and interactive evaluations.
We validate our framework empirically using the nuScenes and nuPlan datasets across multiple planners, demonstrating improvements in both realism and controllability.
arXiv Detail & Related papers (2023-12-31T04:14:43Z) - DATT: Deep Adaptive Trajectory Tracking for Quadrotor Control [62.24301794794304]
Deep Adaptive Trajectory Tracking (DATT) is a learning-based approach that can precisely track arbitrary, potentially infeasible trajectories in the presence of large disturbances in the real world.
DATT significantly outperforms competitive adaptive nonlinear and model predictive controllers for both feasible smooth and infeasible trajectories in unsteady wind fields.
It can efficiently run online with an inference time less than 3.2 ms, less than 1/4 of the adaptive nonlinear model predictive control baseline.
arXiv Detail & Related papers (2023-10-13T12:22:31Z) - Sim-Anchored Learning for On-the-Fly Adaptation [45.123633153460034]
Fine-tuning simulation-trained RL agents with real-world data often degrades crucial behaviors due to limited or skewed data distributions.<n>We propose framing live-adaptation as a multi-objective optimization problem, where policy objectives must be satisfied both in simulation and reality.
arXiv Detail & Related papers (2023-01-17T16:16:53Z) - Model-Based Meta-Reinforcement Learning for Flight with Suspended
Payloads [69.21503033239985]
Transporting suspended payloads is challenging for autonomous aerial vehicles.
We propose a meta-learning approach that "learns how to learn" models of altered dynamics within seconds of post-connection flight data.
arXiv Detail & Related papers (2020-04-23T17:43:56Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.