MonoRace: Winning Champion-Level Drone Racing with Robust Monocular AI

• URL: http://arxiv.org/abs/2601.15222v1
• Date: Wed, 21 Jan 2026 17:53:29 GMT
• Title: MonoRace: Winning Champion-Level Drone Racing with Robust Monocular AI
• Abstract summary: We present MonoRace: an onboard drone racing approach that uses a monocular, rolling-shutter camera and IMU.<n>The approach features robust state estimation that combines neural-network-based gate segmentation with a drone model.<n>It set a new milestone in autonomous drone racing research, reaching speeds up to 100 km/h on the competition track.
• Score: 13.099050406993323
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Autonomous drone racing represents a major frontier in robotics research. It requires an Artificial Intelligence (AI) that can run on board light-weight flying robots under tight resource and time constraints, while pushing the physical system to its limits. The state of the art in this area consists of a system with a stereo camera and an inertial measurement unit (IMU) that beat human drone racing champions in a controlled indoor environment. Here, we present MonoRace: an onboard drone racing approach that uses a monocular, rolling-shutter camera and IMU that generalizes to a competition environment without any external motion tracking system. The approach features robust state estimation that combines neural-network-based gate segmentation with a drone model. Moreover, it includes an offline optimization procedure that leverages the known geometry of gates to refine any state estimation parameter. This offline optimization is based purely on onboard flight data and is important for fine-tuning the vital external camera calibration parameters. Furthermore, the guidance and control are performed by a neural network that foregoes inner loop controllers by directly sending motor commands. This small network runs on the flight controller at 500Hz. The proposed approach won the 2025 Abu Dhabi Autonomous Drone Racing Competition (A2RL), outperforming all competing AI teams and three human world champion pilots in a direct knockout tournament. It set a new milestone in autonomous drone racing research, reaching speeds up to 100 km/h on the competition track and successfully coping with problems such as camera interference and IMU saturation.

Related papers

• Drift-Corrected Monocular VIO and Perception-Aware Planning for Autonomous Drone Racing [4.932181263869029]
  The Abu Dhabi Autonomous Racing League(A2RL) x Drone Champions League competition requires teams to perform high-speed autonomous drone racing using only a single camera and a low-quality inertial measurement unit.<n>This paper presents the system developed for the championship, which achieved a competitive performance.<n>A perception-aware planner generated trajectories that balance speed with the need to keep gates visible for the perception system.
  arXiv  Detail & Related papers  (2025-12-23T16:12:10Z)
• Learning Sim-to-Real Humanoid Locomotion in 15 Minutes [51.500643119683225]
  We introduce a simple and practical recipe based on off-policy RL algorithms, i.e., FastSAC and FastTD3.<n>Our simple recipe stabilizes off-policy RL algorithms at massive scale with thousands of parallel environments.<n>We demonstrate rapid end-to-end learning of humanoid locomotion controllers on Unitree G1 and Booster T1 robots.
  arXiv  Detail & Related papers  (2025-12-01T18:55:17Z)
• AI and Vision based Autonomous Navigation of Nano-Drones in Partially-Known Environments [8.595976385391896]
  This work focuses on enabling the safe and autonomous flight of a pocket-size, 30-gram platform called Crazyflie 2.1.<n>We propose a novel AI-aided, vision-based reactive planning method for obstacle avoidance under the ambit of Integrated Sensing, Computing and Communication paradigm.<n>We show the ability to command the drone at $sim8$ frames-per-second and a model performance reaching a COCO mean-average-precision of $60.8$.
  arXiv  Detail & Related papers  (2025-05-08T06:16:36Z)
• Fast and Modular Autonomy Software for Autonomous Racing Vehicles [24.2222961043227]
  The Indy Autonomous Challenge (IAC) is an international competition aiming to advance autonomous vehicle development. This paper details the MIT-Pitt-RW Team's approach to autonomous racing in the IAC. We present our modular and fast approach to agent detection, motion planning and controls to create an autonomy stack.
  arXiv  Detail & Related papers  (2024-08-27T21:57:16Z)
• Reaching the Limit in Autonomous Racing: Optimal Control versus Reinforcement Learning [66.10854214036605]
  A central question in robotics is how to design a control system for an agile mobile robot. We show that a neural network controller trained with reinforcement learning (RL) outperformed optimal control (OC) methods in this setting. Our findings allowed us to push an agile drone to its maximum performance, achieving a peak acceleration greater than 12 times the gravitational acceleration and a peak velocity of 108 kilometers per hour.
  arXiv  Detail & Related papers  (2023-10-17T02:40:27Z)
• The 7th AI City Challenge [87.23137854688389]
  The AI City Challenge's seventh edition emphasizes two domains at the intersection of computer vision and artificial intelligence. The 2023 challenge had five tracks, which drew a record-breaking number of participation requests from 508 teams across 46 countries. The participating teams' top performances established strong baselines and even outperformed the state-of-the-art in the proposed challenge tracks.
  arXiv  Detail & Related papers  (2023-04-15T08:02:16Z)
• Learning a Single Near-hover Position Controller for Vastly Different Quadcopters [56.37274861303324]
  This paper proposes an adaptive near-hover position controller for quadcopters. It can be deployed to quadcopters of very different mass, size and motor constants. It also shows rapid adaptation to unknown disturbances during runtime.
  arXiv  Detail & Related papers  (2022-09-19T17:55:05Z)
• Indy Autonomous Challenge -- Autonomous Race Cars at the Handling Limits [81.22616193933021]
  The team TUM Auton-omous Motorsports will participate in the Indy Autonomous Challenge in Octo-ber 2021. It will benchmark its self-driving software-stack by racing one out of ten autonomous Dallara AV-21 racecars at the Indianapolis Motor Speedway. It is an ideal testing ground for the development of autonomous driving algorithms capable of mastering the most challenging and rare situations.
  arXiv  Detail & Related papers  (2022-02-08T11:55:05Z)
• The Artificial Intelligence behind the winning entry to the 2019 AI Robotic Racing Competition [5.379463265037841]
  We present the winning solution of the first AI Robotic Racing (AIRR) Circuit. Our approach has a large focus on gate detection with an efficient deep neural segmentation network and active vision. Although our solution was the fastest and most robust, it still lost against one of the best human pilots, Gab707.
  arXiv  Detail & Related papers  (2021-09-30T10:32:23Z)
• AlphaPilot: Autonomous Drone Racing [47.205375478625776]
  The system has successfully been deployed at the first autonomous drone racing world championship: the 2019 AlphaPilot Challenge. The proposed system has been demonstrated to successfully guide the drone through tight race courses reaching speeds up to 8m/s.
  arXiv  Detail & Related papers  (2020-05-26T15:45:05Z)
• AirSim Drone Racing Lab [56.68291351736057]
  AirSim Drone Racing Lab is a simulation framework for enabling machine learning research in this domain. Our framework enables generation of racing tracks in multiple photo-realistic environments. We used our framework to host a simulation based drone racing competition at NeurIPS 2019.
  arXiv  Detail & Related papers  (2020-03-12T08:06:06Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.