Robust Tightly-Coupled Filter-Based Monocular Visual-Inertial State Estimation and Graph-Based Evaluation for Autonomous Drone Racing

• URL: http://arxiv.org/abs/2603.02742v1
• Date: Tue, 03 Mar 2026 08:43:49 GMT
• Title: Robust Tightly-Coupled Filter-Based Monocular Visual-Inertial State Estimation and Graph-Based Evaluation for Autonomous Drone Racing
• Abstract summary: We propose a robust visual-inertial estimation framework for autonomous drone racing.<n>The proposed system is validated using TII-RATM dataset, where ADR-VINS achieves an average RMS translation of 0.134 m, while ADR-FGO yields 0.060 m.<n>Finally, we introduce ADR-FGO for post-flight evaluation in uninstrumented racing environments.
• Score: 5.29147071389637
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Autonomous drone racing (ADR) demands state estimation that is simultaneously computationally efficient and resilient to the perceptual degradation experienced during extreme velocity and maneuvers. Traditional frameworks typically rely on conventional visual-inertial pipelines with loosely-coupled gate-based Perspective-n-Points (PnP) corrections that suffer from a rigid requirement for four visible features and information loss in intermediate steps. Furthermore, the absence of GNSS and Motion Capture systems in uninstrumented, competitive racing environments makes the objective evaluation of such systems remarkably difficult. To address these limitations, we propose ADR-VINS, a robust, monocular visual-inertial state estimation framework based on an Error-State Kalman Filter (ESKF) tailored for autonomous drone racing. Our approach integrates direct pixel reprojection errors from gate corners features as innovation terms within the filter. By bypassing intermediate PnP solvers, ADR-VINS maintains valid state updates with as few as two visible corners and utilizes robust reweighting instead of RANSAC-based schemes to handle outliers, enhancing computational efficiency. Furthermore, we introduce ADR-FGO, an offline Factor-Graph Optimization framework to generate high-fidelity reference trajectories that facilitate post-flight performance evaluation and analysis on uninstrumented, GNSS-denied environments. The proposed system is validated using TII-RATM dataset, where ADR-VINS achieves an average RMS translation error of 0.134 m, while ADR-FGO yields 0.060 m as a smoothing-based reference. Finally, ADR-VINS was successfully deployed in the A2RL Drone Championship Season 2, maintaining stable and robust estimation despite noisy detections during high-agility flight at top speeds of 20.9 m/s. We further utilize ADR-FGO for post-flight evaluation in uninstrumented racing environments.

Related papers

• A Neural Network Based Teleoperation for Remote Controlled Vehicles [98.38733381483934]
  Direct teleoperation of vehicles faces critical technical bottlenecks.<n> communication latency and the operator's inability to physically perceive unmodeled environmental disturbances.<n>We propose a tailored unilateral teleoperation framework.
  arXiv  Detail & Related papers  (2026-08-11T01:51:08Z)
• Flight-Ready LiDAR-Inertial Odometry for Embedded Drone Platforms [0.0]
  Open-source LiDAR-inertial odometry systems have achieved remarkable benchmark accuracy.<n>Current state-of-the-art implementations are primarily optimized for evaluation performance.
  arXiv  Detail & Related papers  (2026-07-24T09:44:29Z)
• Edge-Aware Thermal Infrared UAV Swarm Tracking [6.183623476895028]
  We propose an edge-aware online tracking pipeline centered on the Adaptive Kinematic Kalman Filter (AKKF)<n>AKKF augments the linear KF with state-dependent kinematic modeling while preserving real-time efficiency.<n> Experiments on the Beyond Strong Baseline benchmark provide a starting point for edge-aware UAV tracking.
  arXiv  Detail & Related papers  (2026-07-14T09:13:54Z)
• FAST-LIVGO: A Degeneracy-Robust LiDAR-Inertial-Visual-GNSS Fusion Odometry [14.641801914375163]
  State estimation and mapping in long-term, large-scale, and highly dynamic environments remains a key challenge in robotics.<n>Existing LiDAR-In-ertial-Visual Odometry (LIVO) systems achieve strong local accuracy but suffer from accumulated drift over long distances.<n>We propose a LiDAR-aided fusion framework based on an Error-State Iterated Kalman Filter to address these limitations.<n>Our system reduces accumulated drift and map ghosting, outperforming state-of-the-art methods in accuracy and robustness.
  arXiv  Detail & Related papers  (2026-06-17T15:33:11Z)
• Bench2Drive-Robust: Benchmarking Closed-Loop Autonomous Driving under Deployment Perturbations [122.22391796628408]
  We present Bench2Drive-Robust, to our knowledge the first device-centric robustness benchmark for closed-loop end-to-end autonomous driving.<n>We systematically evaluate deployment-oriented perturbations arising from three major sources: camera-stream failures, ego-state estimation errors, and compute-induced control delay.<n>Our results show that these deployment-related perturbations can substantially degrade closed-loop driving performance.
  arXiv  Detail & Related papers  (2026-05-18T08:45:24Z)
• PVRF: All-in-one Adverse Weather Removal via Prior-modulated and Velocity-constrained Rectified Flow [69.40969296005794]
  We propose a unified framework that integrates zero-shot soft weather perceptions with velocity-constrained rectified-flow refinement.<n>PVRF improves both fidelity and perceptual quality over state-of-the-art baselines.
  arXiv  Detail & Related papers  (2026-05-13T19:07:14Z)
• Instance-level Visual Active Tracking with Occlusion-Aware Planning [61.982298426203165]
  Visual Active Tracking (VAT) aims to control cameras to follow a target in 3D space.<n>VAT faces two key bottlenecks in real-world deployment: confusion from visually similar distractors and severe failure under occlusions.<n>We propose OA-VAT, a unified pipeline with three complementary modules.
  arXiv  Detail & Related papers  (2026-04-23T09:11:50Z)
• Intelligent Control of Differential Drive Robots Subject to Unmodeled Dynamics with EKF-based State Estimation [28.37226750522601]
  This work introduces a unified control and state estimation framework that combines a Lyapunov-based nonlinear controller and Adaptive Networks (ANN)<n>The proposed controller leverages the universal approximation property of neural networks to model unknown nonlinearities in real time.<n>To ensure robust state estimation, the EKF fuses inertial measurement unit (IMU) and odometry from monocular, 2D-LiDAR and wheel encoders.
  arXiv  Detail & Related papers  (2026-03-16T07:44:28Z)
• H-RINS: Hierarchical Tightly-coupled Radar-Inertial Navigation via Smoothing and Mapping [2.3821762993135507]
  Millimeter-wave radar provides robust perception in visually degraded environments.<n>Radar-inertial state estimation is inherently susceptible to drift.<n>We propose a tightly coupled, hierarchical radar-inertial factor graph framework.
  arXiv  Detail & Related papers  (2026-03-14T20:30:49Z)
• Consistent and Efficient MSCKF-based LiDAR-Inertial Odometry with Inferred Cluster-to-Plane Constraints for UAVs [46.21996481591401]
  This paper proposes a consistent and efficient LiDAR-Inertial Odometry framework tailored for UAVs.<n>By applying null-space projection to sliding-window coplanar constraints, we eliminate the direct dependency on feature parameters in the state vector.<n>It exhibits improved robustness in degenerate scenarios, achieves the lowest memory usage via its map-free nature, and runs in real-time on resource-constrained embedded platforms.
  arXiv  Detail & Related papers  (2026-03-13T11:09:50Z)
• ResAD: Normalized Residual Trajectory Modeling for End-to-End Autonomous Driving [64.42138266293202]
  ResAD is a Normalized Residual Trajectory Modeling framework.<n>It reframes the learning task to predict the residual deviation from an inertial reference.<n>On the NAVSIM benchmark, ResAD achieves a state-of-the-art PDMS of 88.6 using a vanilla diffusion policy.
  arXiv  Detail & Related papers  (2025-10-09T17:59:36Z)
• NOVA: Navigation via Object-Centric Visual Autonomy for High-Speed Target Tracking in Unstructured GPS-Denied Environments [56.35569661650558]
  We introduce NOVA, a fully onboard, object-centric framework that enables robust target tracking and collision-aware navigation.<n>Rather than constructing a global map, NOVA formulates perception, estimation, and control entirely in the target's reference frame.<n>We validate NOVA across challenging real-world scenarios, including urban mazes, forest trails, and repeated transitions through buildings with intermittent GPS loss.
  arXiv  Detail & Related papers  (2025-06-23T14:28:30Z)
• Monocular Obstacle Avoidance Based on Inverse PPO for Fixed-wing UAVs [29.207513994002202]
  Fixed-wing Unmanned Aerial Vehicles (UAVs) are one of the most commonly used platforms for the Low-altitude Economy (LAE) and Urban Air Mobility (UAM)<n>Classical obstacle avoidance systems, which rely on prior maps or sophisticated sensors, face limitations in unknown low-altitude environments and small UAV platforms.<n>This paper proposes a lightweight deep reinforcement learning (DRL) based UAV collision avoidance system.
  arXiv  Detail & Related papers  (2024-11-27T03:03:37Z)
• ReLoc-PDR: Visual Relocalization Enhanced Pedestrian Dead Reckoning via Graph Optimization [4.188058836787458]
  This work proposes ReLoc-PDR, a fusion framework combining pedestrian dead reckoning and visual relocalization. A graph optimization-based fusion mechanism with the Tukey kernel effectively corrects cumulative errors and mitigates the impact of abnormal visual observations. Real-world experiments demonstrate that our ReLoc-PDR surpasses representative methods in accuracy and robustness.
  arXiv  Detail & Related papers  (2023-09-04T14:54:47Z)
• Ultra-low Power Deep Learning-based Monocular Relative Localization Onboard Nano-quadrotors [64.68349896377629]
  This work presents a novel autonomous end-to-end system that addresses the monocular relative localization, through deep neural networks (DNNs), of two peer nano-drones. To cope with the ultra-constrained nano-drone platform, we propose a vertically-integrated framework, including dataset augmentation, quantization, and system optimizations. Experimental results show that our DNN can precisely localize a 10cm-size target nano-drone by employing only low-resolution monochrome images, up to 2m distance.
  arXiv  Detail & Related papers  (2023-03-03T14:14:08Z)
• Higher Performance Visual Tracking with Dual-Modal Localization [106.91097443275035]
  Visual Object Tracking (VOT) has synchronous needs for both robustness and accuracy. We propose a dual-modal framework for target localization, consisting of robust localization suppressingors via ONR and the accurate localization attending to the target center precisely via OFC.
  arXiv  Detail & Related papers  (2021-03-18T08:47:56Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.