Dual Pose-Graph Semantic Localization for Vision-Based Autonomous Drone Racing
- URL: http://arxiv.org/abs/2604.15168v1
- Date: Thu, 16 Apr 2026 15:47:15 GMT
- Title: Dual Pose-Graph Semantic Localization for Vision-Based Autonomous Drone Racing
- Abstract summary: Existing visual SLAM systems struggle with motion blur and feature instability inherent to racing dynamics.<n>We present a dual pose-graph architecture that fuses odometry with semantic detections for robust localization.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Autonomous drone racing demands robust real-time localization under extreme conditions: high-speed flight, aggressive maneuvers, and payload-constrained platforms that often rely on a single camera for perception. Existing visual SLAM systems, while effective in general scenarios, struggle with motion blur and feature instability inherent to racing dynamics, and do not exploit the structured nature of racing environments. In this work, we present a dual pose-graph architecture that fuses odometry with semantic detections for robust localization. A temporary graph accumulates multiple gate observations between keyframes and optimizes them into a single refined constraint per landmark, which is then promoted to a persistent main graph. This design preserves the information richness of frequent detections while preventing graph growth from degrading real-time performance. The system is designed to be sensor-agnostic, although in this work we validate it using monocular visual-inertial odometry and visual gate detections. Experimental evaluation on the TII-RATM dataset shows a 56% to 74% reduction in ATE compared to standalone VIO, while an ablation study confirms that the dual-graph architecture achieves 10% to 12% higher accuracy than a single-graph baseline at identical computational cost. Deployment in the A2RL competition demonstrated that the system performs real-time onboard localization during flight, reducing the drift of the odometry baseline by up to 4.2 m per lap.
Related papers
- A Height-Constrained 2-Point Minimal Solver for Pose Estimation from Active LED Markers with Event Cameras [51.7262911415172]
We develop an event-based active marker system to collect real-world data with ground truth from a motion capture system.<n>Experiments on both synthetic and real data demonstrate improved accuracy over the state-of-the-art P2P solver.
arXiv Detail & Related papers (2026-08-10T12:19:24Z) - OrthoTrack: Continuous 6-DoF UAV Trajectory Estimation Anchored in Public Orthophotos [76.81099730054356]
We present OrthoTrack, a training-free system that estimates continuous 6-DoF trajectories using only publicly available orthophotos and surface models as a map prior.<n>On MovingDrone and real-world benchmarks, OrthoTrack runs in real time on a single GPU. It outperforms all baselines by a large margin, even those receiving oracle scale and alignment.
arXiv Detail & Related papers (2026-06-24T00:05:01Z) - Event-based SLAM Benchmark for High-Speed Maneuvers [68.148886127117]
Event-based cameras are bio-inspired sensors with pixels that independently and asynchronously respond to brightness changes at microsecond resolution.<n>Existing event-based approaches, although successful in mitigating motion blur caused by high-speed maneuvers, suffer from many limitations.<n>We introduce a benchmarking framework for event-based state estimation, called EvSLAM, characterized by sufficient variation in data collection platforms.
arXiv Detail & Related papers (2026-04-27T04:36:41Z) - H-RINS: Hierarchical Tightly-coupled Radar-Inertial Navigation via Smoothing and Mapping [2.3821762993135507]
Millimeter-wave radar provides robust perception in visually degraded environments.<n>Radar-inertial state estimation is inherently susceptible to drift.<n>We propose a tightly coupled, hierarchical radar-inertial factor graph framework.
arXiv Detail & Related papers (2026-03-14T20:30:49Z) - Robust Tightly-Coupled Filter-Based Monocular Visual-Inertial State Estimation and Graph-Based Evaluation for Autonomous Drone Racing [5.29147071389637]
We propose a robust visual-inertial estimation framework for autonomous drone racing.<n>The proposed system is validated using TII-RATM dataset, where ADR-VINS achieves an average RMS translation of 0.134 m, while ADR-FGO yields 0.060 m.<n>Finally, we introduce ADR-FGO for post-flight evaluation in uninstrumented racing environments.
arXiv Detail & Related papers (2026-03-03T08:43:49Z) - A2VISR: An Active and Adaptive Ground-Aerial Localization System Using Visual Inertial and Single-Range Fusion [17.59898575353575]
It's a practical approach using the ground-aerial collaborative system to enhance the localization robustness of flying robots in cluttered environments.<n>We improve the ground-aerial localization framework in a more comprehensive manner, which integrates active vision, single-ranging, inertialometry, and optical flow.<n>The proposed approach achieves robust online localization, with an average root mean square error of approximately 0.09 m, while maintaining resilience to capture loss and sensor failures.
arXiv Detail & Related papers (2025-12-18T10:07:06Z) - Expert Switching for Robust AAV Landing: A Dual-Detector Framework in Simulation [0.0]
Two YOLOv8 experts are trained on scale-specialized versions of the HelipadCat dataset.<n>During inference, both experts operate in parallel, and a geometric gating mechanism selects the expert whose prediction is most consistent with the AAV's viewpoint.<n>Results show substantial improvements in alignment, landing accuracy, and overall robustness compared to single-detector baselines.
arXiv Detail & Related papers (2025-12-16T03:41:59Z) - Event-based Graph Representation with Spatial and Motion Vectors for Asynchronous Object Detection [20.537672896807063]
Event-based sensors offer high temporal resolution and irregular latency.<n> converting this data into dense tensors for use in standard neural networks diminishes these inherent advantages.<n>We propose a novel multitemporal representation to better capture spatial structure and temporal changes.
arXiv Detail & Related papers (2025-07-20T23:02:23Z) - Detecting Anomalies in Dynamic Graphs via Memory enhanced Normality [39.476378833827184]
Anomaly detection in dynamic graphs presents a significant challenge due to the temporal evolution of graph structures and attributes.
We introduce a novel spatial- temporal memories-enhanced graph autoencoder (STRIPE)
STRIPE significantly outperforms existing methods with 5.8% improvement in AUC scores and 4.62X faster in training time.
arXiv Detail & Related papers (2024-03-14T02:26:10Z) - Recurrent Vision Transformers for Object Detection with Event Cameras [62.27246562304705]
We present Recurrent Vision Transformers (RVTs), a novel backbone for object detection with event cameras.
RVTs can be trained from scratch to reach state-of-the-art performance on event-based object detection.
Our study brings new insights into effective design choices that can be fruitful for research beyond event-based vision.
arXiv Detail & Related papers (2022-12-11T20:28:59Z) - Correlating sparse sensing for large-scale traffic speed estimation: A
Laplacian-enhanced low-rank tensor kriging approach [76.45949280328838]
We propose a Laplacian enhanced low-rank tensor (LETC) framework featuring both lowrankness and multi-temporal correlations for large-scale traffic speed kriging.
We then design an efficient solution algorithm via several effective numeric techniques to scale up the proposed model to network-wide kriging.
arXiv Detail & Related papers (2022-10-21T07:25:57Z) - Vision in adverse weather: Augmentation using CycleGANs with various
object detectors for robust perception in autonomous racing [70.16043883381677]
In autonomous racing, the weather can change abruptly, causing significant degradation in perception, resulting in ineffective manoeuvres.
In order to improve detection in adverse weather, deep-learning-based models typically require extensive datasets captured in such conditions.
We introduce an approach of using synthesised adverse condition datasets in autonomous racing (generated using CycleGAN) to improve the performance of four out of five state-of-the-art detectors.
arXiv Detail & Related papers (2022-01-10T10:02:40Z) - Spatio-temporal Modeling for Large-scale Vehicular Networks Using Graph
Convolutional Networks [110.80088437391379]
A graph-based framework called SMART is proposed to model and keep track of the statistics of vehicle-to-temporal (V2I) communication latency across a large geographical area.
We develop a graph reconstruction-based approach using a graph convolutional network integrated with a deep Q-networks algorithm.
Our results show that the proposed method can significantly improve both the accuracy and efficiency for modeling and the latency performance of large vehicular networks.
arXiv Detail & Related papers (2021-03-13T06:56:29Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.