Hardware- and Vision-in-the-Loop Validation of Deep Monocular Pose Estimation for Autonomous Maritime UAV Flight

• URL: http://arxiv.org/abs/2606.19176v1
• Date: Wed, 17 Jun 2026 15:18:11 GMT
• Title: Hardware- and Vision-in-the-Loop Validation of Deep Monocular Pose Estimation for Autonomous Maritime UAV Flight
• Abstract summary: This paper presents a hardware-validated vision-in-the-loop framework that enables fully autonomous indoor flight on ships.<n>The results establish a safe and hardware-realistic intermediate stage for developing maritime UAV autonomy prior to shipboard deployment.
• Score: 2.0935101589828244
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Autonomous UAV operations on ships require reliable vision-based relative pose estimation, yet at-sea validation is costly, weather-dependent, and risky. This paper presents a hardware-validated vision-in-the-loop framework that enables fully autonomous indoor flight while emulating photorealistic maritime environments. Rendered maritime views are processed onboard by a deep transformer-based monocular pose estimator. Delayed vision measurements are fused with high-rate IMU data using a delayed Kalman filter to provide consistent state estimates for geometric control. The system captures critical embedded effects, including perception latency, asynchronous updates, and computational constraints, that are absent in pure simulation. Autonomous takeoff, trajectory tracking, and landing experiments demonstrate stable closed-loop flight. The results establish a safe and hardware-realistic intermediate stage for developing maritime UAV autonomy prior to shipboard deployment.

Related papers

• Vision-Based Leader-Follower Formation Control for Cooperative UAVs in GPS-Degraded Environments [0.31662146097653004]
  This paper presents a vision-based cooperative formation framework running on a follower UAV.<n>It uses a front-facing RGB-D camera to detect, track, and localize a leader UAV in real-time.<n>Results show that the proposed framework maintains stable leader-follower formations with reasonable computational cost.
  arXiv  Detail & Related papers  (2026-09-01T15:35:38Z)
• Boosting Robustness for All-Weather Self-Supervised Depth Estimation in Autonomous Driving [46.17295445504376]
  Adverse weather conditions can distort pixel correspondences and violate the assumptions embedded in the self-supervised loss function.<n>While radar is a widely adopted sensor in adverse weather conditions, the sparse distribution of radar points in the Point of View (POV) poses challenges for self-supervised fusion.<n>We propose a novel self-training pipeline using unpaired real all-weather data through multi-teacher distillation and robust radar fusion.
  arXiv  Detail & Related papers  (2026-07-23T17:11:33Z)
• MAD: Mapping-Aware World Models for Agile Quadrotor Flight [47.458890396048126]
  Mapping-Aware Dreamer (MAD) is a geometry-aware world model for vision-based quadrotor flight.<n>MAD learns recurrent latent dynamics that reconstruct robocentric occupancy and visibility grid maps.<n>We demonstrate safe indoor and outdoor flight under limited sensing, reaching 9.66 m/s in simulation and 5.05 m/s in real-world forest experiments.
  arXiv  Detail & Related papers  (2026-06-03T07:17:57Z)
• Bench2Drive-Robust: Benchmarking Closed-Loop Autonomous Driving under Deployment Perturbations [122.22391796628408]
  We present Bench2Drive-Robust, to our knowledge the first device-centric robustness benchmark for closed-loop end-to-end autonomous driving.<n>We systematically evaluate deployment-oriented perturbations arising from three major sources: camera-stream failures, ego-state estimation errors, and compute-induced control delay.<n>Our results show that these deployment-related perturbations can substantially degrade closed-loop driving performance.
  arXiv  Detail & Related papers  (2026-05-18T08:45:24Z)
• Autonomous UAV Pipeline Near-proximity Inspection via Disturbance-Aware Predictive Visual Servoing [12.773186211498283]
  Pipeline inspection is critical to safe energy transportation, but is constrained by long distances, complex terrain, and risks to human inspectors.<n>This paper presents an autonomous quadrotor near-proximity pipeline inspection framework for three-dimensional scenarios based on image-based visual servoing model predictive control (VMPC)<n>A terrain-adaptive velocity design is introduced to maintain the desired cruising speed while generating vertical velocity over unknown slopes without prior terrain information.<n>In real-world tests, the proposed method reduces RMSE by 52.63% and 75.04% in pipeline orientation and lateral deviation in the image, respectively, for straight-pipeline
  arXiv  Detail & Related papers  (2026-04-21T16:05:34Z)
• A Robust Simulation Framework for Verification and Validation of Autonomous Maritime Navigation in Adverse Weather and Constrained Environments [7.743296200054435]
  Maritime Autonomous Surface Ships (MASS) have emerged as a promising solution to enhance navigational safety, operational efficiency, and long-term cost effectiveness.<n>Their reliable deployment requires rigorous verification and validation (V&V) under various environmental conditions.<n>This paper presents an enhanced virtual simulation framework to support the V&V of MASS in realistic maritime environments.
  arXiv  Detail & Related papers  (2026-03-03T00:25:09Z)
• Continuous Marine Tracking via Autonomous UAV Handoff [0.4935992163749761]
  This paper introduces an autonomous UAV vision system for continuous, real-time tracking of marine animals, specifically sharks.<n>The system integrates an onboard computer with a stabilised RGB-D camera and a custom-trained OSTrack pipeline.<n>A key innovation is the inter-UAV handoff protocol, which enables seamless transfer of tracking responsibilities between drones.
  arXiv  Detail & Related papers  (2025-07-17T03:35:53Z)
• NOVA: Navigation via Object-Centric Visual Autonomy for High-Speed Target Tracking in Unstructured GPS-Denied Environments [56.35569661650558]
  We introduce NOVA, a fully onboard, object-centric framework that enables robust target tracking and collision-aware navigation.<n>Rather than constructing a global map, NOVA formulates perception, estimation, and control entirely in the target's reference frame.<n>We validate NOVA across challenging real-world scenarios, including urban mazes, forest trails, and repeated transitions through buildings with intermittent GPS loss.
  arXiv  Detail & Related papers  (2025-06-23T14:28:30Z)
• Angle Robustness Unmanned Aerial Vehicle Navigation in GNSS-Denied Scenarios [66.05091704671503]
  We present a novel angle navigation paradigm to deal with flight deviation in point-to-point navigation tasks. We also propose a model that includes the Adaptive Feature Enhance Module, Cross-knowledge Attention-guided Module and Robust Task-oriented Head Module.
  arXiv  Detail & Related papers  (2024-02-04T08:41:20Z)
• Vision-Based Autonomous Navigation for Unmanned Surface Vessel in Extreme Marine Conditions [2.8983738640808645]
  This paper presents an autonomous vision-based navigation framework for tracking target objects in extreme marine conditions. The proposed framework has been thoroughly tested in simulation under extremely reduced visibility due to sandstorms and fog. The results are compared with state-of-the-art de-hazing methods across the benchmarked MBZIRC simulation dataset.
  arXiv  Detail & Related papers  (2023-08-08T14:25:13Z)
• Large-scale Autonomous Flight with Real-time Semantic SLAM under Dense Forest Canopy [48.51396198176273]
  We propose an integrated system that can perform large-scale autonomous flights and real-time semantic mapping in challenging under-canopy environments. We detect and model tree trunks and ground planes from LiDAR data, which are associated across scans and used to constrain robot poses as well as tree trunk models. A drift-compensation mechanism is designed to minimize the odometry drift using semantic SLAM outputs in real time, while maintaining planner optimality and controller stability.
  arXiv  Detail & Related papers  (2021-09-14T07:24:53Z)
• Distributed Variable-Baseline Stereo SLAM from two UAVs [17.513645771137178]
  In this article, we employ two UAVs equipped with one monocular camera and one IMU each, to exploit their view overlap and relative distance measurements. In order to control the glsuav agents autonomously, we propose a decentralized collaborative estimation scheme. We demonstrate the effectiveness of the approach at high altitude flights of up to 160m, going significantly beyond the capabilities of state-of-the-art VIO methods.
  arXiv  Detail & Related papers  (2020-09-10T12:16:10Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.