Unified Planning-Learning Framework for Robust UUV Navigation Under Partial Observability

• URL: http://arxiv.org/abs/2608.05365v1
• Date: Wed, 05 Aug 2026 19:37:22 GMT
• Title: Unified Planning-Learning Framework for Robust UUV Navigation Under Partial Observability
• Abstract summary: This paper presents an observation-only autonomy framework for Unmanned Underwater Vehicles (UUVs) navigation in dynamic underwater environments.<n>The proposed pipeline constructs occupancy maps solely from onboard sonar and depth image observations.<n>The framework integrates persistent occupancy mapping, global clearance-aware planning, and risk-aware local control.
• Score: 1.8047694351309207
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: This paper presents an observation-only autonomy framework for Unmanned Underwater Vehicles (UUVs) navigation in dynamic underwater environments that integrates persistent occupancy mapping, global clearance-aware planning, and risk-aware local control. The proposed pipeline constructs occupancy maps solely from onboard sonar and depth image observations, adapts a clearance-constrained global planner (GP) to provide long-horizon structure, and integrates a reinforcement learning (RL) policy to handle short-range tracking and reactive avoidance. To further support decision-making under partial observability, the system learns a compact latent state representation from onboard sensor data, encoding environmental structure, obstacle dynamics, and uncertainty. Behavior tree (BT) distillation with staged supervision is introduced to improve safety and training stability, while an uncertainty-calibrated distillation mechanism reweights teacher guidance using online latent-model uncertainty, emphasizing uncertain regimes during learning, with time-to-collision (TTC) and clearance cues remaining explicit in planning and local policy features. To demonstrate the efficacy of the framework, a reproducible multi-seed evaluation protocol is established in high-fidelity GPU-accelerated simulation using NVIDIA Isaac Sim, and performance is benchmarked against BT-only and standard RL baselines. The results obtained demonstrate improved robustness and safety under dynamic conditions, thus providing a general pipeline with a unified hybrid planning learning architecture and a reproducible methodology for robust UUV autonomy under partial observability.

Related papers

• Learning-Based Dynamic Obstacle Avoidance for a UAV Using Only Three Range Sensors [1.2246649738388389]
  We present a learning-based approach to kinodynamic online motion planning for an Unmanned Aerial Vehicle (UAV) operating at a fixed altitude in unknown dynamic environments.<n>The proposed framework integrates a behavior grid map representation with Deep Reinforcement Learning (DRL) for stable policy learning in continuous control.<n>The key idea is the co-design of a state representation and control policy that enables reliable navigation using only three low-cost directional range sensors.
  arXiv  Detail & Related papers  (2026-09-13T10:53:43Z)
• Graph-Based Safe Reinforcement Learning for Multi-Agent Systems with Time-Varying Topology [0.0]
  This paper presents a graph-based safe multi-agent reinforcement learning (MARL) framework for cooperative navigation with time-varying topology.<n>To address the critical challenge of ensuring safety in environments with sensing constraints, a safety-decoupled mechanism is introduced.<n>Building upon this safety foundation, a unified structural architecture is proposed, integrating a attention-based actor and a Graph Attention Network (GAT) centralized critic.
  arXiv  Detail & Related papers  (2026-09-08T14:30:06Z)
• PILOT: Privileged Imitation Learning for End-to-End Motion Planning of Autonomous UAVs under Partial Observability [7.550075542886951]
  This paper presents PILOT, a constraint-aware privileged imitation learning framework for vision-based end-to-end UAV planning under partial observability.
  arXiv  Detail & Related papers  (2026-08-14T08:43:59Z)
• SkyJEPA: Learning Long-Horizon World Models for Zero-Shot Sim-to-Real Control of Quadrotors [48.60897189520386]
  We introduce the JEPA-style model for real-time quadrotor control.<n>We combine a latent dynamics model with a novel physics-inspired prober that maps frozen latents to interpretable state.<n>To reduce the dependence on expensive and unsafe real-world data collection, we develop a structured pipeline for automated dataset generation.
  arXiv  Detail & Related papers  (2026-06-22T15:00:59Z)
• Learning Predictive Control with Deep Koopman Operators for Autonomous Vehicle Motion Planning [11.149068950974113]
  Model Predictive Control (MPC) is widely used for autonomous-vehicle (AV) motion planning, but its real-time applicability is often limited.<n>Actor-critic offers an online solution for nonlinear learning problems in dynamic road environments.<n>This article proposes a framework with deep Koopman operators for efficient real-time motion control.
  arXiv  Detail & Related papers  (2026-06-06T12:26:21Z)
• Instantaneous Planning, Control and Safety for Navigation in Unknown Underwater Spaces [0.21108097398435333]
  Navigating autonomous underwater vehicles (AUVs) in unknown environments is significantly challenging.<n>These factors pose challenges in accurate global localization, reliable communication, and obstacle avoidance.<n>We propose an integrated planning and control framework that leverages real time sensor data to dynamically induce closed loop AUV trajectories.
  arXiv  Detail & Related papers  (2026-04-07T01:32:29Z)
• A Survey on Sensor-based Planning and Control for Unmanned Underwater Vehicles [2.6706790642027194]
  This survey examines recent sensor-based planning and control methods for Unmanned Underwater Vehicles (UUVs)<n>The focus is on reactive local planning layers that adapt to real-time sensor inputs such as SONAR and Inertial Measurement Units (IMU)<n>The survey categorizes the existing literature into decoupled and coupled architectures for sensor-based planning and control.
  arXiv  Detail & Related papers  (2026-04-06T00:40:37Z)
• Compressive sensing inspired self-supervised single-pixel imaging [48.79613794195208]
  SISTA-Net is a compressive sensing-inspired self-supervised method for single-pixel imaging.<n>We leverage deep nonlinear networks as adaptive sparse transforms combined with a learnable soft-thresholding operator to impose explicit physical sparsity in the latent domain.<n>Experiments on multiple simulation scenarios demonstrate that SISTA-Net outperforms state-of-the-art methods by 2.6 dB in PSNR.
  arXiv  Detail & Related papers  (2026-03-31T13:31:43Z)
• Consistent and Efficient MSCKF-based LiDAR-Inertial Odometry with Inferred Cluster-to-Plane Constraints for UAVs [46.21996481591401]
  This paper proposes a consistent and efficient LiDAR-Inertial Odometry framework tailored for UAVs.<n>By applying null-space projection to sliding-window coplanar constraints, we eliminate the direct dependency on feature parameters in the state vector.<n>It exhibits improved robustness in degenerate scenarios, achieves the lowest memory usage via its map-free nature, and runs in real-time on resource-constrained embedded platforms.
  arXiv  Detail & Related papers  (2026-03-13T11:09:50Z)
• DFPO: Scaling Value Modeling via Distributional Flow towards Robust and Generalizable LLM Post-Training [94.568675548967]
  Training reinforcement learning (RL) systems in real-world environments remains challenging due to noisy supervision and poor out-of-domain generalization.<n>Recent distributional RL methods improve robustness by modeling values with multiple quantile points, but they still learn each quantile independently as a scalar.<n>We propose DFPO, a robust distributional RL framework that models values as continuous flows across time steps.
  arXiv  Detail & Related papers  (2026-02-05T17:07:42Z)
• Interpretable Hybrid Deep Q-Learning Framework for IoT-Based Food Spoilage Prediction with Synthetic Data Generation and Hardware Validation [0.5417521241272645]
  The need for an intelligent, real-time spoilage prediction system has become critical in modern IoT-driven food supply chains.<n>We propose a hybrid reinforcement learning framework integrating Long Short-Term Memory (LSTM) and Recurrent Neural Networks (RNN) for enhanced spoilage prediction.
  arXiv  Detail & Related papers  (2025-12-22T12:59:48Z)
• Digital Twin Supervised Reinforcement Learning Framework for Autonomous Underwater Navigation [0.0]
  This article investigates issues through the case of the BlueROV2, an open platform widely used for scientific experimentation.<n>We propose a deep reinforcement learning approach based on the Proximal Policy Optimization (PPO) algorithm.<n>Results show that the PPO policy consistently outperforms DWA in highly cluttered environments.
  arXiv  Detail & Related papers  (2025-12-11T18:52:42Z)
• NOVA: Navigation via Object-Centric Visual Autonomy for High-Speed Target Tracking in Unstructured GPS-Denied Environments [56.35569661650558]
  We introduce NOVA, a fully onboard, object-centric framework that enables robust target tracking and collision-aware navigation.<n>Rather than constructing a global map, NOVA formulates perception, estimation, and control entirely in the target's reference frame.<n>We validate NOVA across challenging real-world scenarios, including urban mazes, forest trails, and repeated transitions through buildings with intermittent GPS loss.
  arXiv  Detail & Related papers  (2025-06-23T14:28:30Z)
• In-Distribution Barrier Functions: Self-Supervised Policy Filters that Avoid Out-of-Distribution States [84.24300005271185]
  We propose a control filter that wraps any reference policy and effectively encourages the system to stay in-distribution with respect to offline-collected safe demonstrations. Our method is effective for two different visuomotor control tasks in simulation environments, including both top-down and egocentric view settings.
  arXiv  Detail & Related papers  (2023-01-27T22:28:19Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.