NavWM: A Unified Navigation World Model for Foresight-Driven Planning

• URL: http://arxiv.org/abs/2606.24101v1
• Date: Tue, 23 Jun 2026 03:30:20 GMT
• Title: NavWM: A Unified Navigation World Model for Foresight-Driven Planning
• Abstract summary: NavWM is a unified navigation world model that seamlessly integrates latent world reasoning, multimodal action prediction, and controllable visual generation.<n>To overcome the limitations of deterministic policies, we introduce an anchor-based multimodal trajectory forecasting framework.<n>Experiments across diverse datasets demonstrate that NavWM significantly advances the state-the-art.
• Score: 15.801647085785826
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Conventional visual navigation policies often struggle with myopic decision-making and mode collapse in complex environments. While world models offer a promising alternative, existing paradigms typically isolate perception, generation, and control, failing to capture their shared spatio-temporal dynamics. In this paper, we propose NavWM, a unified navigation world model that seamlessly integrates latent world reasoning, multimodal action prediction, and controllable visual generation. At its core, NavWM leverages latent world tokens to distill geometric and semantic priors, endowing the agent with robust structural understanding. To overcome the limitations of deterministic policies, we introduce an anchor-based multimodal trajectory forecasting framework that generates a diverse action space. This inherent diversity explicitly empowers the generative world model to act as a robust closed-loop planner, utilizing visual foresight to evaluate and select the optimal path. Extensive experiments across diverse robotics datasets demonstrate that NavWM significantly advances the state-of-the-art, delivering remarkable improvements in both high-fidelity future state generation and zero-shot navigation success.

Related papers

• Predicting Consequences and Reinforcing Navigation Policies with Latent World Models [31.865100130203317]
  We propose a compatibility prediction Latent World Model (LWM) for robot navigation.<n>Our key insight is that spatial proximity correlates with latent feature similarity, enabling action consequences to be evaluated directly in latent space.<n>Our approach significantly outperforms prior world model and imitation learning methods in prediction accuracy, policy learning, and real-world navigation performance.
  arXiv  Detail & Related papers  (2026-08-23T11:58:42Z)
• WorldFly: A World-Model-Based Vision-Language-Action Model for UAV Navigation [42.8714305455232]
  We argue that the ability to "imagine" future states is critical for robust decision-making under such partial observability.<n>We propose WorldFly, a novel world-model-based VLA framework that employs a dual-branch coupled flow matching mechanism to jointly generate future video predictions and navigation actions.
  arXiv  Detail & Related papers  (2026-06-04T13:23:05Z)
• WAM-Nav: Asymmetric Latent World-Action Modeling for Unified Visual Navigation [31.539730066120374]
  Visual navigation requires generating smooth and collision-free trajectories under complex geometric and physical constraints.<n>We propose WAM-Nav, a Latent World-Action Model for embodied visual navigation that jointly learns action generation and latent visual foresight.
  arXiv  Detail & Related papers  (2026-06-03T14:05:19Z)
• World-Ego Modeling for Long-Horizon Evolution in Hybrid Embodied Tasks [62.389116510844445]
  We introduce emphWorld-Ego Modeling, a new conceptual paradigm that decomposes future evolution into world and ego components.<n>We instantiate this paradigm as the World-Ego Model (WEM), a unified embodied world model that couples an implicit separate world-ego planner with a cascade-parallel mixture-of-experts (CP-MoE) diffusion generator.
  arXiv  Detail & Related papers  (2026-05-19T15:10:27Z)
• Uni-World VLA: Interleaved World Modeling and Planning for Autonomous Driving [52.04950569530877]
  We present Uni-World VLA, a unified vision-language-action model that tightly interleaves future frame prediction and trajectory planning.<n>Our approach achieves competitive closed-loop planning performance while producing high-fidelity future frame predictions.
  arXiv  Detail & Related papers  (2026-03-28T14:39:51Z)
• Bridging Scene Generation and Planning: Driving with World Model via Unifying Vision and Motion Representation [66.7879424097418]
  We present WorldDrive, a holistic framework that couples scene generation and real-time planning via unifying vision and motion representation.<n>A simple interaction between motion representation, visual representation, and ego status can generate high-quality, multi-modal trajectories.<n>Experiments on the NAVSIM, NAVSIM-v2, and nuScenes benchmarks demonstrate that WorldDrive achieves leading planning performance among vision-only methods.
  arXiv  Detail & Related papers  (2026-03-16T07:59:39Z)
• An Efficient and Multi-Modal Navigation System with One-Step World Model [11.582535121562247]
  Current navigation world models rely on multi-step diffusion processes and autoregressive frame-by-frame generation.<n>We propose a one-step generation paradigm and a 3D U-Net backbone equipped with efficient spatial-temporal attention.<n>This design drastically reduces inference latency, enabling high-frequency control while achieving superior predictive performance.
  arXiv  Detail & Related papers  (2026-01-18T06:29:56Z)
• AstraNav-World: World Model for Foresight Control and Consistency [40.07910402326578]
  Embodied navigation in dynamic environments demands accurate foresight of how the world will evolve and how actions will unfold over time.<n>We propose AstraNav-World, an end-to-end world model that jointly reasons about future visual states and action sequences.<n>Our framework integrates a diffusion-based video generator with a vision-language policy, enabling synchronized rollouts.
  arXiv  Detail & Related papers  (2025-12-25T15:31:24Z)
• From Forecasting to Planning: Policy World Model for Collaborative State-Action Prediction [57.56072009935036]
  We introduce a new driving paradigm named Policy World Model (PWM)<n>PWM integrates world modeling and trajectory planning within a unified architecture.<n>Our method matches or exceeds state-of-the-art approaches that rely on multi-view and multi-modal inputs.
  arXiv  Detail & Related papers  (2025-10-22T14:57:51Z)
• Unified World Models: Memory-Augmented Planning and Foresight for Visual Navigation [69.94565127141483]
  Current approaches separate navigation planning from visual world modeling, leading to state-action misalignment and limited adaptability.<n>We propose UniWM, a unified, memory-augmented world model integrating egocentric visual foresight and planning within a single multimodal autoregressive backbone.<n>We show that UniWM substantially improves navigation success rates by up to 30%, significantly reduces trajectory errors compared to strong baselines, and exhibits impressive zero-shot generalization on the unseen TartanDrive dataset.
  arXiv  Detail & Related papers  (2025-10-09T18:18:11Z)
• Navigation World Models [68.58459393846461]
  We introduce a controllable video generation model that predicts future visual observations based on past observations and navigation actions.<n>In familiar environments, NWM can plan navigation trajectories by simulating them and evaluating whether they achieve the desired goal.<n>Experiments demonstrate its effectiveness in planning trajectories from scratch or by ranking trajectories sampled from an external policy.
  arXiv  Detail & Related papers  (2024-12-04T18:59:45Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.