Drift-Resistant Navigation World Model with Anchored Epipolar Guidance
- URL: http://arxiv.org/abs/2605.24761v1
- Date: Sat, 23 May 2026 22:47:33 GMT
- Title: Drift-Resistant Navigation World Model with Anchored Epipolar Guidance
- Abstract summary: We propose Drift-Resistant Navigation World Model, a generative model that mitigates both perceptual drift and geometric drift in conventional rollout-based navigation world models.<n>We first predict sparse future anchors that serve as stable long-range targets, and then generate intermediate frames within each chunk conditioned on both past context and future anchors.<n>Experiments on four benchmarks demonstrate consistent improvements over strong baselines in long-horizon visual quality, geometric consistency, and multi-view coherence.
- Score: 81.52175010905665
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: We propose Drift-Resistant Navigation World Model, a generative model that mitigates both perceptual drift and geometric drift in conventional rollout-based navigation world models. Existing methods recursively feed generated content into subsequent steps, causing noise accumulation and degraded predictions, i.e., perceptual drift. Meanwhile, their predictions often deviate from the agent's motion, resulting in geometry drift. We address both types of drift by redesigning world-model prediction as an anchor-guided rollout. Instead of rolling out every frame sequentially, we first predict sparse future anchors that serve as stable long-range targets, and then generate intermediate frames within each chunk conditioned on both past context and future anchors. Importantly, these sparse anchors also provide geometric constraints, supported by bidirectional epipolar geometry, to localize where corresponding content should appear in the intermediate frames. Experiments on four benchmarks demonstrate consistent improvements over strong baselines in long-horizon visual quality, geometric consistency, and multi-view coherence. These gains further translate into improved downstream planning performance under the same planners, highlighting the importance of drift-resistant, geometry-aware prediction for reliable navigation world models.
Related papers
- RIGOR: Rig-Informed Geometry for Omnidirectional Reconstruction [38.41034045192577]
Recent developments in feed-forward 3D reconstruction resulted in models which can recover dense scene representations and camera motion solely from an image stream.<n>We present RIGOR: a large-scale reconstruction pipeline for gravity-aligned omnidirectional videos.<n>We demonstrate that the proposed consistency mechanisms improve both trajectory accuracy and reconstructed geometry over a feed-forward baseline on challenging construction-site sequences.
arXiv Detail & Related papers (2026-09-11T20:11:43Z) - Surfsvr: 2D Surface Priors as 3D Geometric Regularizers for Sparse Voxel Reconstruction [56.51413081953813]
SurfSVR is a novel sparse voxel reconstruction paradigm that treats 2D surface priors as explicit 3D geometric regularizers.<n>It consistently improves sparse voxel reconstruction across scenes with substantially different visibility and geometry characteristics.
arXiv Detail & Related papers (2026-08-12T11:25:31Z) - GeoRoute: Geometry-Aware Hybrid Inference for Traffic Future-Frame Prediction [0.8091286187898472]
Long-horizon future-frame prediction is important for autonomous driving, traffic surveillance, and intelligent transportation systems.<n>Recent latent video diffusion models have achieved impressive visual quality, but directly applying them to structured traffic scenes often leads to unstable geometry.<n>We present a training-free inference framework that stabilizes reliable static structure in pretrained video predictions.
arXiv Detail & Related papers (2026-08-10T12:01:18Z) - Can Video Diffusion Models Predict Past Frames? Bidirectional Cycle Consistency for Reversible Interpolation [25.677744104220853]
Video frame aims to synthesize realistic intermediate frames between given endpoints while adhering to specific motion semantics.<n>We propose a novel bidirectional framework that enforces symmetry between forward and backward generation trajectories.<n>Our method achieves state-of-the-art performance in imaging quality, motion smoothness, and dynamic control on both 37-frame and 73-frame tasks.
arXiv Detail & Related papers (2026-04-02T06:58:46Z) - DynFlowDrive: Flow-Based Dynamic World Modeling for Autonomous Driving [67.83404465171257]
DynFlowDrive is a latent world model that models the transition of world states under different driving actions.<n>It learns a velocity field that describes how the scene state changes under different driving actions.<n>Building upon this, we introduce a stability-aware multi-mode trajectory selection strategy.
arXiv Detail & Related papers (2026-03-20T06:19:31Z) - VGGT-World: Transforming VGGT into an Autoregressive Geometry World Model [59.789011777899965]
VGGT-World is a geometry world model that side-steps video generation entirely and instead forecasts the temporal evolution of frozen geometry-foundation-model features.<n>We show that VGGT-World significantly outperforms the strongest baselines in depth forecasting while running 3.6-5 times faster with only 0.43B trainable parameters.
arXiv Detail & Related papers (2026-03-13T04:56:43Z) - RAYNOVA: Scale-Temporal Autoregressive World Modeling in Ray Space [51.441415833480505]
RAYNOVA is a multiview world model for driving scenarios that employs a dual-causal autoregressive framework.<n>It constructs an isotropic-temporal representation across views, frames, and scales based on relative Plcker-ray positional encoding.
arXiv Detail & Related papers (2026-02-24T08:41:40Z) - Mitigating Error Accumulation in Continuous Navigation via Memory-Augmented Kalman Filtering [20.380488628232186]
Continuous navigation is critical for Unmanned Aerial Vehicle (UAV)<n>Existing Vision-Language Navigation (VLN) models follow the dead-reckoning, which iteratively updates its position for the next waypoint prediction, and subsequently construct the complete trajectory.<n>We propose a novel framework that decouples navigation into two complementary processes: a Prior Prediction, based on motion dynamics and a Likelihood Correction, from historical observation.
arXiv Detail & Related papers (2026-01-30T05:03:08Z) - AstraNav-World: World Model for Foresight Control and Consistency [40.07910402326578]
Embodied navigation in dynamic environments demands accurate foresight of how the world will evolve and how actions will unfold over time.<n>We propose AstraNav-World, an end-to-end world model that jointly reasons about future visual states and action sequences.<n>Our framework integrates a diffusion-based video generator with a vision-language policy, enabling synchronized rollouts.
arXiv Detail & Related papers (2025-12-25T15:31:24Z) - TALO: Pushing 3D Vision Foundation Models Towards Globally Consistent Online Reconstruction [57.46712611558817]
3D vision foundation models have shown strong generalization in reconstructing key 3D attributes from uncalibrated images through a single feed-forward pass.<n>Recent strategies align consecutive predictions by solving global transformation, yet our analysis reveals their fundamental limitations in assumption validity, local alignment scope, and robustness under noisy geometry.<n>We propose a higher-DOF and long-term alignment framework based on Thin Plate Spline, leveraging globally propagated control points to correct spatially varying inconsistencies.
arXiv Detail & Related papers (2025-12-02T02:22:20Z) - GrndCtrl: Grounding World Models via Self-Supervised Reward Alignment [16.343768407636322]
We introduce Reinforcement Learning with World Grounding (RLWG), a self-supervised post-training framework that aligns pretrained world models with a physically verifiable structure through geometric and perceptual rewards.<n>We instantiate this framework with GrndCtrl, a reward-aligned adaptation method based on Group Relative Policy Optimization (GRPO), yielding world models that maintain stable trajectories, consistent geometry, and reliable rollouts for embodied navigation.
arXiv Detail & Related papers (2025-12-01T18:03:29Z) - Scaling Up Occupancy-centric Driving Scene Generation: Dataset and Method [54.461213497603154]
Occupancy-centric methods have recently achieved state-of-the-art results by offering consistent conditioning across frames and modalities.<n>Nuplan-Occ is the largest occupancy dataset to date, constructed from the widely used Nuplan benchmark.<n>We develop a unified framework that jointly synthesizes high-quality occupancy, multi-view videos, and LiDAR point clouds.
arXiv Detail & Related papers (2025-10-27T03:52:45Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.