GeoWAM: Visual Geometry World Action Models for Autonomous Driving

• URL: http://arxiv.org/abs/2608.23486v2
• Date: Tue, 25 Aug 2026 05:05:45 GMT
• Title: GeoWAM: Visual Geometry World Action Models for Autonomous Driving
• Abstract summary: We introduce textbfGeoWAM, a visual geometry world action model for autonomous driving.<n>Rather than predicting future images, GeoWAM is pretrained to forecast future scene geometry.<n>A geometry-conditioned action head then leverages these learned geometric dynamics to predict future ego trajectories.
• Score: 14.05425826273513
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: World action models (WAMs) have recently gained increasing attention as a framework for jointly modeling scene evolution and ego actions in autonomous driving. Most existing WAMs learn scene dynamics in pixel space by combining a video-generation backbone for future-observation prediction with an action head for ego-trajectory prediction. Pixels, however, provide only an indirect representation of these dynamics: they entangle geometry and motion with appearance, texture, and illumination, forcing the model to infer three-dimensional transformations from two-dimensional observations. We argue that geometry, represented by point clouds, offers a more natural state space for driving because it explicitly captures spatial structure and the rigid and non-rigid transformations that govern scene evolution while directly aligning with the space in which driving actions are executed. Building on this insight, we introduce \textbf{GeoWAM}, a visual geometry world action model for autonomous driving. Rather than predicting future images, GeoWAM is pretrained to forecast future scene geometry, yielding representations that jointly encode spatial structure and temporal evolution. A geometry-conditioned action head then leverages these learned geometric dynamics to predict future ego trajectories. Extensive open-loop and closed-loop evaluations show that visual geometry world modeling yields substantially stronger driving policies than image-based alternatives, establishing future-geometry prediction as an effective pretraining objective for autonomous driving.

Related papers

• TourPhysics: Bringing Physics to World Models for Exploration and Manipulation from a Single Image [53.206752160427065]
  TourPhysics is an online framework from a single image and a declarative physical configuration.<n>For each action, the simulator computes a finite physical and camera trajectory before the corresponding observation is generated.<n>TourPhysics follows prescribed camera and object trajectories more closely than the evaluated baselines.
  arXiv  Detail & Related papers  (2026-09-04T09:15:03Z)
• SG-WAM: Self-Guided World Modeling in Geometry-Aware Policy Space [12.198811616220835]
  World Action Models (WAMs) couple action generation with prediction of future states.<n>We propose SG-WAM, a self-guided framework that learns geometry-aware action-conditioned dynamics directly in the policy-derived representation space.
  arXiv  Detail & Related papers  (2026-08-02T17:25:08Z)
• GeoWorldAD: Geometry World Action Model for Autonomous Driving [45.0114703918243]
  We propose GeoWorldAD, a geometry world action model that grounds trajectory planning in ego-aligned 3D space.<n>Present geometry provides essential spatial constraints for safe planning, while future geometry reveals how surrounding agents and ego-centric free space may evolve.<n>Experiments on NAVSIM v1 and v2 demonstrate state-of-the-art performance, highlighting the effectiveness of explicit 3D geometry grounding.
  arXiv  Detail & Related papers  (2026-07-20T03:56:07Z)
• LiAuto-GeoX: Efficient Grounded Driving Transformer [54.23823436153608]
  We present textbfLiAuto-GeoX, an efficient grounded driving transformer for deployable, ego-centric 3D scene understanding.<n>We show that textbfLiAuto-GeoX runs at 220 FPS on KITTI while maintaining high-fidelity dense reconstruction, enabling real-time deployment.
  arXiv  Detail & Related papers  (2026-06-04T06:58:44Z)
• HERMES++: Toward a Unified Driving World Model for 3D Scene Understanding and Generation [83.31948299340782]
  HERMES++ is a unified driving world model that integrates 3D scene understanding and future geometry prediction within a single framework.<n>Hermes++ achieves strong performance, outperforming specialist approaches in both future point cloud prediction and 3D scene understanding tasks.
  arXiv  Detail & Related papers  (2026-04-30T17:59:58Z)
• Bridging Scene Generation and Planning: Driving with World Model via Unifying Vision and Motion Representation [66.7879424097418]
  We present WorldDrive, a holistic framework that couples scene generation and real-time planning via unifying vision and motion representation.<n>A simple interaction between motion representation, visual representation, and ego status can generate high-quality, multi-modal trajectories.<n>Experiments on the NAVSIM, NAVSIM-v2, and nuScenes benchmarks demonstrate that WorldDrive achieves leading planning performance among vision-only methods.
  arXiv  Detail & Related papers  (2026-03-16T07:59:39Z)
• Future-Aware End-to-End Driving: Bidirectional Modeling of Trajectory Planning and Scene Evolution [96.25314747309811]
  We introduce SeerDrive, a novel end-to-end framework that jointly models future scene evolution and trajectory planning.<n>Our method first predicts future bird's-eye view (BEV) representations to anticipate the dynamics of the surrounding scene.<n>Two key components enable this: (1) future-aware planning, which injects predicted BEV features into the trajectory planner, and (2) iterative scene modeling and vehicle planning.
  arXiv  Detail & Related papers  (2025-10-13T07:41:47Z)
• GASP: Unifying Geometric and Semantic Self-Supervised Pre-training for Autonomous Driving [12.889523014369884]
  We propose a geometric and semantic self-supervised pre-training method, GASP, that learns a unified representation by predicting, at any queried future point in spacetime.<n>By modeling geometric and semantic 4D occupancy fields instead of raw sensor measurements, the model learns a structured, general representation of the environment and its evolution through time.
  arXiv  Detail & Related papers  (2025-03-19T20:00:27Z)
• GenAD: Generative End-to-End Autonomous Driving [13.332272121018285]
  GenAD is a generative framework that casts autonomous driving into a generative modeling problem. We propose an instance-centric scene tokenizer that first transforms the surrounding scenes into map-aware instance tokens. We then employ a variational autoencoder to learn the future trajectory distribution in a structural latent space for trajectory prior modeling.
  arXiv  Detail & Related papers  (2024-02-18T08:21:05Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.