Valerant: An Automatic Navigable Game Map Generator via Action-Conditioned World Model Exploration

• URL: http://arxiv.org/abs/2609.09418v2
• Date: Mon, 14 Sep 2026 03:54:15 GMT
• Title: Valerant: An Automatic Navigable Game Map Generator via Action-Conditioned World Model Exploration
• Abstract summary: World Action Models (WAMs) couple predictive world modeling with action generation, allowing anticipated future states to guide agent behavior.<n>We present textscValerant, a framework that transforms a pretrained action-conditioned world model into a WAM for exploring and constructing 3D game maps.<n>This framework extends WAM-based interaction beyond 2D visual simulation and offers a new approach to reducing manual effort in 3D game-map creation.
• Score: 10.110436795631793
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: World Action Models (WAMs) couple predictive world modeling with action generation, allowing anticipated future states to guide agent behavior. Although WAMs are rapidly advancing embodied AI, general-purpose counterparts remain largely unexplored in games. Existing game-oriented approaches often combine action-conditioned world models with external policies and reward functions to realize WAM-like decision-making, yet they operate mainly in 2D visual observation space and do not instantiate persistent 3D geometry. Extending this paradigm to 3D games introduces a distinct challenge. In autonomous driving and robotics, the physical environment exists independently of the model, providing a persistent 3D world in which selected actions can be executed. Games have no such external substrate; the virtual world itself must be instantiated. Most playable games require a persistent and navigable space, while 3D games additionally require explicit geometry that supports movement and interaction. Action-conditioned video rollouts provide visual observations but not this spatial representation. We present \textsc{Valerant}, a training-free framework that transforms a pretrained action-conditioned world model into a WAM for exploring and constructing 3D game maps. By coupling predictive visual rollouts with SLAM-based spatial reconstruction and exploration-driven action selection, \textsc{Valerant} progressively transforms a single image into a persistent 3D game map. This framework extends WAM-based interaction beyond 2D visual simulation and offers a new approach to reducing manual effort in 3D game-map creation.

Related papers

• From Pixels to States: Rethinking Interactive World Models as Game Engines [32.66997200688335]
  This paper examines interactive game world modeling along four dimensions: player action control, game state dynamics, state-observation persistence, and real-time interactive generation.<n>We present a scalable data engine for Black Myth: Wukong that collects over 90 hours of gameplay with frame-aligned player actions, ground-truth game states, and visual observations.
  arXiv  Detail & Related papers  (2026-07-15T17:48:48Z)
• PAIWorld: A 3D-Consistent World Foundation Model for Robotic Manipulation [51.385664546670284]
  We present PAIWorld, a framework that augments diffusion-transformer world models via three core components.<n>It achieves state-of-the-art multi-view 3D consistency on robotic benchmarks, ranking 1st on the WorldArena leaderboard and 2nd on the AgiBot-Challenge2026 leaderboard.
  arXiv  Detail & Related papers  (2026-06-16T18:23:23Z)
• Future Dynamic 3D Reconstruction: A 3D World Model with Disentangled Ego-Motion [69.61280478695205]
  We propose FR3D, a world model that predicts a persistent 3D latent representation for future dynamic 3D reconstruction.<n>Experiments demonstrate FR3D's strong performance for future dynamic 3D reconstruction from monocular observations across multiple datasets, even 2 seconds into the future.
  arXiv  Detail & Related papers  (2026-06-16T17:59:46Z)
• WAM4D: Fast 4D World Action Model via Spatial Register Tokens [52.16661403052964]
  We present WAM4D, a fast 4D world action model that uses lightweight spatial register tokens as training-time future-depth readouts.<n>We show that WAM4D improves spatial consistency and achieves competitive action prediction while maintaining efficient inference.
  arXiv  Detail & Related papers  (2026-06-12T02:49:34Z)
• 3D-Belief: Embodied Belief Inference via Generative 3D World Modeling [37.75852887428672]
  We present 3D-Belief, a generative 3D world model that infers explicit, actionable 3D beliefs from partial observations and updates them online over time.<n>Unlike prior visual prediction models, 3D-Belief represents uncertainty directly in 3D, enabling embodied agents to imagine plausible scene completions and reason over partially observed environments.
  arXiv  Detail & Related papers  (2026-05-12T00:42:27Z)
• UNICA: A Unified Neural Framework for Controllable 3D Avatars [14.243189295411801]
  UNICA (UNIfied neural Controllable Avatar) is a skeleton-free generative model that unifies all avatar control components into a single neural framework.<n>Our approach naturally captures hair and loose clothing dynamics without manually designed physical simulation.
  arXiv  Detail & Related papers  (2026-04-03T07:09:55Z)
• PointWorld: Scaling 3D World Models for In-The-Wild Robotic Manipulation [48.807071017228964]
  We introduce PointWorld, a large pre-trained 3D world model that unifies state and action in a shared 3D space as 3D point flows.<n>With a real-time (0.1s) inference speed, PointWorld can be efficiently integrated in the model-predictive control (MPC) framework for manipulation.<n>We demonstrate that a single pre-trained checkpoint enables a real-world Franka robot to perform rigid-body pushing, deformable and articulated object manipulation.
  arXiv  Detail & Related papers  (2026-01-07T10:29:12Z)
• 3D-VLA: A 3D Vision-Language-Action Generative World Model [68.0388311799959]
  Recent vision-language-action (VLA) models rely on 2D inputs, lacking integration with the broader realm of the 3D physical world. We propose 3D-VLA by introducing a new family of embodied foundation models that seamlessly link 3D perception, reasoning, and action. Our experiments on held-in datasets demonstrate that 3D-VLA significantly improves the reasoning, multimodal generation, and planning capabilities in embodied environments.
  arXiv  Detail & Related papers  (2024-03-14T17:58:41Z)
• Persistent Nature: A Generative Model of Unbounded 3D Worlds [74.51149070418002]
  We present an extendable, planar scene layout grid that can be rendered from arbitrary camera poses via a 3D decoder and volume rendering. Based on this representation, we learn a generative world model solely from single-view internet photos. Our approach enables scene extrapolation beyond the fixed bounds of current 3D generative models, while also supporting a persistent, camera-independent world representation.
  arXiv  Detail & Related papers  (2023-03-23T17:59:40Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.