WorldClaw: Agentic 3D Open-World Generation at Scale

• URL: http://arxiv.org/abs/2608.05248v1
• Date: Wed, 05 Aug 2026 15:46:38 GMT
• Title: WorldClaw: Agentic 3D Open-World Generation at Scale
• Abstract summary: We present WorldClaw, a fully agentic, coarse-to-fine framework for open-world 3D scene generation.<n>Planning agents translate a text prompt into a structured specification of regions, terrain, assets, materials, and spatial relations.<n>WorldClaw builds a globally coherent terrain foundation from semantic layouts, reusable assets, generative or procedural materials, and a region-aware height field.
• Score: 20.019718140328347
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Generating large-scale, freely explorable 3D worlds from open-ended text remains challenging because a system must jointly maintain global spatial coherence, rich local content, and explicit assets suitable for downstream editing and reuse. We present WorldClaw, a fully agentic, coarse-to-fine framework for open-world 3D scene generation. Planning agents translate a text prompt into a structured specification of regions, terrain, assets, materials, and spatial relations. WorldClaw then builds a globally coherent terrain foundation from semantic layouts, reusable assets, generative or procedural materials, and a region-aware height field. For detail-demanding regions, it generates terrain-conditioned compositions, reconstructs editable textured meshes, and recovers their placement on the terrain; render-based agents further refine terrain, objects, appearance, and contacts. Across diverse open-world prompts, WorldClaw produces large-scale scenes with coherent spatial organization, visually compelling local content, and editable instance-level assets while preserving a consistent global terrain structure.

Related papers

• SceneConductor: 3D Scene Generation from a Single Image with Multi-Agent Orchestration [32.39337008619354]
  We propose a multi-agent orchestration framework that decomposes single-image 3D scene generation into three structured stages.<n>We introduce a geometry-aware layout predictor supervised by sparse geometric priors derived from point maps.<n>Our method consistently outperforms prior approaches in geometric accuracy, spatial consistency, and perceptual realism.
  arXiv  Detail & Related papers  (2026-06-07T01:38:39Z)
• WorldAct: Activating Monolithic 3D Worlds into Interactive-Ready Object-Centric Scenes [15.223046632151364]
  We present WorldAct, a framework that converts static generated 3D worlds into editable and interaction-ready scenes.<n>WorldAct uses a multimodal agent to guide scene decomposition, identify actionable objects, reconstruct geometrically aligned object-level meshes for interaction, and restore the residual background via 3D inpainting.<n> Experiments show that WorldAct enables richer interaction scenarios than the original generated scenes, suggesting a practical path toward editable and interactive 3D world models.
  arXiv  Detail & Related papers  (2026-05-15T10:56:23Z)
• Map2World: Segment Map Conditioned Text to 3D World Generation [64.2098235580955]
  3D world generation is essential for immersive content creation or autonomous driving simulation.<n>Recent advances in 3D world generation have shown promising results; however, these methods are constrained by grid layouts.<n>We introduce a novel framework, Map2World, that first enables 3D world generation conditioned on user-defined segment maps of arbitrary shapes and scales.
  arXiv  Detail & Related papers  (2026-05-01T16:56:49Z)
• SDesc3D: Towards Layout-Aware 3D Indoor Scene Generation from Short Descriptions [71.54559024212976]
  3D indoor scene generation conditioned on short textual descriptions provides a promising avenue for interactive 3D environment construction.<n>Existing works suffer from poor physical plausibility and insufficient detail richness in such semantic condensation cases.<n>We propose SDesc3D, a short-text conditioned 3D indoor scene generation framework, that leverages multi-view structural priors and regional functionality implications.
  arXiv  Detail & Related papers  (2026-04-02T12:33:01Z)
• WorldGen: From Text to Traversable and Interactive 3D Worlds [87.95088818329403]
  We introduce WorldGen, a system that enables the automatic creation of large-scale, interactive 3D worlds directly from text prompts.<n>Our approach transforms natural language descriptions into fully textured environments that can be immediately explored or edited within standard game engines.<n>This work represents a step towards accessible, generative world-building at scale, advancing the frontier of 3D generative AI for applications in gaming, simulation, and immersive social environments.
  arXiv  Detail & Related papers  (2025-11-20T22:13:18Z)
• WorldGrow: Generating Infinite 3D World [75.81531067447203]
  We tackle the challenge of generating the infinitely extendable 3D world -- large, continuous environments with coherent geometry and realistic appearance.<n>We propose WorldGrow, a hierarchical framework for unbounded 3D scene synthesis.<n>Our method features three core components: (1) a data curation pipeline that extracts high-quality scene blocks for training, making the 3D structured latent representations suitable for scene generation; (2) a 3D block inpainting mechanism that enables context-aware scene extension; and (3) a coarse-to-fine generation strategy that ensures both global layout plausibility and local geometric/textural fidelity.
  arXiv  Detail & Related papers  (2025-10-24T17:39:52Z)
• Agentic 3D Scene Generation with Spatially Contextualized VLMs [67.31920821192323]
  We introduce a new paradigm that enables vision-language models to generate, understand, and edit complex 3D environments.<n>We develop an agentic 3D scene generation pipeline in which the VLM iteratively reads from and updates the spatial context.<n>Results show that our framework can handle diverse and challenging inputs, achieving a level of generalization not observed in prior work.
  arXiv  Detail & Related papers  (2025-05-26T15:28:17Z)
• CULTURE3D: A Large-Scale and Diverse Dataset of Cultural Landmarks and Terrains for Gaussian-Based Scene Rendering [16.614203937535205]
  Current state-of-the-art 3D reconstruction models face limitations in building extra-large scale outdoor scenes.<n>In this paper, we present a extra-large fine-grained dataset with 10 billion points composed of 41,006 drone-captured high-resolution aerial images.<n>Compared to existing datasets, ours offers significantly larger scale and higher detail, uniquely suited for fine-grained 3D applications.
  arXiv  Detail & Related papers  (2025-01-12T20:36:39Z)
• LAW-Diffusion: Complex Scene Generation by Diffusion with Layouts [107.11267074981905]
  We propose a semantically controllable layout-AWare diffusion model, termed LAW-Diffusion. We show that LAW-Diffusion yields the state-of-the-art generative performance, especially with coherent object relations.
  arXiv  Detail & Related papers  (2023-08-13T08:06:18Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.