SceneCode: Executable World Programs for Editable Indoor Scenes with Articulated Objects

• URL: http://arxiv.org/abs/2605.19587v1
• Date: Tue, 19 May 2026 09:31:04 GMT
• Title: SceneCode: Executable World Programs for Editable Indoor Scenes with Articulated Objects
• Abstract summary: Indoor scene synthesis underpins embodied AI, robotic manipulation, and simulation-based policy evaluation.<n>Existing pipelines represent generated content as static meshes and inherit articulation only from curated asset libraries.<n>We present SceneCode, a framework that compiles a natural language prompt into an executable, code-driven indoor world.
• Score: 69.20984454755512
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Indoor scene synthesis underpins embodied AI, robotic manipulation, and simulation-based policy evaluation, where a useful scene must specify not only what the environment looks like, but also how its objects are structured. Existing pipelines, however, typically represent generated content as static meshes and inherit articulation only from curated asset libraries, which limits object-level controllability and prevents new interactable assets from being produced on demand. We address this gap by formulating physically interactable indoor scene synthesis as programmatic world generation, and present SceneCode, a framework that compiles a natural language prompt into an executable, code-driven indoor world rather than a collection of opaque meshes. A room-level agentic backbone first turns the prompt into a structured house layout and emits per-object AssetRequests through a planner--designer--critic loop. Each request is then routed to one of five code-generation strategies and converted into a synthesized part-wise Blender Python programs that are validated through an execution-guided repair-and-refine loop. The resulting programs are compiled into simulation-ready assets, and exported as SDF for physics simulation. A persistent scene-state registry links object requests, executable programs, rendered geometry, and simulation assets, turning scene assembly into a traceable and locally editable world-building process. We evaluate SceneCode across scene-level synthesis, object-level asset quality, human judgment, and downstream robot interaction. Results show that executable world programs improve prompt-faithful indoor scene generation and produce assets with cleaner mesh structure, and simulator-loadable articulation metadata. Project page: https://scene-code.github.io/.

Related papers

• NeoWorld-Pro: Programming Interactive Scenes from Monocular Images for Embodied Simulation [37.57654523550713]
  NeoWorld-Pro is a framework that reformulates monocular scene reconstruction as procedural programming for interactive 3D environments.<n>A physics-in-the-loop mechanism then iteratively refines the generated programs by validating their execution in a physics engine.
  arXiv  Detail & Related papers  (2026-08-25T08:19:39Z)
• Agentic Real2Sim: Physics-based World Modeling with Vision-Language Agents [42.18672329354181]
  We introduce textitAgentic Real2Sim, a framework for generalized physical world modeling with vision-language agents.<n>We evaluate Agentic Real2Sim on rigid-object manipulation, deformable-object interaction, and humanoid motion scenes.<n>The framework's agentic decisions can be driven by an open-weight VLM backend at a small fraction of the cost of frontier models.
  arXiv  Detail & Related papers  (2026-07-21T15:23:38Z)
• SimWorlds: A Multi-Agent System for Dynamic 3D Scene Creation [50.175987640001644]
  We present SimWorlds: a multi-agent framework that produces dynamic, editable 4D scenes from text.<n>We also introduce 4DBuildBench, a benchmark for assessing both visual fidelity and physical consistency of the procedural dynamic 3D scenes.
  arXiv  Detail & Related papers  (2026-07-02T06:29:18Z)
• WorldAct: Activating Monolithic 3D Worlds into Interactive-Ready Object-Centric Scenes [15.223046632151364]
  We present WorldAct, a framework that converts static generated 3D worlds into editable and interaction-ready scenes.<n>WorldAct uses a multimodal agent to guide scene decomposition, identify actionable objects, reconstruct geometrically aligned object-level meshes for interaction, and restore the residual background via 3D inpainting.<n> Experiments show that WorldAct enables richer interaction scenarios than the original generated scenes, suggesting a practical path toward editable and interactive 3D world models.
  arXiv  Detail & Related papers  (2026-05-15T10:56:23Z)
• SAGE: Scalable Agentic 3D Scene Generation for Embodied AI [67.43935343696982]
  Existing scene-generation systems often rely on rule-based or task-specific pipelines, yielding artifacts and physically invalid scenes.<n>We present SAGE, an agentic framework that, given a user-specified embodied task, understands the intent and automatically generates simulation-ready environments at scale.<n>The resulting environments are realistic, diverse, and directly deployable in modern simulators for policy training.
  arXiv  Detail & Related papers  (2026-02-10T18:59:55Z)
• SceneSmith: Agentic Generation of Simulation-Ready Indoor Scenes [19.995619927680476]
  SceneSmith builds environments from architectural layout to natural furniture population.<n>SceneSmith generates more objects than prior methods, with 2% interobject collisions and 96% of objects remaining stable under physics simulation.<n>SceneSmith environments can be used in an end-to-end pipeline for automatic policy evaluation.
  arXiv  Detail & Related papers  (2026-02-09T19:56:04Z)
• RoomEditor++: A Parameter-Sharing Diffusion Architecture for High-Fidelity Furniture Synthesis [89.26382925677301]
  Virtual furniture synthesis holds substantial promise for home design and e-commerce applications.<n>RoomEditor++ is a versatile diffusion-based architecture featuring a parameter-sharing dual diffusion backbone.<n>RoomEditor++ is superior over state-of-the-art approaches in terms of quantitative metrics, qualitative assessments, and human preference studies.
  arXiv  Detail & Related papers  (2025-12-19T13:39:43Z)
• ArtiWorld: LLM-Driven Articulation of 3D Objects in Scenes [43.19849355456126]
  ArtiWorld is a scene-aware pipeline that localizes candidate articulable objects from textual scene descriptions.<n>At the core of this pipeline is Arti4URDF, which leverages 3D point cloud and prior knowledge of a large language model.<n>We evaluate ArtiWorld at three levels: 3D simulated objects, full 3D simulated scenes, and real-world scan scenes.
  arXiv  Detail & Related papers  (2025-11-17T04:59:21Z)
• REACT3D: Recovering Articulations for Interactive Physical 3D Scenes [96.27769519526426]
  REACT3D is a framework that converts static 3D scenes into simulation-ready interactive replicas with consistent geometry.<n>We achieve state-of-the-art performance on detection/segmentation and articulation metrics across diverse indoor scenes.
  arXiv  Detail & Related papers  (2025-10-13T12:37:59Z)
• LiveScene: Language Embedding Interactive Radiance Fields for Physical Scene Rendering and Control [43.25983939699873]
  This paper scales object-level reconstruction to complex scenes, advancing interactive scene reconstruction.<n>We propose LiveScene, a scene-level language-embedded interactive radiance field that efficiently reconstructs and controls multiple objects.
  arXiv  Detail & Related papers  (2024-06-23T07:26:13Z)
• SceneCraft: An LLM Agent for Synthesizing 3D Scene as Blender Code [76.22337677728109]
  SceneCraft is a Large Language Model (LLM) Agent converting text descriptions into Blender-executable Python scripts. SceneCraft renders complex scenes with up to a hundred 3D assets. We tackle these challenges through a combination of advanced abstraction, strategic planning, and library learning.
  arXiv  Detail & Related papers  (2024-03-02T16:16:26Z)
• CommonScenes: Generating Commonsense 3D Indoor Scenes with Scene Graph Diffusion [83.30168660888913]
  We present CommonScenes, a fully generative model that converts scene graphs into corresponding controllable 3D scenes. Our pipeline consists of two branches, one predicting the overall scene layout via a variational auto-encoder and the other generating compatible shapes. The generated scenes can be manipulated by editing the input scene graph and sampling the noise in the diffusion model.
  arXiv  Detail & Related papers  (2023-05-25T17:39:13Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.