Procedura: Agentic 3D Modeling with Procedural Control

• URL: http://arxiv.org/abs/2608.26238v1
• Date: Wed, 26 Aug 2026 17:54:39 GMT
• Title: Procedura: Agentic 3D Modeling with Procedural Control
• Abstract summary: Procedura is a novel 3D modeling agent framework that writes an object as a procedural assembly.<n>From a text prompt, the agent plans the object as an assembly graph and writes the program part by part.<n>A decoupled vision critic then refines the assembly one diagnosed fix at a time.
• Score: 52.232812096564906
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Native 3D generators now recover impressive mesh geometry from a single image. However, a dense mesh stays soft where a machined object should be sharp, it carries no part decomposition, and it exposes no parameter a user could edit. To address this, we explore the paradigm of 3D shape as code, leveraging and scaling the coding ability of an LLM for 3D modeling. We introduce Procedura, a novel 3D modeling agent framework that writes an object as a procedural assembly, a parametric program whose named parts are joined by typed, machine-checkable mates. From a text prompt, the agent plans the object as an assembly graph and writes the program part by part, solving each placement from the mated frames rather than guessing it, and admitting a part only once compile, mate, and connectivity checks pass. A decoupled vision critic then refines the assembly one diagnosed fix at a time. Moreover, the same graph carries per-part materials and a simulator-validated articulation. We evaluate on P3D-Bench under its assembly judge, and with the same judge on MechBench-36, our hard-surface benchmark. On both, Procedura outperforms state-of-the-art native 3D generators and every prior 3D-code agent on judged quality, produces the sharpest edges of any method we evaluate, and is the only one whose output is an editable, part-structured program.

Related papers

• SAM3D-Part: Interactive Part Selection and Generation from 3D Objects [20.379932054770588]
  We present SAM3D-Part, a prompt-driven framework for selective part generation from input 3D object meshes.<n>Experiments and ablations demonstrate that SAM3D-Part can significantly improve source alignment, reduce conditioning cost, and enable consistent selective part generation.
  arXiv  Detail & Related papers  (2026-09-14T14:26:34Z)
• P3D-Bench: Benchmarking MLLMs for Parametric 3D Generation and Structural Reasoning [37.03209423305997]
  We introduce P3D-Bench, a benchmark for parametric 3D generation.<n>Under a unified protocol, P3D-Bench covers three task families (Text-to-3D, Image-to-3D and Assembly-3D)<n>We evaluate frontier MLLMs and text-only LLMs on 400 text cases, 400 image cases and 203 annotated assemblies.
  arXiv  Detail & Related papers  (2026-06-09T17:36:34Z)
• 3D-CoS: A New 3D Reconstruction Paradigm Based on VLM Code Synthesis [69.23609431485401]
  We propose and systematically evaluate a new 3D reconstruction paradigm, where 3D assets are constructed as executable code.<n>Our study shows that code as a 3D representation offers strong controllability and locality, yielding stronger edit fidelity and better preservation of unedited regions.
  arXiv  Detail & Related papers  (2026-06-09T06:46:29Z)
• 3DCodeBench: Benchmarking Agentic Procedural 3D Modeling Via Code [25.904997126319547]
  3DCodeBench is a systematic benchmark for evaluating vision-language model (VLM) agents for procedural 3D generation in 3D modeling software.<n>We build 3DCodeArena, a ranking platform based on pairwise human preferences over generated 3D outputs.
  arXiv  Detail & Related papers  (2026-05-31T06:59:49Z)
• PatchAlign3D: Local Feature Alignment for Dense 3D Shape understanding [67.15800065888887]
  Current foundation models for 3D shapes excel at global tasks (retrieval, classification) but transfer poorly to local part-level reasoning.<n>We introduce an encoder-only 3D model that produces language-aligned patch-level features directly from point clouds.<n>Our 3D encoder achieves zero-shot 3D part segmentation with fast single-pass inference without any test-time multi-view rendering.
  arXiv  Detail & Related papers  (2026-01-05T18:55:45Z)
• PartGen: Part-level 3D Generation and Reconstruction with Multi-View Diffusion Models [63.1432721793683]
  We introduce PartGen, a novel approach that generates 3D objects composed of meaningful parts starting from text, an image, or an unstructured 3D object.<n>We evaluate our method on generated and real 3D assets and show that it outperforms segmentation and part-extraction baselines by a large margin.
  arXiv  Detail & Related papers  (2024-12-24T18:59:43Z)
• 3D Part Segmentation via Geometric Aggregation of 2D Visual Features [57.20161517451834]
  Supervised 3D part segmentation models are tailored for a fixed set of objects and parts, limiting their transferability to open-set, real-world scenarios.<n>Recent works have explored vision-language models (VLMs) as a promising alternative, using multi-view rendering and textual prompting to identify object parts.<n>To address these limitations, we propose COPS, a COmprehensive model for Parts that blends semantics extracted from visual concepts and 3D geometry to effectively identify object parts.
  arXiv  Detail & Related papers  (2024-12-05T15:27:58Z)
• 3D-GPT: Procedural 3D Modeling with Large Language Models [47.72968643115063]
  We introduce 3D-GPT, a framework utilizing large language models(LLMs) for instruction-driven 3D modeling. 3D-GPT positions LLMs as proficient problem solvers, dissecting the procedural 3D modeling tasks into accessible segments and appointing the apt agent for each task. Our empirical investigations confirm that 3D-GPT not only interprets and executes instructions, delivering reliable results but also collaborates effectively with human designers.
  arXiv  Detail & Related papers  (2023-10-19T17:41:48Z)
• Sketch2CAD: 3D CAD Model Reconstruction from 2D Sketch using Visual Transformer [0.0]
  Current 3D reconstruction methods generate outputs in the form of voxels, point clouds, or meshes.<n>These formats have inherent limitations, such as rough surfaces and distorted structures.<n>We present a novel 3D reconstruction method designed to overcome these disadvantages by reconstructing CAD-compatible models.
  arXiv  Detail & Related papers  (2023-09-28T21:02:04Z)
• AutoSweep: Recovering 3D Editable Objectsfrom a Single Photograph [54.701098964773756]
  We aim to recover 3D objects with semantic parts and can be directly edited. Our work makes an attempt towards recovering two types of primitive-shaped objects, namely, generalized cuboids and generalized cylinders. Our algorithm can recover high quality 3D models and outperforms existing methods in both instance segmentation and 3D reconstruction.
  arXiv  Detail & Related papers  (2020-05-27T12:16:24Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.