CubePart: An Open-Vocabulary Part-Controllable 3D Generator
- URL: http://arxiv.org/abs/2605.28763v1
- Date: Wed, 27 May 2026 17:22:38 GMT
- Title: CubePart: An Open-Vocabulary Part-Controllable 3D Generator
- Abstract summary: We present CubePart, a generative framework for open-vocabulary, part-controllable 3D mesh generation.<n>Our method generates a set of meshes that assemble into a coherent object while respecting the specified semantic structure.<n>We demonstrate that the resulting assets can be directly integrated into game engines and driven by animation and behavior scripts without manual post-processing.
- Score: 25.37244384706095
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Interactive 3D assets used in games and simulation are typically decomposed into specific semantic parts to support animation, physics, and scripted behaviors, yet most generative 3D models produce either monolithic meshes or arbitrary part decompositions that cannot be aligned with application-specific requirements. We present CubePart, a generative framework for open-vocabulary, part-controllable 3D mesh generation that exposes part structure as an explicit inference-time control signal. Given a global text prompt and a user-defined parts schema expressed as an open-ended list of part names, our method generates a set of meshes - one per schema element - that assemble into a coherent object while respecting the specified semantic structure. To enable this capability, we introduce a scalable data pipeline to construct a large open-vocabulary, part-labeled 3D dataset, along with a two-stage generative architecture that separates global shape synthesis from part-level decoding. We demonstrate that the resulting assets can be directly integrated into game engines and driven by animation and behavior scripts without manual post-processing. Project Page: https://cubepart.github.io/
Related papers
- SAM3D-Part: Interactive Part Selection and Generation from 3D Objects [20.379932054770588]
We present SAM3D-Part, a prompt-driven framework for selective part generation from input 3D object meshes.<n>Experiments and ablations demonstrate that SAM3D-Part can significantly improve source alignment, reduce conditioning cost, and enable consistent selective part generation.
arXiv Detail & Related papers (2026-09-14T14:26:34Z) - Procedura: Agentic 3D Modeling with Procedural Control [52.232812096564906]
Procedura is a novel 3D modeling agent framework that writes an object as a procedural assembly.<n>From a text prompt, the agent plans the object as an assembly graph and writes the program part by part.<n>A decoupled vision critic then refines the assembly one diagnosed fix at a time.
arXiv Detail & Related papers (2026-08-26T17:54:39Z) - MultiCube: Compositional 3D Generation With Part-Level Semantic and Spatial Control [43.67846683430802]
MultiCube is a compositional 3D generation method that provides explicit, independent control over both the semantics and spatial arrangement of each part.<n>It outputs a 3D object composed of distinct meshes, one per specified part, that adhere to the given semantic and spatial conditions.
arXiv Detail & Related papers (2026-08-20T17:44:48Z) - PatchAlign3D: Local Feature Alignment for Dense 3D Shape understanding [67.15800065888887]
Current foundation models for 3D shapes excel at global tasks (retrieval, classification) but transfer poorly to local part-level reasoning.<n>We introduce an encoder-only 3D model that produces language-aligned patch-level features directly from point clouds.<n>Our 3D encoder achieves zero-shot 3D part segmentation with fast single-pass inference without any test-time multi-view rendering.
arXiv Detail & Related papers (2026-01-05T18:55:45Z) - Name That Part: 3D Part Segmentation and Naming [13.782629682520422]
We propose ALIGN-Parts, which formulates part naming as a direct set alignment task.<n>Our method decomposes shapes into partlets - implicit 3D part representations - matched to part descriptions via bipartite assignment.<n>Our model supports zero-shot matching to arbitrary descriptions and confidence-calibrated predictions for known categories.
arXiv Detail & Related papers (2025-12-19T19:02:36Z) - OmniPart: Part-Aware 3D Generation with Semantic Decoupling and Structural Cohesion [31.767548415448957]
We introduce OmniPart, a novel framework for part-aware 3D object generation.<n>Our approach supports user-defined part granularity, precise localization, and enables diverse downstream applications.
arXiv Detail & Related papers (2025-07-08T16:46:15Z) - PartCrafter: Structured 3D Mesh Generation via Compositional Latent Diffusion Transformers [29.52313100024294]
We introduce PartCrafter, the first structured 3D generative model that jointly synthesizes multiple semantically meaningful and geometrically distinct 3D meshes from a single RGB image.<n>PartCrafter simultaneously denoises multiple 3D parts, enabling end-to-end part-aware generation of both individual objects and complex multi-object scenes.<n> Experiments show that PartCrafter outperforms existing approaches in generating decomposable 3D meshes.
arXiv Detail & Related papers (2025-06-05T20:30:28Z) - Chirpy3D: Creative Fine-grained 3D Object Fabrication via Part Sampling [128.23917788822948]
Chirpy3D is a novel approach for fine-grained 3D object generation in a zero-shot setting.<n>The model must infer plausible 3D structures, capture fine-grained details, and generalize to novel objects.<n>Our experiments demonstrate that Chirpy3D surpasses existing methods in generating creative 3D objects with higher quality and fine-grained details.
arXiv Detail & Related papers (2025-01-07T21:14:11Z) - PartGen: Part-level 3D Generation and Reconstruction with Multi-View Diffusion Models [63.1432721793683]
We introduce PartGen, a novel approach that generates 3D objects composed of meaningful parts starting from text, an image, or an unstructured 3D object.<n>We evaluate our method on generated and real 3D assets and show that it outperforms segmentation and part-extraction baselines by a large margin.
arXiv Detail & Related papers (2024-12-24T18:59:43Z) - 3D Part Segmentation via Geometric Aggregation of 2D Visual Features [57.20161517451834]
Supervised 3D part segmentation models are tailored for a fixed set of objects and parts, limiting their transferability to open-set, real-world scenarios.<n>Recent works have explored vision-language models (VLMs) as a promising alternative, using multi-view rendering and textual prompting to identify object parts.<n>To address these limitations, we propose COPS, a COmprehensive model for Parts that blends semantics extracted from visual concepts and 3D geometry to effectively identify object parts.
arXiv Detail & Related papers (2024-12-05T15:27:58Z) - Disentangled 3D Scene Generation with Layout Learning [109.03233745767062]
We introduce a method to generate 3D scenes that are disentangled into their component objects.
Our key insight is that objects can be discovered by finding parts of a 3D scene that, when rearranged spatially, still produce valid configurations of the same scene.
We show that despite its simplicity, our approach successfully generates 3D scenes into individual objects.
arXiv Detail & Related papers (2024-02-26T18:54:15Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.