BrickAnything: Geometry-Conditioned Buildable Brick Generation with Structure-Aware Tokenization

• URL: http://arxiv.org/abs/2605.26182v1
• Date: Mon, 25 May 2026 07:33:25 GMT
• Title: BrickAnything: Geometry-Conditioned Buildable Brick Generation with Structure-Aware Tokenization
• Abstract summary: BrickAnything is a geometry-conditioned autoregressive framework for generating buildable brick structures from diverse 3D representations.<n>To model structural dependencies among bricks, we introduce a structure-aware tree tokenization, which represents brick structures through local attachment relations.<n>Extensive experiments demonstrate that BrickAnything produces geometrically faithful and physically realizable brick structures.
• Score: 9.148773572697763
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Generating physically buildable brick structures from 3D shapes requires more than geometric reconstruction: the output must also satisfy discrete part constraints and structural stability. Existing brick generation methods either rely on heuristic optimization, which can break down when the target 3D shape does not admit a feasible structure under predefined constraints, or generate brick sequences without explicitly modeling the underlying 3D geometry and assembly relations. In this work, we present BrickAnything, a geometry-conditioned autoregressive framework for generating buildable brick structures from diverse 3D representations. BrickAnything uses point clouds as a unified geometric interface and predicts brick sequences that reconstruct the target shape under assembly constraints. To model structural dependencies among bricks, we introduce a structure-aware tree tokenization, which represents brick structures through local attachment relations. This formulation makes sequence generation more consistent with the physical construction process, and reduces invalid intermediate states. We further introduce preference-based alignment post-training, validity-constrained decoding and adaptive rollback to improve buildability objectives such as stability and geometric fidelity. Extensive experiments demonstrate that BrickAnything produces geometrically faithful and physically realizable brick structures, and that the proposed tokenization effectively reduces rollback and regeneration compared with conventional ordering strategies.

Related papers

• Beyond Spatial Compression: Interface-Centric Generative States for Open-World 3D Structure [55.17771962316751]
  Current 3D tokenizers treat representation as spatial compression, but leave component ownership and attachment validity implicit.<n>We formulate an alternative view, interface-centric generative states, in which tokenization constructs an operational state rather than a passive compressed code.<n>We instantiate this formulation with Component-Conditioned Canonical Local Tokens (C2LT-3D), factorizing representation into canonical local geometry, partition-conditioned context, and relational seam variables.
  arXiv  Detail & Related papers  (2026-05-11T12:09:28Z)
• Mind the Gap: Geometrically Accurate Generative Reconstruction from Disjoint Views [0.8435195043404353]
  We introduce Generative Reconstruction from Disjoint Views as a new paradigm.<n>We propose GLADOS, a general, modular framework that operates through three stages.<n>As an architectureagnostic framework, GLADOS enables seamless integration of future advances in generation, reconstruction, and inpainting.
  arXiv  Detail & Related papers  (2026-05-08T10:24:23Z)
• Rollback-Free Stable Brick Structures Generation [51.856925926010184]
  Existing approaches rely on external physical simulators during inference to perform rejection sampling and brick-by-brick rollbacks.<n>We propose a reinforcement learning paradigm that shifts physical validity enforcement from test-time correction to training-time policy optimization.<n> Experimental results demonstrate that our approach achieves state-of-the-art generation quality while accelerating inference speed by orders of magnitude.
  arXiv  Detail & Related papers  (2026-05-07T21:06:44Z)
• Learning Hierarchical and Geometry-Aware Graph Representations for Text-to-CAD [22.163726324892256]
  We propose a hierarchical and geometry-aware graph as an intermediate representation.<n>Instead of mapping text directly to code, our framework first predicts structure and constraints, then conditions action sequencing and code generation.<n>Our method consistently outperforms existing approaches in both geometric fidelity and accurate satisfaction of geometric constraints.
  arXiv  Detail & Related papers  (2026-04-11T07:49:16Z)
• Light-SQ: Structure-aware Shape Abstraction with Superquadrics for Generated Meshes [60.92139345612904]
  We present Light-SQ, a novel superquadric-based optimization framework.<n>We propose a block-regrow-fill strategy guided by structure-aware volumetric decomposition.<n>Experiments demonstrate that Light-SQ enables efficient, high-fidelity, and editable shape abstraction with superquadrics.
  arXiv  Detail & Related papers  (2025-09-29T16:18:32Z)
• GSDiff: Synthesizing Vector Floorplans via Geometry-enhanced Structural Graph Generation [3.78198085695976]
  architectural floorplan design is vital for housing and interior design, offering a faster, cost-effective alternative to manual sketches by architects.<n>Existing methods, including rule-based and learning-based approaches, face challenges in design and constrained generation with extensive post-processing.<n>We propose a novel generative framework for vector design via structural graph generation, called GSDiff.
  arXiv  Detail & Related papers  (2024-08-29T04:40:31Z)
• StructRe: Rewriting for Structured Shape Modeling [60.20359722058389]
  We present StructRe, a structure rewriting system, as a novel approach to structured shape modeling.<n>Given a 3D object represented by points and components, StructRe can rewrite it upward into more concise structures, or downward into more detailed structures.
  arXiv  Detail & Related papers  (2023-11-29T10:35:00Z)
• Budget-Aware Sequential Brick Assembly with Efficient Constraint Satisfaction [63.672314717599285]
  We tackle the problem of sequential brick assembly with LEGO bricks to create 3D structures. In particular, the number of assemblable structures increases exponentially as the number of bricks used increases. We propose a new method to predict the scores of the next brick position by employing a U-shaped sparse 3D convolutional neural network.
  arXiv  Detail & Related papers  (2022-10-03T15:35:08Z)
• DSG-Net: Learning Disentangled Structure and Geometry for 3D Shape Generation [98.96086261213578]
  We introduce DSG-Net, a deep neural network that learns a disentangled structured and geometric mesh representation for 3D shapes. This supports a range of novel shape generation applications with disentangled control, such as of structure (geometry) while keeping geometry (structure) unchanged. Our method not only supports controllable generation applications but also produces high-quality synthesized shapes, outperforming state-of-the-art methods.
  arXiv  Detail & Related papers  (2020-08-12T17:06:51Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.