Sequential Brick Assembly with Efficient Constraint Satisfaction

• URL: http://arxiv.org/abs/2210.01021v1
• Date: Mon, 3 Oct 2022 15:35:08 GMT
• Title: Sequential Brick Assembly with Efficient Constraint Satisfaction
• Authors: Seokjun Ahn, Jungtaek Kim, Minsu Cho, Jaesik Park
• Abstract summary: We address the problem of generating a sequence of LEGO brick assembly with high-fidelity structures. Our method performs a brick structure assessment to predict the next brick position and its confidence by employing a U-shaped sparse 3D convolutional network. Instead of using handcrafted brick assembly datasets, our model is trained with a large number of 3D objects that allow to create a new high-fidelity structure.
• Score: 39.869693447362145
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We address the problem of generating a sequence of LEGO brick assembly with high-fidelity structures, satisfying physical constraints between bricks. The assembly problem is challenging since the number of possible structures increases exponentially with the number of available bricks, complicating the physical constraints to satisfy across bricks. To tackle this problem, our method performs a brick structure assessment to predict the next brick position and its confidence by employing a U-shaped sparse 3D convolutional network. The convolution filter efficiently validates physical constraints in a parallelizable and scalable manner, allowing to process of different brick types. To generate a novel structure, we devise a sampling strategy to determine the next brick position by considering attachable positions under physical constraints. Instead of using handcrafted brick assembly datasets, our model is trained with a large number of 3D objects that allow to create a new high-fidelity structure. We demonstrate that our method successfully generates diverse brick structures while handling two different brick types and outperforms existing methods based on Bayesian optimization, graph generative model, and reinforcement learning, all of which are limited to a single brick type.

Related papers

• Generating Physically Stable and Buildable Brick Structures from Text [63.75381708299733]
  BrickGPT is the first approach for generating physically stable assembly models from text prompts.<n>We release our dataset, StableText2Brick, containing over7,000 3D textured brick structures.
  arXiv  Detail & Related papers  (2025-05-08T17:58:18Z)
• Reinforcement learning with combinatorial actions for coupled restless bandits [62.89013331120493]
  We propose SEQUOIA, an RL algorithm that directly optimize for long-term reward over the feasible action space. We empirically validate SEQUOIA on four novel restless bandit problems with constraints: multiple interventions, path constraints, bipartite matching, and capacity constraints.
  arXiv  Detail & Related papers  (2025-03-01T21:25:21Z)
• Scalable iterative pruning of large language and vision models using block coordinate descent [0.31410859223862103]
  Pruning neural networks, which involves removing a fraction of their weights, can often maintain high accuracy while significantly reducing model complexity, at least up to a certain limit. We present a neural network pruning technique that builds upon the Combinatorial Brain Surgeon, but solves an optimization problem over a subset of the network weights in an iterative, block-wise manner.
  arXiv  Detail & Related papers  (2024-11-26T17:54:02Z)
• MILP-StuDio: MILP Instance Generation via Block Structure Decomposition [55.79888361191114]
  Mixed-integer linear programming (MILP) is one of the most popular mathematical formulations with numerous applications. We propose a novel MILP generation framework, called Block Structure Decomposition (MILP-StuDio), to generate high-quality instances by preserving the block structures.
  arXiv  Detail & Related papers  (2024-10-30T08:33:27Z)
• TreeSBA: Tree-Transformer for Self-Supervised Sequential Brick Assembly [51.29305265324916]
  We propose a class-agnostic tree-transformer framework to predict the sequential assembly actions from input multi-view images. A major challenge of the sequential brick assembly task is that the step-wise action labels are costly and tedious to obtain in practice. We mitigate this problem by leveraging synthetic-to-real transfer learning.
  arXiv  Detail & Related papers  (2024-07-22T14:05:27Z)
• Learning Stackable and Skippable LEGO Bricks for Efficient, Reconfigurable, and Variable-Resolution Diffusion Modeling [98.65190562585461]
  Diffusion models excel at generating photo-realistic images but come with significant computational costs. Current options like U-Net and Vision Transformer often rely on resource-intensive deep networks. This study introduces LEGO bricks, which seamlessly integrate Local-feature Enrichment and Global-content Orchestration.
  arXiv  Detail & Related papers  (2023-10-10T07:52:30Z)
• Brick-by-Brick: Combinatorial Construction with Deep Reinforcement Learning [52.85981207514049]
  We introduce a novel formulation, complex construction, which requires a building agent to assemble unit primitives sequentially. To construct a target object, we provide incomplete knowledge about the desired target (i.e., 2D images) instead of exact and explicit information to the agent. We demonstrate that the proposed method successfully learns to construct an unseen object conditioned on a single image or multiple views of a target object.
  arXiv  Detail & Related papers  (2021-10-29T01:09:51Z)
• Spatial Assembly: Generative Architecture With Reinforcement Learning, Self Play and Tree Search [1.2691047660244335]
  We investigate the use of Reinforcement Learning for the generation of spatial assemblies. We propose an algorithm that uses Reinforcement Learning and Self-Play to learn a policy that generates assemblies that maximize objectives set by the designer.
  arXiv  Detail & Related papers  (2021-01-19T11:57:10Z)
• An Integer Linear Programming Framework for Mining Constraints from Data [81.60135973848125]
  We present a general framework for mining constraints from data. In particular, we consider the inference in structured output prediction as an integer linear programming (ILP) problem. We show that our approach can learn to solve 9x9 Sudoku puzzles and minimal spanning tree problems from examples without providing the underlying rules.
  arXiv  Detail & Related papers  (2020-06-18T20:09:53Z)
• Combinatorial 3D Shape Generation via Sequential Assembly [40.2815083025929]
  Sequential assembly with geometric primitives has drawn attention in robotics and 3D vision since it yields a practical blueprint to construct a target shape. We propose a 3D shape generation framework to alleviate this consequence induced by a huge number of feasible combinations. Experimental results demonstrate that our method successfully generates 3D shapes and simulates more realistic generation processes.
  arXiv  Detail & Related papers  (2020-04-16T01:23:14Z)
• Automatic Generation of Algorithms for Black-Box Robust Optimisation Problems [0.0]
  We develop algorithms capable of tackling robust black-box optimisation problems, where the number of model runs is limited. We employ an automatic generation of algorithms approach: Grammar-Guided Genetic Programming. Our algorithmic building blocks combine elements of existing techniques and new features, resulting in the investigation of a novel solution space.
  arXiv  Detail & Related papers  (2020-04-15T18:51:33Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.