Physics-Aware Combinatorial Assembly Sequence Planning using Data-free Action Masking

• URL: http://arxiv.org/abs/2408.10162v2
• Date: Fri, 08 Nov 2024 18:22:46 GMT
• Title: Physics-Aware Combinatorial Assembly Sequence Planning using Data-free Action Masking
• Authors: Ruixuan Liu, Alan Chen, Weiye Zhao, Changliu Liu,
• Abstract summary: Combinatorial assembly uses standardized unit primitives to build objects that satisfy user specifications. This paper studies assembly sequence planning (ASP) for physical assembly. We employ deep reinforcement learning to learn a construction policy for placing unit primitives sequentially to build the desired object.
• Score: 6.919208054874144
• License:
• Abstract: Combinatorial assembly uses standardized unit primitives to build objects that satisfy user specifications. This paper studies assembly sequence planning (ASP) for physical combinatorial assembly. Given the shape of the desired object, the goal is to find a sequence of actions for placing unit primitives to build the target object. In particular, we aim to ensure the planned assembly sequence is physically executable. However, ASP for combinatorial assembly is particularly challenging due to its combinatorial nature. To address the challenge, we employ deep reinforcement learning to learn a construction policy for placing unit primitives sequentially to build the desired object. Specifically, we design an online physics-aware action mask that filters out invalid actions, which effectively guides policy learning and ensures violation-free deployment. In the end, we apply the proposed method to Lego assembly with more than 250 3D structures. The experiment results demonstrate that the proposed method plans physically valid assembly sequences to build all structures, achieving a $100\%$ success rate, whereas the best comparable baseline fails more than $40$ structures. Our implementation is available at \url{https://github.com/intelligent-control-lab/PhysicsAwareCombinatorialASP}.

Related papers

• AssemblyComplete: 3D Combinatorial Construction with Deep Reinforcement Learning [4.3507834596906125]
  A critical goal in robotics is to teach robots to adapt to real-world collaborative tasks, particularly in automatic assembly. This paper introduces 3D assembly completion, which is demonstrated using unit primitives (i.e., Lego bricks) We propose a two-part deep reinforcement learning (DRL) framework that tackles teaching the robot to understand the objective of an incomplete assembly and learning a construction policy to complete the assembly.
  arXiv  Detail & Related papers  (2024-10-20T18:51:17Z)
• TreeSBA: Tree-Transformer for Self-Supervised Sequential Brick Assembly [51.29305265324916]
  We propose a class-agnostic tree-transformer framework to predict the sequential assembly actions from input multi-view images. A major challenge of the sequential brick assembly task is that the step-wise action labels are costly and tedious to obtain in practice. We mitigate this problem by leveraging synthetic-to-real transfer learning.
  arXiv  Detail & Related papers  (2024-07-22T14:05:27Z)
• SPAFormer: Sequential 3D Part Assembly with Transformers [52.980803808373516]
  We introduce SPAFormer, an innovative model designed to overcome the explosion challenge in the 3D Part Assembly task. It addresses this problem by leveraging constraints from assembly sequences, effectively reducing the solution space's complexity. It further enhances assembly through knowledge enhancement strategies that utilize the attributes of parts and their sequence information.
  arXiv  Detail & Related papers  (2024-03-09T10:53:11Z)
• Multi-level Reasoning for Robotic Assembly: From Sequence Inference to Contact Selection [74.40109927350856]
  We present the Part Assembly Sequence Transformer (PAST) to infer assembly sequences from a target blueprint. We then use a motion planner and optimization to generate part movements and contacts. Experimental results show that our approach generalizes better than prior methods.
  arXiv  Detail & Related papers  (2023-12-17T00:47:13Z)
• ASAP: Automated Sequence Planning for Complex Robotic Assembly with Physical Feasibility [27.424678100675163]
  We present ASAP, a physics-based planning approach for automatically generating a sequence for general-shaped assemblies. A search can be guided by either geometrics or graph neural networks trained on data with simulation labels. We show the superior performance of ASAP at generating physically realistic assembly sequence plans on a large dataset of hundreds of complex product assemblies.
  arXiv  Detail & Related papers  (2023-09-29T00:27:40Z)
• Planning Assembly Sequence with Graph Transformer [35.2954163574535]
  Assembly sequence planning (ASP) is proven to be NP-complete thus its effective and efficient solution has been a challenge for researchers in the field. We present a graph-transformer based framework for the ASP problem which is trained and demonstrated on a self-collected ASP database.
  arXiv  Detail & Related papers  (2022-10-11T08:06:16Z)
• Policy Architectures for Compositional Generalization in Control [71.61675703776628]
  We introduce a framework for modeling entity-based compositional structure in tasks. Our policies are flexible and can be trained end-to-end without requiring any action primitives.
  arXiv  Detail & Related papers  (2022-03-10T06:44:24Z)
• Graph-based Reinforcement Learning meets Mixed Integer Programs: An application to 3D robot assembly discovery [34.25379651790627]
  We tackle the problem of building arbitrary, predefined target structures entirely from scratch using a set of Tetris-like building blocks and a robotic manipulator. Our novel hierarchical approach aims at efficiently decomposing the overall task into three feasible levels that benefit mutually from each other.
  arXiv  Detail & Related papers  (2022-03-08T14:44:51Z)
• Brick-by-Brick: Combinatorial Construction with Deep Reinforcement Learning [52.85981207514049]
  We introduce a novel formulation, complex construction, which requires a building agent to assemble unit primitives sequentially. To construct a target object, we provide incomplete knowledge about the desired target (i.e., 2D images) instead of exact and explicit information to the agent. We demonstrate that the proposed method successfully learns to construct an unseen object conditioned on a single image or multiple views of a target object.
  arXiv  Detail & Related papers  (2021-10-29T01:09:51Z)
• Learning visual policies for building 3D shape categories [130.7718618259183]
  Previous work in this domain often assembles particular instances of objects from known sets of primitives. We learn a visual policy to assemble other instances of the same category. Our visual assembly policies are trained with no real images and reach up to 95% success rate when evaluated on a real robot.
  arXiv  Detail & Related papers  (2020-04-15T17:29:10Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.