Learning to build covering structures with continuous adjustments

• URL: http://arxiv.org/abs/2609.08669v1
• Date: Tue, 08 Sep 2026 12:32:42 GMT
• Title: Learning to build covering structures with continuous adjustments
• Abstract summary: We introduce a reinforcement learning approach that generates construction sequences adaptively as the structure is built.<n>Because the stability simulation of a structure is computationally heavy, we develop an efficient exploration strategy.<n>We successfully build a spanning arch with 3D-printed blocks in closed-loop execution, confirming that policies trained in simulation transfer to real hardware.
• Score: 8.307608514694444
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Robotic construction offers the potential to use materials more efficiently and create complex geometries, but current methods rely on rigid, high-precision plans that cannot accommodate the tolerances, inaccuracies, and unexpected changes inherent in physical fabrication. In this work, we introduce a reinforcement learning approach that forgoes predefined plans entirely, instead generating construction sequences adaptively as the structure is built. Our method operates on graph-structured state representations and a mixed (parameterized) action space, requiring both discrete block selection and continuous placement parameters. Because the stability simulation of a structure is computationally heavy, we develop an efficient exploration strategy by incorporating unilateral edges into graph neural networks, extending soft actor-critic (SAC) to this hybrid setting. We evaluate our algorithm, HSAC, against the prior method hybrid-PPO (HPPO), demonstrating significantly higher asymptotic performance and good sample efficiency. We also demonstrate HSAC's robustness to hyperparameter choices and its exploration capability, handling up to 10 discrete actions without performance degradation. Finally, we validate our approach on a physical two-robot setup, successfully building a spanning arch with 3D-printed blocks in closed-loop execution, confirming that policies trained in simulation transfer to real hardware.

Related papers

• EUPHORIA: Efficient Universal Planning via Hybrid Optimization for Robust Industrial Robotic Assembly [12.727917085274841]
  EUPHORIA is a unified framework that achieves universal few-shot adaptability and dynamic efficiency.<n>For structural reasoning, we introduce a Physics-Informed Graph Transformer trained via Soft Actor-Critic.<n>Experiments show that EUPHORIA significantly reduces energy consumption over decoupled baselines.
  arXiv  Detail & Related papers  (2026-05-15T18:25:49Z)
• Rollback-Free Stable Brick Structures Generation [51.856925926010184]
  Existing approaches rely on external physical simulators during inference to perform rejection sampling and brick-by-brick rollbacks.<n>We propose a reinforcement learning paradigm that shifts physical validity enforcement from test-time correction to training-time policy optimization.<n> Experimental results demonstrate that our approach achieves state-of-the-art generation quality while accelerating inference speed by orders of magnitude.
  arXiv  Detail & Related papers  (2026-05-07T21:06:44Z)
• A Unified Low-Dimensional Design Embedding for Joint Optimization of Shape, Material, and Actuation in Soft Robots [4.829343342713712]
  We introduce a smooth, low-dimensional design embedding for soft robots that unifies shape morphing, multi-material distribution, and actuation.<n>In experiments, we show that design increases with the number of basis functions, unlike comparable neural network encodings.<n>We further show that joint co-optimization of shape, material, and actuation using our unified embedding consistently outperforms sequential strategies.
  arXiv  Detail & Related papers  (2026-03-06T17:33:32Z)
• Structural Action Transformer for 3D Dexterous Manipulation [80.07649565189035]
  Cross-embodiment skill transfer is a challenge for high-DoF robotic hands.<n>Existing methods, often relying on 2D observations and temporal-centric action representation, struggle to capture 3D spatial relations.<n>This paper proposes a new 3D dexterous manipulation policy that challenges this paradigm by introducing a structural-centric perspective.
  arXiv  Detail & Related papers  (2026-03-04T11:38:12Z)
• Learning to Build: Autonomous Robotic Assembly of Stable Structures Without Predefined Plans [10.231077693993736]
  Instead of following fixed plans, construction tasks are defined through targets and obstacles.<n>A reinforcement learning (RL) policy, trained using deep Q-learning with successor features, serves as the decision-making component.
  arXiv  Detail & Related papers  (2026-02-27T11:31:49Z)
• Mechanistic Design and Scaling of Hybrid Architectures [114.3129802943915]
  We identify and test new hybrid architectures constructed from a variety of computational primitives. We experimentally validate the resulting architectures via an extensive compute-optimal and a new state-optimal scaling law analysis. We find MAD synthetics to correlate with compute-optimal perplexity, enabling accurate evaluation of new architectures.
  arXiv  Detail & Related papers  (2024-03-26T16:33:12Z)
• SPO: Sequential Monte Carlo Policy Optimisation [41.52684912140086]
  We introduce SPO: Sequential Monte Carlo Policy optimisation. We show that SPO provides robust policy improvement and efficient scaling properties. We demonstrate statistically significant improvements in performance relative to model-free and model-based baselines.
  arXiv  Detail & Related papers  (2024-02-12T10:32:47Z)
• Towards Continual Learning Desiderata via HSIC-Bottleneck Orthogonalization and Equiangular Embedding [55.107555305760954]
  We propose a conceptually simple yet effective method that attributes forgetting to layer-wise parameter overwriting and the resulting decision boundary distortion. Our method achieves competitive accuracy performance, even with absolute superiority of zero exemplar buffer and 1.02x the base model.
  arXiv  Detail & Related papers  (2024-01-17T09:01:29Z)
• Provable Guarantees for Generative Behavior Cloning: Bridging Low-Level Stability and High-Level Behavior [51.60683890503293]
  We propose a theoretical framework for studying behavior cloning of complex expert demonstrations using generative modeling. We show that pure supervised cloning can generate trajectories matching the per-time step distribution of arbitrary expert trajectories.
  arXiv  Detail & Related papers  (2023-07-27T04:27:26Z)
• Graph-based Reinforcement Learning meets Mixed Integer Programs: An application to 3D robot assembly discovery [34.25379651790627]
  We tackle the problem of building arbitrary, predefined target structures entirely from scratch using a set of Tetris-like building blocks and a robotic manipulator. Our novel hierarchical approach aims at efficiently decomposing the overall task into three feasible levels that benefit mutually from each other.
  arXiv  Detail & Related papers  (2022-03-08T14:44:51Z)
• Composable Learning with Sparse Kernel Representations [110.19179439773578]
  We present a reinforcement learning algorithm for learning sparse non-parametric controllers in a Reproducing Kernel Hilbert Space. We improve the sample complexity of this approach by imposing a structure of the state-action function through a normalized advantage function. We demonstrate the performance of this algorithm on learning obstacle-avoidance policies in multiple simulations of a robot equipped with a laser scanner while navigating in a 2D environment.
  arXiv  Detail & Related papers  (2021-03-26T13:58:23Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.