Module Number Adaptive Visual Shape Control for Serial Modular Soft Robots

• URL: http://arxiv.org/abs/2608.29547v1
• Date: Sun, 30 Aug 2026 04:33:10 GMT
• Title: Module Number Adaptive Visual Shape Control for Serial Modular Soft Robots
• Abstract summary: This paper presents a module number adaptive visual shape control method for serial modular soft pneumatic robots.<n>A controller trained only on single module actuation shape data is reused for robots with one to five modules.<n>Experiments show that single module control learning enables scalable whole body control without configuration specific control data collection.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Image based shape control provides a simple means of controlling the whole body configuration of soft robots. However, existing data driven approaches are typically developed for fixed robot structures and require new control data when the number of modules changes. This paper presents a module number adaptive visual shape control method for serial modular soft pneumatic robots. A controller trained only on single module actuation shape data is reused for robots with one to five modules by decomposing whole body camera images into local module patches. A single common module segmenter localizes individual modules across all tested configurations, while the same local controller is applied to every extracted patch. Geometric data augmentation improves transferability to downstream modules, and a lightweight mask reconstruction network reconstructs a synthetically removed actuator mask channel. Experiments on physical robots demonstrate shape control across varying numbers of modules and under environmental changes and payload loading. The results show that single module control learning enables scalable whole body control without configuration specific control data collection.

Related papers

• Controllable Text-to-Motion Generation via Modular Body-Part Phase Control [25.2003430574182]
  Text-to-motion (T2M) generation is becoming a practical tool for animation and interactive avatars.<n>We propose Modular Body-Part Phase Control, a plug-and-play framework enabling structured, localized editing.<n> Experiments on both diffusion- and flow-based models demonstrate that our approach provides predictable and fine-grained control over motion magnitude, speed, and timing.
  arXiv  Detail & Related papers  (2026-03-20T09:37:16Z)
• Maestro: Orchestrating Robotics Modules with Vision-Language Models for Zero-Shot Generalist Robots [54.62646284378409]
  We build policies around vision-language models (VLMs) by augmenting their general capabilities with specific robot capabilities encapsulated in a curated set of perception, planning, and control modules.<n>In Maestro, a VLM coding agent dynamically composes these modules into a programmatic policy for the current task and scenario.
  arXiv  Detail & Related papers  (2025-11-02T12:34:37Z)
• MeMo: Meaningful, Modular Controllers via Noise Injection [25.541496793132183]
  We show that when a new robot is built from the same parts, its control can be quickly learned by reusing the modular controllers.<n>We achieve this with a framework called MeMo which learns (Me)aningful, (Mo)dular controllers.<n>We benchmark our framework in locomotion and grasping environments on simple to complex robot morphology transfer.
  arXiv  Detail & Related papers  (2024-05-24T18:39:20Z)
• Plug-and-Play Transformer Modules for Test-Time Adaptation [54.80435317208111]
  We introduce PLUTO: a Plug-and-pLay modUlar Test-time domain adaptatiOn strategy. We pre-train a large set of modules, each specialized for different source domains. We harness multiple most-relevant source domains in a single inference call.
  arXiv  Detail & Related papers  (2024-01-06T00:24:50Z)
• ModuleFormer: Modularity Emerges from Mixture-of-Experts [60.6148988099284]
  This paper proposes a new neural network architecture, ModuleFormer, to improve the efficiency and flexibility of large language models. Unlike the previous SMoE-based modular language model, ModuleFormer can induce modularity from uncurated data.
  arXiv  Detail & Related papers  (2023-06-07T17:59:57Z)
• Modular Transformers: Compressing Transformers into Modularized Layers for Flexible Efficient Inference [83.01121484432801]
  We introduce Modular Transformers, a modularized encoder-decoder framework for flexible sequence-to-sequence model compression. After a single training phase, Modular Transformers can achieve flexible compression ratios from 1.1x to 6x with little to moderate relative performance drop.
  arXiv  Detail & Related papers  (2023-06-04T15:26:28Z)
• Modular Deep Learning [120.36599591042908]
  Transfer learning has recently become the dominant paradigm of machine learning. It remains unclear how to develop models that specialise towards multiple tasks without incurring negative interference. Modular deep learning has emerged as a promising solution to these challenges.
  arXiv  Detail & Related papers  (2023-02-22T18:11:25Z)
• Behavior Trees in Robot Control Systems [0.0]
  Key idea underlying behavior trees is to make use of modularity, hierarchies and feedback. A hierarchy of such modules is natural, since robot tasks can often be decomposed into a hierarchy of sub-tasks. feedback control is a fundamental tool for handling uncertainties and disturbances in any low level control system.
  arXiv  Detail & Related papers  (2022-03-24T14:16:15Z)
• Learning Modular Robot Control Policies [10.503109190599828]
  We construct a modular control policy that handles a broad class of designs. As the modules are physically re-configured, the policy automatically re-configures to match the kinematic structure. We show that the policy can then generalize to a larger set of designs not seen during training.
  arXiv  Detail & Related papers  (2021-05-20T21:54:37Z)
• One Policy to Control Them All: Shared Modular Policies for Agent-Agnostic Control [47.78262874364569]
  We investigate whether there exists a single global policy that can generalize to control a wide variety of agent morphologies. We propose to express this global policy as a collection of identical modular neural networks. We show that a single modular policy can successfully generate locomotion behaviors for several planar agents.
  arXiv  Detail & Related papers  (2020-07-09T17:59:35Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.