A Continual Learning Framework for Adaptive Control of Modular Soft Robots
- URL: http://arxiv.org/abs/2607.06740v1
- Date: Tue, 07 Jul 2026 19:11:07 GMT
- Title: A Continual Learning Framework for Adaptive Control of Modular Soft Robots
- Abstract summary: Soft robots have attracted significant attention in applications such as medical intervention, rehabilitation, and robotic manipulation.<n>MSRs represent an emerging class of robotic systems with highly deformable and reconfigurable structures capable of performing complex tasks.<n>Existing approaches typically require controllers to be retrained from scratch whenever the robot morphology changes.<n>We propose a continual learning inspired control framework capable of incrementally adapting to changes in robot morphology.
- Score: 4.374184567811783
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Soft robots have attracted significant attention in applications such as medical intervention, rehabilitation, and robotic manipulation due to their inherent compliance, flexibility, and high degrees of freedom. Modular soft robots (MSRs), composed of multiple interconnected segments, represent an emerging class of robotic systems with highly deformable and reconfigurable structures capable of performing complex tasks. However, designing controllers for MSRs remains challenging due to their nonlinear dynamics, modeling complexity, and hyper-redundant nature. Existing approaches typically require controllers to be retrained from scratch whenever the robot morphology changes. In this work, we address these challenges through a continual learning inspired control framework capable of incrementally adapting to changes in robot morphology while preserving previously acquired knowledge. Specifically, the proposed framework enables the controller to sequentially learn new MSR configurations without forgetting previously learned ones. In addition, for MSRs with fixed configurations, the same framework can be employed in a distributed manner to learn module-specific dynamics, enabling localized control and improved precision. The proposed approach is validated through closed-loop trajectory tracking experiments in simulation using a tendon-driven soft robot, as well as on a real-world three-module pneumatic soft robotic arm. Furthermore, we demonstrate the adaptive capabilities of the framework through a reaching experiment in which the controller selectively activates only the necessary modules to reach a virtual target position, thereby reducing computational overhead.
Related papers
- Tendon-Driven Continuum Robot with Modular Stiffness and In-Situ Self Pose Estimation [11.597035276368608]
This paper presents a self-contained modular continuum robotic platform that combines mechanical reconfigurability with onboard pose estimation.<n>Proprioceptive sensing is achieved using magnetic sensors and a modular learning-based framework.<n>The system is experimentally validated in real world, demonstrating self-sensing capabilities and adaptation without external tracking.
arXiv Detail & Related papers (2026-09-14T19:21:09Z) - Learning Context-Aware Neural ODE Dynamics for Adaptive Robotic Control [55.01272784312405]
We propose a context-aware dynamics model based on neural ordinary differential equations.<n>We validate the approach across diverse robotic platforms, including a quadrotor in simulation, as well as a Sphero BOLT robot and a Fanuc manipulator in real-world experiments.
arXiv Detail & Related papers (2026-06-13T20:55:46Z) - Reinforcement learning in linear embedding space unlocks generalizable control across soft robot configurations [60.42735420750131]
Soft-bodied organisms such as octopuses and elephant trunks exhibit remarkable morphological adaptability.<n>Various soft robots have emerged in recent decades, featuring diverse materials, stiffnesses, and morphologies tailored to specific tasks.<n>Here, we introduce a generalizable control system that enables rapid adaptation across diverse soft robot configurations.
arXiv Detail & Related papers (2026-06-06T11:09:46Z) - X-OP: Cross-Morphology Whole-Body Teleoperation via MPC Retargeting [3.134050607080983]
Whole-body teleoperation is essential for scalable robot data collection in loco-manipulation tasks.<n>We propose a hierarchical whole-body teleoperation framework driven by a single XR device.<n>We show higher success rates on whole-body control tasks for both a humanoid and a mobile manipulator.
arXiv Detail & Related papers (2026-06-06T01:50:59Z) - Sim-to-Real Transfer for Muscle-Actuated Robots via Generalized Actuator Networks [53.12548325396181]
Tendon drives paired with soft muscle actuation enable faster and safer robots.<n>We propose a sim-to-real pipeline that learns a neural network model of this complex actuation.<n>We successfully deploy precise goal-reaching and dynamic ball-in-a-cup policies trained entirely in simulation.
arXiv Detail & Related papers (2026-04-10T16:52:54Z) - Current state of the multi-agent multi-view experimental and digital twin rendezvous (MMEDR-Autonomous) framework [0.0]
Machine learning-based methods can be integrated within the guidance, navigation, and control architecture to design a robust rendezvous and docking framework.<n>MMEDR-Autonomous is a unified framework comprising a learning-based optical navigation network, a reinforcement learning-based guidance approach under ongoing development, and a hardware-in-the-loop testbed.<n>The MMEDR-Autonomous framework is currently progressing toward integrated experimental validation in multi-agent rendezvous scenarios.
arXiv Detail & Related papers (2026-03-21T00:13:54Z) - HybridMimic: Hybrid RL-Centroidal Control for Humanoid Motion Mimicking [3.446278503007937]
HybridMimic is a framework in which a learned policy dynamically modulates a centroidal-model-based controller.<n>It reduces the average base position tracking error by 13% compared to a state-of-the-art RL baseline.
arXiv Detail & Related papers (2026-03-06T17:58:02Z) - Simulation-based Learning of Electrical Cabinet Assembly Using Robot Skills [2.900269335003268]
This paper presents a simulation-driven approach for automating the force-controlled assembly of electrical terminals on DIN-rails.<n>The proposed method integrates deep reinforcement learning (DRL) with parameterizable robot skills in a physics-based simulation environment.<n> Experimental results demonstrate high success rates (up to 100%) in both simulation and real-world settings, even under significant positional and rotational deviations.
arXiv Detail & Related papers (2026-02-16T08:45:54Z) - Robotic World Model: A Neural Network Simulator for Robust Policy Optimization in Robotics [50.191655141020505]
This work advances model-based reinforcement learning by addressing the challenges of long-horizon prediction, error accumulation, and sim-to-real transfer.<n>By providing a scalable and robust framework, the introduced methods pave the way for adaptive and efficient robotic systems in real-world applications.
arXiv Detail & Related papers (2025-01-17T10:39:09Z) - Learning and Adapting Agile Locomotion Skills by Transferring Experience [71.8926510772552]
We propose a framework for training complex robotic skills by transferring experience from existing controllers to jumpstart learning new tasks.
We show that our method enables learning complex agile jumping behaviors, navigating to goal locations while walking on hind legs, and adapting to new environments.
arXiv Detail & Related papers (2023-04-19T17:37:54Z) - Active Learning of Discrete-Time Dynamics for Uncertainty-Aware Model Predictive Control [46.81433026280051]
We present a self-supervised learning approach that actively models the dynamics of nonlinear robotic systems.
Our approach showcases high resilience and generalization capabilities by consistently adapting to unseen flight conditions.
arXiv Detail & Related papers (2022-10-23T00:45:05Z) - Active Predicting Coding: Brain-Inspired Reinforcement Learning for
Sparse Reward Robotic Control Problems [79.07468367923619]
We propose a backpropagation-free approach to robotic control through the neuro-cognitive computational framework of neural generative coding (NGC)
We design an agent built completely from powerful predictive coding/processing circuits that facilitate dynamic, online learning from sparse rewards.
We show that our proposed ActPC agent performs well in the face of sparse (extrinsic) reward signals and is competitive with or outperforms several powerful backprop-based RL approaches.
arXiv Detail & Related papers (2022-09-19T16:49:32Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.