Learning Control as Enabling Layer for Embodied Intelligence Research explored with Soft Robotic Swimming in diverse Flow Speeds

• URL: http://arxiv.org/abs/2606.20660v1
• Date: Tue, 09 Jun 2026 15:20:13 GMT
• Title: Learning Control as Enabling Layer for Embodied Intelligence Research explored with Soft Robotic Swimming in diverse Flow Speeds
• Abstract summary: We evaluate whether augmenting PID control with a Linear Repetitive Learning Estimation Scheme (PID-LRLES) recovers tracking accuracy and repeatability under dynamic flow.<n>The LRLES generalizes classical integral action from constant to periodic, non-constant references, while using a stable transfer-function realization.<n>This approach provides an enabling layer for future robophysical studies seeking to isolate the effects of morphology, sensing, and environmental flow on aquatic locomotion.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Soft robots are valuable robophysical platforms for studying body-caudal undulatory locomotion, but their compliant bodies are difficult to control precisely under changing hydrodynamic loading. Conventional proportional-integral-derivative (PID) feedback stabilizes periodic undulation in static water, but can accumulate flow-dependent tracking delay and increasing inter-trial variability when environmental flow becomes non-trivial. Here, we evaluate whether augmenting PID control with a Linear Repetitive Learning Estimation Scheme (PID-LRLES) recovers tracking accuracy and repeatability under dynamic flow. The LRLES generalizes classical integral action from constant to periodic, non-constant references, while using a stable transfer-function realization whose poles have negative real parts to avoid the long-term instability issues of classical repetitive control. Closed-loop experiments were carried out in a recirculating flow tank at five bulk flow speeds spanning 0 to 32.6 cm s^-1, using an embedded soft capacitive bending sensor at a 1 kHz control-loop rate. With controller gains tuned once in static water and then held fixed across all conditions, PID-LRLES tracked the periodic bending-envelope reference more closely than the PID baseline and significantly reduced the inter-trial spread of the per-trial RMSE (paired Wilcoxon signed-rank test, p = 1.8 x 10^-4, n = 25). Embedded soft proprioception and cycle-to-cycle learning act as complementary contributors to robustness: the sensor exposes the periodic hydrodynamic bias in body deformation, while the learning term absorbs it over recent oscillation cycles. By reducing flow-dependent control-induced variability, the approach provides an enabling layer for future robophysical studies seeking to isolate the effects of morphology, sensing, and environmental flow on aquatic locomotion.

Related papers

• Self-Supervised Cardiac Phase Detection via Single-Parameter Latent Orbits [44.45620787098836]
  Accurate identification of end-diastole (ED) and end-systole (ES) in echocardiography underpins the quantification of ventricular function.<n>Recent self-supervised methods either prescribe strict periodic trajectories or learn an unconstrained low-dimensional motion subspace from reconstruction or registration objectives.<n>We learn an effective latent orbit, significantly improves upon the previous state of the art in ED localisation and matches it in ES localisation while using a more constrained representation and fewer training epochs.
  arXiv  Detail & Related papers  (2026-09-10T14:56:16Z)
• Micro-Swarm Locomotion Optimization in Dynamic Flow using Multi-Objective Multi-Agent Reinforcement Learning [2.0223202343873226]
  Coordinating micro-robotic swarms in physiologically realistic, time-dependent fluid environments remains an unsolved challenge.<n>We present a hybrid Computational Fluid Dynamics - Multi-Objective Multi-Agent Reinforcement Learning framework.<n>16 magnetically actuated micro-robots navigate a pulsatile arterial, simultaneously optimizing upstream progression, energy conservation, and motion smoothness.
  arXiv  Detail & Related papers  (2026-05-24T12:04:29Z)
• A Flow Matching Framework for Soft-Robot Inverse Dynamics [13.045225329973617]
  inverse-dynamics framework for open-loop feedforward control learns the system's differential dynamics as a generative transport map.<n>Work demonstrates flow matching as a robust, high-performance paradigm for learning differential inverse dynamics in soft robotic systems.
  arXiv  Detail & Related papers  (2026-04-03T12:45:46Z)
• Uncertainty-Aware Adaptive Dynamics For Underwater Vehicle-Manipulator Robots [0.5161531917413708]
  This paper introduces a novel uncertainty-aware adaptive dynamics model framework.<n>It embeds convex physical consistency constraints during online estimation.<n>Experiments on a BlueROV2 Heavy with a 4-DOF manipulator demonstrate rapid convergence and calibrated predictions.
  arXiv  Detail & Related papers  (2026-03-06T18:35:48Z)
• When Sensors Fail: Temporal Sequence Models for Robust PPO under Sensor Drift [64.37959940809633]
  We study robustness of Proximal Policy Optimization (PPO) under temporally persistent sensor failures.<n>We show Transformer-based sequence policies substantially outperform, RNN, and SSMs in robustness, maintaining high returns even when large fractions of sensors are unavailable.
  arXiv  Detail & Related papers  (2026-03-04T22:21:54Z)
• Hypersonic Flow Control: Generalized Deep Reinforcement Learning for Hypersonic Intake Unstart Control under Uncertainty [0.34376560669160394]
  Unstart is a major challenge to reliable air-breathing propulsion at Mach 5 and above.<n>We show a strategy to control unstart in a canonical two-dimensional hypersonic inlet at Mach 5 and Reynolds number $5times 106$.<n>Results establish a data-driven approach for real-time hypersonic flow control under realistic operational uncertainties.
  arXiv  Detail & Related papers  (2026-01-27T22:38:52Z)
• Curly Flow Matching for Learning Non-gradient Field Dynamics [49.480209466896035]
  We introduce Curly Flow Matching (Curly-FM), a novel approach to learning non-gradient field dynamics.<n>Curly-FM is capable of learning non-gradient field dynamics by designing and solving a Schr"odinger bridge problem.<n>Curly-FM can learn trajectories that better match both the reference process and population marginals.
  arXiv  Detail & Related papers  (2025-10-30T16:11:39Z)
• Drift No More? Context Equilibria in Multi-Turn LLM Interactions [58.69551510148673]
  contexts drift is the gradual divergence of a model's outputs from goal-consistent behavior across turns.<n>Unlike single-turn errors, drift unfolds temporally and is poorly captured by static evaluation metrics.<n>We show that multi-turn drift can be understood as a controllable equilibrium phenomenon rather than as inevitable decay.
  arXiv  Detail & Related papers  (2025-10-09T04:48:49Z)
• Physics-informed Neural-operator Predictive Control for Drag Reduction in Turbulent Flows [109.99020160824553]
  We propose an efficient deep reinforcement learning framework for modeling and control of turbulent flows.<n>It is model-based RL for predictive control (PC), where both the policy and the observer models for turbulence control are learned jointly.<n>We find that PINO-PC achieves a drag reduction of 39.0% under a bulk-velocity Reynolds number of 15,000, outperforming previous fluid control methods by more than 32%.
  arXiv  Detail & Related papers  (2025-10-03T00:18:26Z)
• Differentiable multiphase flow model for physics-informed machine learning in reservoir pressure management [44.41703936689344]
  We introduce a physics-informed machine learning workflow that couples a fully differentiable multiphase flow simulator.<n>The CNN learns to predict fluid extraction rates from heterogeneous permeability fields to enforce pressure limits at critical reservoir locations.<n>We demonstrate that high-accuracy training can be achieved with fewer than three thousand full-physics multiphase flow simulations.
  arXiv  Detail & Related papers  (2025-08-26T20:38:02Z)
• Real-time simulation of parameter-dependent fluid flows through deep learning-based reduced order models [0.2538209532048866]
  Reduced order models (ROMs) provide reliable approximations to parameter-dependent fluid dynamics problems in rapid times. Deep learning (DL)-based ROMs overcome all these limitations by learning in a non-intrusive way both the nonlinear trial manifold and the reduced dynamics. The resulting POD-DL-ROMs are shown to provide accurate results in almost real-time for the flow around a cylinder benchmark, the fluid-structure interaction between an elastic beam attached to a fixed, rigid block and a laminar incompressible flow, and the blood flow in a cerebral aneurysm.
  arXiv  Detail & Related papers  (2021-06-10T13:07:33Z)
• Feedback-induced instabilities and dynamics in the Jaynes-Cummings model [62.997667081978825]
  We investigate the coherence and steady-state properties of the Jaynes-Cummings model subjected to time-delayed coherent feedback. The introduced feedback qualitatively modifies the dynamical response and steady-state quantum properties of the system.
  arXiv  Detail & Related papers  (2020-06-20T10:07:01Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.