Input-to-State Stable Coupled Oscillator Networks for Closed-form Model-based Control in Latent Space

• URL: http://arxiv.org/abs/2409.08439v2
• Date: Sun, 13 Oct 2024 22:04:42 GMT
• Title: Input-to-State Stable Coupled Oscillator Networks for Closed-form Model-based Control in Latent Space
• Authors: Maximilian Stölzle, Cosimo Della Santina,
• Abstract summary: We argue that a promising avenue is to leverage powerful and well-understood closed-form strategies from control theory literature. We identify three fundamental shortcomings in existing latent-space models that have so far prevented this powerful combination. We propose a novel Coupled Network (CON) model that simultaneously tackles all these issues.
• Score: 2.527926867319859
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Even though a variety of methods have been proposed in the literature, efficient and effective latent-space control (i.e., control in a learned low-dimensional space) of physical systems remains an open challenge. We argue that a promising avenue is to leverage powerful and well-understood closed-form strategies from control theory literature in combination with learned dynamics, such as potential-energy shaping. We identify three fundamental shortcomings in existing latent-space models that have so far prevented this powerful combination: (i) they lack the mathematical structure of a physical system, (ii) they do not inherently conserve the stability properties of the real systems, (iii) these methods do not have an invertible mapping between input and latent-space forcing. This work proposes a novel Coupled Oscillator Network (CON) model that simultaneously tackles all these issues. More specifically, (i) we show analytically that CON is a Lagrangian system - i.e., it possesses well-defined potential and kinetic energy terms. Then, (ii) we provide formal proof of global Input-to-State stability using Lyapunov arguments. Moving to the experimental side, we demonstrate that CON reaches SoA performance when learning complex nonlinear dynamics of mechanical systems directly from images. An additional methodological innovation contributing to achieving this third goal is an approximated closed-form solution for efficient integration of network dynamics, which eases efficient training. We tackle (iii) by approximating the forcing-to-input mapping with a decoder that is trained to reconstruct the input based on the encoded latent space force. Finally, we show how these properties enable latent-space control. We use an integral-saturated PID with potential force compensation and demonstrate high-quality performance on a soft robot using raw pixels as the only feedback information.

Related papers

• Inferring stability properties of chaotic systems on autoencoders' latent spaces [4.266376725904727]
  In chaotic systems and turbulence, convolutional autoencoders and echo state networks (CAE-ESN) successfully forecast the dynamics. We show that the CAE-ESN model infers the invariant stability properties and the geometry of the space vectors in the low-dimensional manifold. This work opens up new opportunities for inferring the stability of high-dimensional chaotic systems in latent spaces.
  arXiv  Detail & Related papers  (2024-10-23T16:25:36Z)
• Stability analysis of chaotic systems in latent spaces [4.266376725904727]
  We show that a latent-space approach can infer the solution of a chaotic partial differential equation. It can also predict the stability properties of the physical system.
  arXiv  Detail & Related papers  (2024-10-01T08:09:14Z)
• Learning Deep Dissipative Dynamics [5.862431328401459]
  Dissipativity is a crucial indicator for dynamical systems that generalizes stability and input-output stability. We propose a differentiable projection that transforms any dynamics represented by neural networks into dissipative ones. Our method strictly guarantees stability, input-output stability, and energy conservation of trained dynamical systems.
  arXiv  Detail & Related papers  (2024-08-21T09:44:43Z)
• Stable Modular Control via Contraction Theory for Reinforcement Learning [8.742125999252366]
  We propose a novel way to integrate control techniques with reinforcement learning (RL) for stability, robustness, and generalization. We realize such modularity via signal composition and dynamic decomposition.
  arXiv  Detail & Related papers  (2023-11-07T02:41:02Z)
• ConCerNet: A Contrastive Learning Based Framework for Automated Conservation Law Discovery and Trustworthy Dynamical System Prediction [82.81767856234956]
  This paper proposes a new learning framework named ConCerNet to improve the trustworthiness of the DNN based dynamics modeling. We show that our method consistently outperforms the baseline neural networks in both coordinate error and conservation metrics.
  arXiv  Detail & Related papers  (2023-02-11T21:07:30Z)
• On Robust Numerical Solver for ODE via Self-Attention Mechanism [82.95493796476767]
  We explore training efficient and robust AI-enhanced numerical solvers with a small data size by mitigating intrinsic noise disturbances. We first analyze the ability of the self-attention mechanism to regulate noise in supervised learning and then propose a simple-yet-effective numerical solver, Attr, which introduces an additive self-attention mechanism to the numerical solution of differential equations.
  arXiv  Detail & Related papers  (2023-02-05T01:39:21Z)
• Physics-Inspired Temporal Learning of Quadrotor Dynamics for Accurate Model Predictive Trajectory Tracking [76.27433308688592]
  Accurately modeling quadrotor's system dynamics is critical for guaranteeing agile, safe, and stable navigation. We present a novel Physics-Inspired Temporal Convolutional Network (PI-TCN) approach to learning quadrotor's system dynamics purely from robot experience. Our approach combines the expressive power of sparse temporal convolutions and dense feed-forward connections to make accurate system predictions.
  arXiv  Detail & Related papers  (2022-06-07T13:51:35Z)
• Decimation technique for open quantum systems: a case study with driven-dissipative bosonic chains [62.997667081978825]
  Unavoidable coupling of quantum systems to external degrees of freedom leads to dissipative (non-unitary) dynamics. We introduce a method to deal with these systems based on the calculation of (dissipative) lattice Green's function. We illustrate the power of this method with several examples of driven-dissipative bosonic chains of increasing complexity.
  arXiv  Detail & Related papers  (2022-02-15T19:00:09Z)
• Forced Variational Integrator Networks for Prediction and Control of Mechanical Systems [7.538482310185133]
  We show that forced variational integrator networks (FVIN) architecture allows us to accurately account for energy dissipation and external forcing. This can result in highly-data efficient model-based control and can predict on real non-conservative systems.
  arXiv  Detail & Related papers  (2021-06-05T21:39:09Z)
• gradSim: Differentiable simulation for system identification and visuomotor control [66.37288629125996]
  We present gradSim, a framework that overcomes the dependence on 3D supervision by leveraging differentiable multiphysics simulation and differentiable rendering. Our unified graph enables learning in challenging visuomotor control tasks, without relying on state-based (3D) supervision.
  arXiv  Detail & Related papers  (2021-04-06T16:32:01Z)
• Euclideanizing Flows: Diffeomorphic Reduction for Learning Stable Dynamical Systems [74.80320120264459]
  We present an approach to learn such motions from a limited number of human demonstrations. The complex motions are encoded as rollouts of a stable dynamical system. The efficacy of this approach is demonstrated through validation on an established benchmark as well demonstrations collected on a real-world robotic system.
  arXiv  Detail & Related papers  (2020-05-27T03:51:57Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.