Implicit energy regularization of neural ordinary-differential-equation control

• URL: http://arxiv.org/abs/2103.06525v1
• Date: Thu, 11 Mar 2021 08:28:15 GMT
• Title: Implicit energy regularization of neural ordinary-differential-equation control
• Authors: Lucas B\"ottcher and Nino Antulov-Fantulin and Thomas Asikis
• Abstract summary: We present a versatile neural ordinary-differential-equation control (NODEC) framework with implicit energy regularization. We show that NODEC can steer dynamical systems towards a desired target state within a predefined amount of time.
• Score: 3.5880535198436156
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Although optimal control problems of dynamical systems can be formulated within the framework of variational calculus, their solution for complex systems is often analytically and computationally intractable. In this Letter we present a versatile neural ordinary-differential-equation control (NODEC) framework with implicit energy regularization and use it to obtain neural-network-generated control signals that can steer dynamical systems towards a desired target state within a predefined amount of time. We demonstrate the ability of NODEC to learn control signals that closely resemble those found by corresponding optimal control frameworks in terms of control energy and deviation from the desired target state. Our results suggest that NODEC is capable to solve a wide range of control and optimization problems, including those that are analytically intractable.

Related papers

• Receding Hamiltonian-Informed Optimal Neural Control and State Estimation for Closed-Loop Dynamical Systems [4.05766189327054]
  Hamiltonian-Informed Optimal Neural (Hion) controllers are a novel class of neural network-based controllers for dynamical systems. Hion controllers estimate future states and compute optimal control inputs using Pontryagin's Principle.
  arXiv  Detail & Related papers  (2024-11-02T16:06:29Z)
• Lyapunov Neural ODE Feedback Control Policies [6.165163123577486]
  This paper presents a Lyapunov-NODE control (L-NODEC) approach to solving continuous-time optimal control problems. We establish that L-NODEC ensures exponential stability of the controlled system, as well as its adversarial robustness to uncertain initial conditions.
  arXiv  Detail & Related papers  (2024-08-31T08:59:18Z)
• Optimal State Manipulation for a Two-Qubit System Driven by Coherent and Incoherent Controls [77.34726150561087]
  State preparation is important for optimal control of two-qubit quantum systems. We exploit two physically different coherent control and optimize the Hilbert-Schmidt target density matrices.
  arXiv  Detail & Related papers  (2023-04-03T10:22:35Z)
• Pontryagin Optimal Control via Neural Networks [19.546571122359534]
  We integrate Neural Networks with the Pontryagin's Maximum Principle (PMP), and propose a sample efficient framework NN-PMP-Gradient. The resulting controller can be implemented for systems with unknown and complex dynamics. Compared with the widely applied model-free and model-based reinforcement learning (RL) algorithms, our NN-PMP-Gradient achieves higher sample-efficiency and performance in terms of control objectives.
  arXiv  Detail & Related papers  (2022-12-30T06:47:03Z)
• Optimal control for state preparation in two-qubit open quantum systems driven by coherent and incoherent controls via GRAPE approach [77.34726150561087]
  We consider a model of two qubits driven by coherent and incoherent time-dependent controls. The dynamics of the system is governed by a Gorini-Kossakowski-Sudarshan-Lindblad master equation. We study evolution of the von Neumann entropy, purity, and one-qubit reduced density matrices under optimized controls.
  arXiv  Detail & Related papers  (2022-11-04T15:20:18Z)
• Near-optimal control of dynamical systems with neural ordinary differential equations [0.0]
  Recent advances in deep learning and neural network-based optimization have contributed to the development of methods that can help solve control problems involving high-dimensional dynamical systems. We first analyze how truncated and non-truncated backpropagation through time affect runtime performance and the ability of neural networks to learn optimal control functions.
  arXiv  Detail & Related papers  (2022-06-22T14:11:11Z)
• Sparsity in Partially Controllable Linear Systems [56.142264865866636]
  We study partially controllable linear dynamical systems specified by an underlying sparsity pattern. Our results characterize those state variables which are irrelevant for optimal control.
  arXiv  Detail & Related papers  (2021-10-12T16:41:47Z)
• Gaussian Process-based Min-norm Stabilizing Controller for Control-Affine Systems with Uncertain Input Effects and Dynamics [90.81186513537777]
  We propose a novel compound kernel that captures the control-affine nature of the problem. We show that this resulting optimization problem is convex, and we call it Gaussian Process-based Control Lyapunov Function Second-Order Cone Program (GP-CLF-SOCP)
  arXiv  Detail & Related papers  (2020-11-14T01:27:32Z)
• Neural Ordinary Differential Equation Control of Dynamics on Graphs [2.750124853532831]
  We study the ability of neural networks to calculate feedback control signals that steer trajectories of continuous time non-linear dynamical systems on graphs. We present a neural-ODE control (NODEC) framework and find that it can learn feedback control signals that drive graph dynamical systems into desired target states.
  arXiv  Detail & Related papers  (2020-06-17T10:47:03Z)
• Adaptive Control and Regret Minimization in Linear Quadratic Gaussian (LQG) Setting [91.43582419264763]
  We propose LqgOpt, a novel reinforcement learning algorithm based on the principle of optimism in the face of uncertainty. LqgOpt efficiently explores the system dynamics, estimates the model parameters up to their confidence interval, and deploys the controller of the most optimistic model.
  arXiv  Detail & Related papers  (2020-03-12T19:56:38Z)
• Time-local optimal control for parameter estimation in the Gaussian regime [68.8204255655161]
  instantaneous control unitaries may be used to mitigate the decrease of information caused by an open dynamics. A possible, locally optimal (in time) choice for such controls is the one that maximises the time-derivative of the quantum Fisher information.
  arXiv  Detail & Related papers  (2020-01-10T16:24:31Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.