Control of Two-way Coupled Fluid Systems with Differentiable Solvers

• URL: http://arxiv.org/abs/2206.00342v1
• Date: Wed, 1 Jun 2022 09:12:08 GMT
• Title: Control of Two-way Coupled Fluid Systems with Differentiable Solvers
• Authors: Brener Ramos, Felix Trost, Nils Thuerey
• Abstract summary: We investigate the use of deep neural networks to control complex nonlinear dynamical systems. We solve the Navier Stokes equations with two way coupling, which gives rise to nonlinear perturbations. We show that controllers trained with our approach outperform a variety of classical and learned alternatives in terms of evaluation metrics and generalization capabilities.
• Score: 22.435002906710803
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: We investigate the use of deep neural networks to control complex nonlinear dynamical systems, specifically the movement of a rigid body immersed in a fluid. We solve the Navier Stokes equations with two way coupling, which gives rise to nonlinear perturbations that make the control task very challenging. Neural networks are trained in an unsupervised way to act as controllers with desired characteristics through a process of learning from a differentiable simulator. Here we introduce a set of physically interpretable loss terms to let the networks learn robust and stable interactions. We demonstrate that controllers trained in a canonical setting with quiescent initial conditions reliably generalize to varied and challenging environments such as previously unseen inflow conditions and forcing, although they do not have any fluid information as input. Further, we show that controllers trained with our approach outperform a variety of classical and learned alternatives in terms of evaluation metrics and generalization capabilities.

Related papers

• Leveraging Low-Rank and Sparse Recurrent Connectivity for Robust Closed-Loop Control [63.310780486820796]
  We show how a parameterization of recurrent connectivity influences robustness in closed-loop settings. We find that closed-form continuous-time neural networks (CfCs) with fewer parameters can outperform their full-rank, fully-connected counterparts.
  arXiv  Detail & Related papers  (2023-10-05T21:44:18Z)
• Controlling dynamical systems to complex target states using machine learning: next-generation vs. classical reservoir computing [68.8204255655161]
  Controlling nonlinear dynamical systems using machine learning allows to drive systems into simple behavior like periodicity but also to more complex arbitrary dynamics. We show first that classical reservoir computing excels at this task. In a next step, we compare those results based on different amounts of training data to an alternative setup, where next-generation reservoir computing is used instead. It turns out that while delivering comparable performance for usual amounts of training data, next-generation RC significantly outperforms in situations where only very limited data is available.
  arXiv  Detail & Related papers  (2023-07-14T07:05:17Z)
• FluidLab: A Differentiable Environment for Benchmarking Complex Fluid Manipulation [80.63838153351804]
  We introduce FluidLab, a simulation environment with a diverse set of manipulation tasks involving complex fluid dynamics. At the heart of our platform is a fully differentiable physics simulator, providing GPU-accelerated simulations and gradient calculations. We propose several domain-specific optimization schemes coupled with differentiable physics.
  arXiv  Detail & Related papers  (2023-03-04T07:24:22Z)
• Control-oriented meta-learning [25.316358215670274]
  We use data-driven modeling with neural networks to learn, offline from past data, an adaptive controller with an internal parametric model of nonlinear features. We meta-learn the adaptive controller with closed-loop tracking simulation as the base-learner and the average tracking error as the meta-objective.
  arXiv  Detail & Related papers  (2022-04-14T03:02:27Z)
• Deep Q-learning: a robust control approach [4.125187280299247]
  We formulate an uncertain linear time-invariant model by means of the neural tangent kernel to describe learning. We show the instability of learning and analyze the agent's behavior in frequency-domain. Numerical simulations in different OpenAI Gym environments suggest that the $mathcalH_infty$ controlled learning performs slightly better than Double deep Q-learning.
  arXiv  Detail & Related papers  (2022-01-21T09:47:34Z)
• Online-Learning Deep Neuro-Adaptive Dynamic Inversion Controller for Model Free Control [1.3764085113103217]
  A neuro-adaptive controller is implemented featuring a deep neural network trained on a new weight update law. The controller is able to learn the nonlinear plant quickly and displays good performance in the tracking control problem.
  arXiv  Detail & Related papers  (2021-07-21T22:46:03Z)
• Meta-Adaptive Nonlinear Control: Theory and Algorithms [47.122874727499216]
  We present an online multi-task learning approach for adaptive nonlinear control, which we call Online Meta-environment Control (OMAC) We provide instantiations of our approach under varying conditions, leading to the first non-asymptotic end-to-end convergence guarantee for multi-task adaptive nonlinear control.
  arXiv  Detail & Related papers  (2021-06-11T00:39:07Z)
• Trajectory Tracking of Underactuated Sea Vessels With Uncertain Dynamics: An Integral Reinforcement Learning Approach [2.064612766965483]
  An online machine learning mechanism based on integral reinforcement learning is proposed to find a solution for a class of nonlinear tracking problems. The solution is implemented using an online value iteration process which is realized by employing means of the adaptive critics and gradient descent approaches.
  arXiv  Detail & Related papers  (2021-04-01T01:41:49Z)
• Adaptive-Control-Oriented Meta-Learning for Nonlinear Systems [29.579737941918022]
  We learn, offline from past data, an adaptive controller with an internal parametric model of nonlinear features. We meta-learn the adaptive controller with closed-loop tracking simulation as the base-learner and the average tracking error as the meta-objective. With a nonlinear planar rotorcraft subject to wind, we demonstrate that our adaptive controller outperforms other controllers trained with regression-oriented meta-learning.
  arXiv  Detail & Related papers  (2021-03-07T23:49:59Z)
• Deluca -- A Differentiable Control Library: Environments, Methods, and Benchmarking [52.44199258132215]
  We present an open-source library of differentiable physics and robotics environments. The library features several popular environments, including classical control settings from OpenAI Gym. We give several use-cases of new scientific results obtained using the library.
  arXiv  Detail & Related papers  (2021-02-19T15:06:47Z)
• Learning to Control PDEs with Differentiable Physics [102.36050646250871]
  We present a novel hierarchical predictor-corrector scheme which enables neural networks to learn to understand and control complex nonlinear physical systems over long time frames. We demonstrate that our method successfully develops an understanding of complex physical systems and learns to control them for tasks involving PDEs.
  arXiv  Detail & Related papers  (2020-01-21T11:58:41Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.