DiffPhyCon: A Generative Approach to Control Complex Physical Systems

• URL: http://arxiv.org/abs/2407.06494v4
• Date: Tue, 29 Oct 2024 18:28:07 GMT
• Title: DiffPhyCon: A Generative Approach to Control Complex Physical Systems
• Authors: Long Wei, Peiyan Hu, Ruiqi Feng, Haodong Feng, Yixuan Du, Tao Zhang, Rui Wang, Yue Wang, Zhi-Ming Ma, Tailin Wu,
• Abstract summary: We introduce Diffusion Physical systems Control (DiffPhyCon), a new class of method to address the physical systems control problem. DiffPhyCon excels by simultaneously minimizing both the learned generative energy function and the predefined control objectives. Our method outperforms widely applied classical approaches and state-of-the-art deep learning and reinforcement learning methods.
• Score: 16.733151963652244
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Controlling the evolution of complex physical systems is a fundamental task across science and engineering. Classical techniques suffer from limited applicability or huge computational costs. On the other hand, recent deep learning and reinforcement learning-based approaches often struggle to optimize long-term control sequences under the constraints of system dynamics. In this work, we introduce Diffusion Physical systems Control (DiffPhyCon), a new class of method to address the physical systems control problem. DiffPhyCon excels by simultaneously minimizing both the learned generative energy function and the predefined control objectives across the entire trajectory and control sequence. Thus, it can explore globally and plan near-optimal control sequences. Moreover, we enhance DiffPhyCon with prior reweighting, enabling the discovery of control sequences that significantly deviate from the training distribution. We test our method on three tasks: 1D Burgers' equation, 2D jellyfish movement control, and 2D high-dimensional smoke control, where our generated jellyfish dataset is released as a benchmark for complex physical system control research. Our method outperforms widely applied classical approaches and state-of-the-art deep learning and reinforcement learning methods. Notably, DiffPhyCon unveils an intriguing fast-close-slow-open pattern observed in the jellyfish, aligning with established findings in the field of fluid dynamics. The project website, jellyfish dataset, and code can be found at https://github.com/AI4Science-WestlakeU/diffphycon.

Related papers

• Controlling dynamics of stochastic systems with deep reinforcement learning [0.0]
  We propose a simulation algorithm that allows achieving control of the dynamics of systems through the use of trained artificial neural networks. Specifically, we use agent-based simulations where the neural network plays the role of the controller that drives local state-to-state transitions.
  arXiv  Detail & Related papers  (2025-02-25T11:28:12Z)
• Closed-loop Diffusion Control of Complex Physical Systems [10.167080282182972]
  We propose an efficient Closed-Loop Diffusion method for Physical systems Control (CL-DiffPhyCon) By employing an asynchronous denoising framework for different physical time steps, CL-DiffPhyCon generates control signals conditioned on real-time feedback from the environment. We evaluate CL-DiffPhyCon on two tasks: 1D Burgers' equation control and 2D incompressible fluid control.
  arXiv  Detail & Related papers  (2024-07-31T14:54:29Z)
• Learning System Dynamics without Forgetting [60.08612207170659]
  Predicting trajectories of systems with unknown dynamics is crucial in various research fields, including physics and biology. We present a novel framework of Mode-switching Graph ODE (MS-GODE), which can continually learn varying dynamics. We construct a novel benchmark of biological dynamic systems, featuring diverse systems with disparate dynamics.
  arXiv  Detail & Related papers  (2024-06-30T14:55:18Z)
• Neural Control: Concurrent System Identification and Control Learning with Neural ODE [13.727727205587804]
  We propose a neural ODE based method for controlling unknown dynamical systems, denoted as Neural Control (NC) Our model concurrently learns system dynamics as well as optimal controls that guides towards target states. Our experiments demonstrate the effectiveness of our model for learning optimal control of unknown dynamical systems.
  arXiv  Detail & Related papers  (2024-01-03T17:05:17Z)
• Controlling quantum many-body systems using reduced-order modelling [0.0]
  We propose an efficient approach for solving a class of control problems for many-body quantum systems. Simulating dynamics of such a reduced-order model, viewed as a digital twin" of the original subsystem, is significantly more efficient. Our results will find direct applications in the study of many-body systems, in probing non-trivial quasiparticle properties, as well as in development control tools for quantum computing devices.
  arXiv  Detail & Related papers  (2022-11-01T13:58:44Z)
• Physics-Inspired Temporal Learning of Quadrotor Dynamics for Accurate Model Predictive Trajectory Tracking [76.27433308688592]
  Accurately modeling quadrotor's system dynamics is critical for guaranteeing agile, safe, and stable navigation. We present a novel Physics-Inspired Temporal Convolutional Network (PI-TCN) approach to learning quadrotor's system dynamics purely from robot experience. Our approach combines the expressive power of sparse temporal convolutions and dense feed-forward connections to make accurate system predictions.
  arXiv  Detail & Related papers  (2022-06-07T13:51:35Z)
• Neurosymbolic hybrid approach to driver collision warning [64.02492460600905]
  There are two main algorithmic approaches to autonomous driving systems. Deep learning alone has achieved state-of-the-art results in many areas. But sometimes it can be very difficult to debug if the deep learning model doesn't work.
  arXiv  Detail & Related papers  (2022-03-28T20:29:50Z)
• Learning by Doing: Controlling a Dynamical System using Causality, Control, and Reinforcement Learning [27.564435351371653]
  Questions in causality, control, and reinforcement learning go beyond the classical machine learning task of prediction. We believe that combining the different views might create synergies and this competition is meant as a first step toward such synergies. The goal in both tracks is to infer controls that drive the system to a desired state.
  arXiv  Detail & Related papers  (2022-02-12T12:37:29Z)
• Sparsity in Partially Controllable Linear Systems [56.142264865866636]
  We study partially controllable linear dynamical systems specified by an underlying sparsity pattern. Our results characterize those state variables which are irrelevant for optimal control.
  arXiv  Detail & Related papers  (2021-10-12T16:41:47Z)
• Deluca -- A Differentiable Control Library: Environments, Methods, and Benchmarking [52.44199258132215]
  We present an open-source library of differentiable physics and robotics environments. The library features several popular environments, including classical control settings from OpenAI Gym. We give several use-cases of new scientific results obtained using the library.
  arXiv  Detail & Related papers  (2021-02-19T15:06:47Z)
• Learning to Control PDEs with Differentiable Physics [102.36050646250871]
  We present a novel hierarchical predictor-corrector scheme which enables neural networks to learn to understand and control complex nonlinear physical systems over long time frames. We demonstrate that our method successfully develops an understanding of complex physical systems and learns to control them for tasks involving PDEs.
  arXiv  Detail & Related papers  (2020-01-21T11:58:41Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.