Variational Deep Learning for the Identification and Reconstruction of Chaotic and Stochastic Dynamical Systems from Noisy and Partial Observations

• URL: http://arxiv.org/abs/2009.02296v6
• Date: Tue, 16 Feb 2021 16:58:18 GMT
• Title: Variational Deep Learning for the Identification and Reconstruction of Chaotic and Stochastic Dynamical Systems from Noisy and Partial Observations
• Authors: Duong Nguyen, Said Ouala, Lucas Drumetz and Ronan Fablet
• Abstract summary: The identification of governing equations remains challenging when dealing with noisy and partial observations. Within the proposed framework, we learn an inference model to reconstruct the true states of the system. This framework bridges classical data assimilation and state-of-the-art machine learning techniques.
• Score: 15.82296284460491
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The data-driven recovery of the unknown governing equations of dynamical systems has recently received an increasing interest. However, the identification of governing equations remains challenging when dealing with noisy and partial observations. Here, we address this challenge and investigate variational deep learning schemes. Within the proposed framework, we jointly learn an inference model to reconstruct the true states of the system and the governing laws of these states from series of noisy and partial data. In doing so, this framework bridges classical data assimilation and state-of-the-art machine learning techniques. We also demonstrate that it generalises state-of-the-art methods. Importantly, both the inference model and the governing model embed stochastic components to account for stochastic variabilities, model errors, and reconstruction uncertainties. Various experiments on chaotic and stochastic dynamical systems support the relevance of our scheme w.r.t. state-of-the-art approaches.

Related papers

• Learning System Dynamics without Forgetting [60.08612207170659]
  Predicting trajectories of systems with unknown dynamics is crucial in various research fields, including physics and biology. We present a novel framework of Mode-switching Graph ODE (MS-GODE), which can continually learn varying dynamics. We construct a novel benchmark of biological dynamic systems, featuring diverse systems with disparate dynamics.
  arXiv  Detail & Related papers  (2024-06-30T14:55:18Z)
• Learning Governing Equations of Unobserved States in Dynamical Systems [0.0]
  We employ a hybrid neural ODE structure to learn governing equations of partially-observed dynamical systems. We demonstrate that the method is capable of successfully learning the true underlying governing equations of unobserved states within these systems.
  arXiv  Detail & Related papers  (2024-04-29T10:28:14Z)
• Neural Differential Algebraic Equations [6.100037457394823]
  We present Neural Differential-Algebraic Equations (NDAEs) suitable for data-driven modeling of Differential-Algebraic Equations (DAEs) We show that the proposed NDAEs abstraction is suitable for relevant system-theoretic data-driven modeling tasks.
  arXiv  Detail & Related papers  (2024-03-19T17:43:57Z)
• AI-Lorenz: A physics-data-driven framework for black-box and gray-box identification of chaotic systems with symbolic regression [2.07180164747172]
  We develop a framework that learns mathematical expressions modeling complex dynamical behaviors. We train a small neural network to learn the dynamics of a system, its rate of change in time, and missing model terms. This, in turn, enables us to predict the future evolution of the dynamical behavior.
  arXiv  Detail & Related papers  (2023-12-21T18:58:41Z)
• Pseudo-Hamiltonian system identification [0.0]
  We consider systems that can be modelled as first-order ordinary differential equations. We are able to learn the analytic terms of internal dynamics even if the model is trained on data where the system is affected by unknown damping and external disturbances.
  arXiv  Detail & Related papers  (2023-05-09T15:22:05Z)
• Capturing Actionable Dynamics with Structured Latent Ordinary Differential Equations [68.62843292346813]
  We propose a structured latent ODE model that captures system input variations within its latent representation. Building on a static variable specification, our model learns factors of variation for each input to the system, thus separating the effects of the system inputs in the latent space.
  arXiv  Detail & Related papers  (2022-02-25T20:00:56Z)
• Structure-Preserving Learning Using Gaussian Processes and Variational Integrators [62.31425348954686]
  We propose the combination of a variational integrator for the nominal dynamics of a mechanical system and learning residual dynamics with Gaussian process regression. We extend our approach to systems with known kinematic constraints and provide formal bounds on the prediction uncertainty.
  arXiv  Detail & Related papers  (2021-12-10T11:09:29Z)
• Constructing Neural Network-Based Models for Simulating Dynamical Systems [59.0861954179401]
  Data-driven modeling is an alternative paradigm that seeks to learn an approximation of the dynamics of a system using observations of the true system. This paper provides a survey of the different ways to construct models of dynamical systems using neural networks. In addition to the basic overview, we review the related literature and outline the most significant challenges from numerical simulations that this modeling paradigm must overcome.
  arXiv  Detail & Related papers  (2021-11-02T10:51:42Z)
• Supervised DKRC with Images for Offline System Identification [77.34726150561087]
  Modern dynamical systems are becoming increasingly non-linear and complex. There is a need for a framework to model these systems in a compact and comprehensive representation for prediction and control. Our approach learns these basis functions using a supervised learning approach.
  arXiv  Detail & Related papers  (2021-09-06T04:39:06Z)
• Discovering Sparse Interpretable Dynamics from Partial Observations [0.0]
  We propose a machine learning framework for discovering these governing equations using only partial observations. Our tests show that this method can successfully reconstruct the full system state.
  arXiv  Detail & Related papers  (2021-07-22T18:23:23Z)
• Using Data Assimilation to Train a Hybrid Forecast System that Combines Machine-Learning and Knowledge-Based Components [52.77024349608834]
  We consider the problem of data-assisted forecasting of chaotic dynamical systems when the available data is noisy partial measurements. We show that by using partial measurements of the state of the dynamical system, we can train a machine learning model to improve predictions made by an imperfect knowledge-based model.
  arXiv  Detail & Related papers  (2021-02-15T19:56:48Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.