Stochastic Adversarial Koopman Model for Dynamical Systems

• URL: http://arxiv.org/abs/2109.05095v1
• Date: Fri, 10 Sep 2021 20:17:44 GMT
• Title: Stochastic Adversarial Koopman Model for Dynamical Systems
• Authors: Kaushik Balakrishnan and Devesh Upadhyay
• Abstract summary: This paper extends a recently developed adversarial Koopman model to space, where the Koopman applies on the probability of the latent encoding of an encoder. The efficacy of the Koopman model is demonstrated on different test problems in chaos, fluid dynamics, combustion, and reaction-diffusion models.
• Score: 0.4061135251278187
• License: http://creativecommons.org/publicdomain/zero/1.0/
• Abstract: Dynamical systems are ubiquitous and are often modeled using a non-linear system of governing equations. Numerical solution procedures for many dynamical systems have existed for several decades, but can be slow due to high-dimensional state space of the dynamical system. Thus, deep learning-based reduced order models (ROMs) are of interest and one such family of algorithms along these lines are based on the Koopman theory. This paper extends a recently developed adversarial Koopman model (Balakrishnan \& Upadhyay, arXiv:2006.05547) to stochastic space, where the Koopman operator applies on the probability distribution of the latent encoding of an encoder. Specifically, the latent encoding of the system is modeled as a Gaussian, and is advanced in time by using an auxiliary neural network that outputs two Koopman matrices $K_{\mu}$ and $K_{\sigma}$. Adversarial and gradient losses are used and this is found to lower the prediction errors. A reduced Koopman formulation is also undertaken where the Koopman matrices are assumed to have a tridiagonal structure, and this yields predictions comparable to the baseline model with full Koopman matrices. The efficacy of the stochastic Koopman model is demonstrated on different test problems in chaos, fluid dynamics, combustion, and reaction-diffusion models. The proposed model is also applied in a setting where the Koopman matrices are conditioned on other input parameters for generalization and this is applied to simulate the state of a Lithium-ion battery in time. The Koopman models discussed in this study are very promising for the wide range of problems considered.

Related papers

• Uncertainty Modelling and Robust Observer Synthesis using the Koopman Operator [5.317624228510749]
  The Koopman operator allows nonlinear systems to be rewritten as infinite-dimensional linear systems. A finite-dimensional approximation of the Koopman operator can be identified directly from data. A population of several dozen motor drives is used to experimentally demonstrate the proposed method.
  arXiv  Detail & Related papers  (2024-10-01T20:31:18Z)
• Generative Modeling of Regular and Irregular Time Series Data via Koopman VAEs [50.25683648762602]
  We introduce Koopman VAE, a new generative framework that is based on a novel design for the model prior. Inspired by Koopman theory, we represent the latent conditional prior dynamics using a linear map. KoVAE outperforms state-of-the-art GAN and VAE methods across several challenging synthetic and real-world time series generation benchmarks.
  arXiv  Detail & Related papers  (2023-10-04T07:14:43Z)
• Beyond expectations: Residual Dynamic Mode Decomposition and Variance for Stochastic Dynamical Systems [8.259767785187805]
  Dynamic Mode Decomposition (DMD) is the poster child of projection-based methods. We introduce the concept of variance-pseudospectra to gauge statistical coherency. Our study concludes with practical applications using both simulated and experimental data.
  arXiv  Detail & Related papers  (2023-08-21T13:05:12Z)
• Eigenvalue initialisation and regularisation for Koopman autoencoders [2.260916274164351]
  We study the Koopman autoencoder model which includes an encoder, a Koopman operator layer, and a decoder. We propose the "eigeninit" initialisation scheme that samples initial Koopman operators from specific eigenvalue distributions. In addition, we suggest the "eigenloss" penalty scheme that penalises the eigenvalues of the Koopman operator during training.
  arXiv  Detail & Related papers  (2022-12-23T00:05:26Z)
• The Ordered Matrix Dirichlet for Modeling Ordinal Dynamics [54.96229007229786]
  We propose the Ordered Matrix Dirichlet (OMD) to map latent states to observed action types. Models built on the OMD recover interpretable latent states and show superior forecasting performance in few-shot settings.
  arXiv  Detail & Related papers  (2022-12-08T08:04:26Z)
• Inverting brain grey matter models with likelihood-free inference: a tool for trustable cytoarchitecture measurements [62.997667081978825]
  characterisation of the brain grey matter cytoarchitecture with quantitative sensitivity to soma density and volume remains an unsolved challenge in dMRI. We propose a new forward model, specifically a new system of equations, requiring a few relatively sparse b-shells. We then apply modern tools from Bayesian analysis known as likelihood-free inference (LFI) to invert our proposed model.
  arXiv  Detail & Related papers  (2021-11-15T09:08:27Z)
• Deep Identification of Nonlinear Systems in Koopman Form [0.0]
  The present paper treats the identification of nonlinear dynamical systems using Koopman-based deep state-space encoders. An input-affine formulation is considered for the lifted model structure and we address both full and partial state availability.
  arXiv  Detail & Related papers  (2021-10-06T08:50:56Z)
• Robust Compressed Sensing using Generative Models [98.64228459705859]
  In this paper we propose an algorithm inspired by the Median-of-Means (MOM) Our algorithm guarantees recovery for heavy-tailed data, even in the presence of outliers.
  arXiv  Detail & Related papers  (2020-06-16T19:07:41Z)
• Learning to Encode Position for Transformer with Continuous Dynamical Model [88.69870971415591]
  We introduce a new way of learning to encode position information for non-recurrent models, such as Transformer models. We model the evolution of encoded results along position index by such a dynamical system.
  arXiv  Detail & Related papers  (2020-03-13T00:41:41Z)
• Forecasting Sequential Data using Consistent Koopman Autoencoders [52.209416711500005]
  A new class of physics-based methods related to Koopman theory has been introduced, offering an alternative for processing nonlinear dynamical systems. We propose a novel Consistent Koopman Autoencoder model which, unlike the majority of existing work, leverages the forward and backward dynamics. Key to our approach is a new analysis which explores the interplay between consistent dynamics and their associated Koopman operators.
  arXiv  Detail & Related papers  (2020-03-04T18:24:30Z)
• Sparsity-promoting algorithms for the discovery of informative Koopman invariant subspaces [0.0]
  We propose a framework based on multi-task feature learning to extract most informative Koopman in subspace. We show a relationship between the present algorithm, sparsity DMD, and an empirical criterion promoting KDMD.
  arXiv  Detail & Related papers  (2020-02-25T03:02:09Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.