Stability Preserving Data-driven Models With Latent Dynamics
- URL: http://arxiv.org/abs/2204.11744v1
- Date: Wed, 20 Apr 2022 00:41:10 GMT
- Title: Stability Preserving Data-driven Models With Latent Dynamics
- Authors: Yushuang Luo and Xiantao Li and Wenrui Hao
- Abstract summary: We introduce a data-driven modeling approach for dynamics problems with latent variables.
We present a model framework where the stability of the coupled dynamics can be easily enforced.
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: In this paper, we introduce a data-driven modeling approach for dynamics
problems with latent variables. The state-space of the proposed model includes
artificial latent variables, in addition to observed variables that can be
fitted to a given data set. We present a model framework where the stability of
the coupled dynamics can be easily enforced. The model is implemented by
recurrent cells and trained using backpropagation through time. Numerical
examples using benchmark tests from order reduction problems demonstrate the
stability of the model and the efficiency of the recurrent cell implementation.
As applications, two fluid-structure interaction problems are considered to
illustrate the accuracy and predictive capability of the model.
Related papers
- Hybrid Adaptive Modeling using Neural Networks Trained with Nonlinear Dynamics Based Features [5.652228574188242]
This paper introduces a novel approach that departs from standard techniques by uncovering information from nonlinear dynamical modeling and embedding it in data-based models.
By explicitly incorporating nonlinear dynamic phenomena through perturbation methods, the predictive capabilities are more realistic and insightful compared to knowledge obtained from brute-force numerical simulations.
arXiv Detail & Related papers (2025-01-21T02:38:28Z) - Modeling Latent Non-Linear Dynamical System over Time Series [7.534744211716623]
We study the problem of modeling a non-linear dynamical system when given a time series by deriving equations directly from the data.
We introduce a latent state to allow time-dependent modeling and formulate this problem as a dynamics estimation problem in latent states.
arXiv Detail & Related papers (2024-12-11T05:45:30Z) - Identifiable Representation and Model Learning for Latent Dynamic Systems [0.0]
We study the problem of identifiable representation and model learning for latent dynamic systems.
We prove that, for linear and affine nonlinear latent dynamic systems with sparse input matrices, it is possible to identify the latent variables up to scaling.
arXiv Detail & Related papers (2024-10-23T13:55:42Z) - Learning and Inference in Sparse Coding Models with Langevin Dynamics [3.0600309122672726]
We describe a system capable of inference and learning in a probabilistic latent variable model.
We demonstrate this idea for a sparse coding model by deriving a continuous-time equation for inferring its latent variables via Langevin dynamics.
We show that Langevin dynamics lead to an efficient procedure for sampling from the posterior distribution in the 'L0 sparse' regime, where latent variables are encouraged to be set to zero as opposed to having a small L1 norm.
arXiv Detail & Related papers (2022-04-23T23:16:47Z) - Capturing Actionable Dynamics with Structured Latent Ordinary
Differential Equations [68.62843292346813]
We propose a structured latent ODE model that captures system input variations within its latent representation.
Building on a static variable specification, our model learns factors of variation for each input to the system, thus separating the effects of the system inputs in the latent space.
arXiv Detail & Related papers (2022-02-25T20:00:56Z) - Closed-form Continuous-Depth Models [99.40335716948101]
Continuous-depth neural models rely on advanced numerical differential equation solvers.
We present a new family of models, termed Closed-form Continuous-depth (CfC) networks, that are simple to describe and at least one order of magnitude faster.
arXiv Detail & Related papers (2021-06-25T22:08:51Z) - Autoregressive Dynamics Models for Offline Policy Evaluation and
Optimization [60.73540999409032]
We show that expressive autoregressive dynamics models generate different dimensions of the next state and reward sequentially conditioned on previous dimensions.
We also show that autoregressive dynamics models are useful for offline policy optimization by serving as a way to enrich the replay buffer.
arXiv Detail & Related papers (2021-04-28T16:48:44Z) - Anomaly Detection of Time Series with Smoothness-Inducing Sequential
Variational Auto-Encoder [59.69303945834122]
We present a Smoothness-Inducing Sequential Variational Auto-Encoder (SISVAE) model for robust estimation and anomaly detection of time series.
Our model parameterizes mean and variance for each time-stamp with flexible neural networks.
We show the effectiveness of our model on both synthetic datasets and public real-world benchmarks.
arXiv Detail & Related papers (2021-02-02T06:15:15Z) - An accelerated hybrid data-driven/model-based approach for
poroelasticity problems with multi-fidelity multi-physics data [0.0]
We present a hybrid model/model-free data-driven approach to solve poroity problems.
To handle the different fidelities of the solid elasticity and fluid hydraulic responses, we introduce a hybridized model.
arXiv Detail & Related papers (2020-11-30T23:36:05Z) - Control as Hybrid Inference [62.997667081978825]
We present an implementation of CHI which naturally mediates the balance between iterative and amortised inference.
We verify the scalability of our algorithm on a continuous control benchmark, demonstrating that it outperforms strong model-free and model-based baselines.
arXiv Detail & Related papers (2020-07-11T19:44:09Z) - Variational Hyper RNN for Sequence Modeling [69.0659591456772]
We propose a novel probabilistic sequence model that excels at capturing high variability in time series data.
Our method uses temporal latent variables to capture information about the underlying data pattern.
The efficacy of the proposed method is demonstrated on a range of synthetic and real-world sequential data.
arXiv Detail & Related papers (2020-02-24T19:30:32Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.