Modeling Unknown Stochastic Dynamical System via Autoencoder

• URL: http://arxiv.org/abs/2312.10001v1
• Date: Fri, 15 Dec 2023 18:19:22 GMT
• Title: Modeling Unknown Stochastic Dynamical System via Autoencoder
• Authors: Zhongshu Xu, Yuan Chen, Qifan Chen, Dongbin Xiu
• Abstract summary: We present a numerical method to learn an accurate predictive model for an unknown dynamical system from its trajectory data. It employs the idea of autoencoder to identify the unobserved latent random variables. It is also applicable to systems driven by non-Gaussian noises.
• Score: 3.8769921482808116
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We present a numerical method to learn an accurate predictive model for an unknown stochastic dynamical system from its trajectory data. The method seeks to approximate the unknown flow map of the underlying system. It employs the idea of autoencoder to identify the unobserved latent random variables. In our approach, we design an encoding function to discover the latent variables, which are modeled as unit Gaussian, and a decoding function to reconstruct the future states of the system. Both the encoder and decoder are expressed as deep neural networks (DNNs). Once the DNNs are trained by the trajectory data, the decoder serves as a predictive model for the unknown stochastic system. Through an extensive set of numerical examples, we demonstrate that the method is able to produce long-term system predictions by using short bursts of trajectory data. It is also applicable to systems driven by non-Gaussian noises.

Related papers

• Modeling Unknown Stochastic Dynamical System Subject to External Excitation [4.357350642401934]
  We present a numerical method for learning unknown nonautonomous dynamical system. Our basic assumption is that the governing equations for the system are unavailable. When a sufficient amount of such I/O data are available, our method is capable of learning the unknown dynamics.
  arXiv  Detail & Related papers  (2024-06-22T06:21:44Z)
• Deep Learning of Chaotic Systems from Partially-Observed Data [0.0]
  A general data driven numerical framework has been developed for learning and modeling unknown dynamical systems using fully- or partially-observed data. In this paper, we apply this framework to chaotic systems, in particular the well-known Lorenz 63 and 96 systems. We demonstrate that the flow map based DNN learning method is capable of accurately modeling chaotic systems, even when only a subset of the state variables are available to the DNNs.
  arXiv  Detail & Related papers  (2022-05-12T00:18:06Z)
• Stochastic Trajectory Prediction via Motion Indeterminacy Diffusion [88.45326906116165]
  We present a new framework to formulate the trajectory prediction task as a reverse process of motion indeterminacy diffusion (MID) We encode the history behavior information and the social interactions as a state embedding and devise a Transformer-based diffusion model to capture the temporal dependencies of trajectories. Experiments on the human trajectory prediction benchmarks including the Stanford Drone and ETH/UCY datasets demonstrate the superiority of our method.
  arXiv  Detail & Related papers  (2022-03-25T16:59:08Z)
• Modeling unknown dynamical systems with hidden parameters [0.0]
  We present a data-driven numerical approach for modeling unknown dynamical systems with missing/hidden parameters. The method is based on training a deep neural network (DNN) model for the unknown system using its trajectory data.
  arXiv  Detail & Related papers  (2022-02-03T21:34:58Z)
• Learning Summary Statistics for Bayesian Inference with Autoencoders [58.720142291102135]
  We use the inner dimension of deep neural network based Autoencoders as summary statistics. To create an incentive for the encoder to encode all the parameter-related information but not the noise, we give the decoder access to explicit or implicit information that has been used to generate the training data.
  arXiv  Detail & Related papers  (2022-01-28T12:00:31Z)
• Supervised DKRC with Images for Offline System Identification [77.34726150561087]
  Modern dynamical systems are becoming increasingly non-linear and complex. There is a need for a framework to model these systems in a compact and comprehensive representation for prediction and control. Our approach learns these basis functions using a supervised learning approach.
  arXiv  Detail & Related papers  (2021-09-06T04:39:06Z)
• Artificial neural network as a universal model of nonlinear dynamical systems [0.0]
  The map is built as an artificial neural network whose weights encode a modeled system. We consider the Lorenz system, the Roessler system and also Hindmarch-Rose neuron. High similarity is observed for visual images of attractors, power spectra, bifurcation diagrams and Lyapunovs exponents.
  arXiv  Detail & Related papers  (2021-03-06T16:02:41Z)
• Using Data Assimilation to Train a Hybrid Forecast System that Combines Machine-Learning and Knowledge-Based Components [52.77024349608834]
  We consider the problem of data-assisted forecasting of chaotic dynamical systems when the available data is noisy partial measurements. We show that by using partial measurements of the state of the dynamical system, we can train a machine learning model to improve predictions made by an imperfect knowledge-based model.
  arXiv  Detail & Related papers  (2021-02-15T19:56:48Z)
• A Novel Anomaly Detection Algorithm for Hybrid Production Systems based on Deep Learning and Timed Automata [73.38551379469533]
  DAD:DeepAnomalyDetection is a new approach for automatic model learning and anomaly detection in hybrid production systems. It combines deep learning and timed automata for creating behavioral model from observations. The algorithm has been applied to few data sets including two from real systems and has shown promising results.
  arXiv  Detail & Related papers  (2020-10-29T08:27:43Z)
• Variational inference formulation for a model-free simulation of a dynamical system with unknown parameters by a recurrent neural network [8.616180927172548]
  We propose a "model-free" simulation of a dynamical system with unknown parameters without prior knowledge. The deep learning model aims to jointly learn the nonlinear time marching operator and the effects of the unknown parameters from a time series dataset. It is found that the proposed deep learning model is capable of correctly identifying the dimensions of the random parameters and learning a representation of complex time series data.
  arXiv  Detail & Related papers  (2020-03-02T20:57:02Z)
• Data-Driven Symbol Detection via Model-Based Machine Learning [117.58188185409904]
  We review a data-driven framework to symbol detection design which combines machine learning (ML) and model-based algorithms. In this hybrid approach, well-known channel-model-based algorithms are augmented with ML-based algorithms to remove their channel-model-dependence. Our results demonstrate that these techniques can yield near-optimal performance of model-based algorithms without knowing the exact channel input-output statistical relationship.
  arXiv  Detail & Related papers  (2020-02-14T06:58:27Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.