Deep Learning of Dynamical System Parameters from Return Maps as Images
- URL: http://arxiv.org/abs/2306.11258v1
- Date: Tue, 20 Jun 2023 03:23:32 GMT
- Title: Deep Learning of Dynamical System Parameters from Return Maps as Images
- Authors: Connor James Stephens, Emmanuel Blazquez
- Abstract summary: We present a novel approach to system identification using deep learning techniques.
We use a supervised learning approach for estimating the parameters of discrete and continuous-time dynamical systems.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: We present a novel approach to system identification (SI) using deep learning
techniques. Focusing on parametric system identification (PSI), we use a
supervised learning approach for estimating the parameters of discrete and
continuous-time dynamical systems, irrespective of chaos. To accomplish this,
we transform collections of state-space trajectory observations into image-like
data to retain the state-space topology of trajectories from dynamical systems
and train convolutional neural networks to estimate the parameters of dynamical
systems from these images. We demonstrate that our approach can learn parameter
estimation functions for various dynamical systems, and by using training-time
data augmentation, we are able to learn estimation functions whose parameter
estimates are robust to changes in the sample fidelity of their inputs. Once
trained, these estimation models return parameter estimations for new systems
with negligible time and computation costs.
Related papers
- Machine-learning parameter tracking with partial state observation [0.0]
Complex and nonlinear dynamical systems often involve parameters that change with time, accurate tracking of which is essential to tasks such as state estimation, prediction, and control.
We develop a model-free and fully data-driven framework to accurately track time-varying parameters from partial state observation in real time.
Low- and high-dimensional, Markovian and non-Markovian nonlinear dynamical systems are used to demonstrate the power of the machine-learning based parameter-tracking framework.
arXiv Detail & Related papers (2023-11-15T17:39:25Z) - Learning Nonautonomous Systems via Dynamic Mode Decomposition [0.0]
We present a data-driven learning approach for unknown nonautonomous dynamical systems with time-dependent inputs based on dynamic mode decomposition (DMD)
To circumvent the difficulty of approximating the time-dependent Koopman operators for nonautonomous systems, a modified system is employed as an approximation to the original nonautonomous system.
arXiv Detail & Related papers (2023-06-27T16:58:26Z) - Reparameterization through Spatial Gradient Scaling [69.27487006953852]
Reparameterization aims to improve the generalization of deep neural networks by transforming convolutional layers into equivalent multi-branched structures during training.
We present a novel spatial gradient scaling method to redistribute learning focus among weights in convolutional networks.
arXiv Detail & Related papers (2023-03-05T17:57:33Z) - Embed and Emulate: Learning to estimate parameters of dynamical systems
with uncertainty quantification [11.353411236854582]
This paper explores learning emulators for parameter estimation with uncertainty estimation of high-dimensional dynamical systems.
Our task is to accurately estimate a range of likely values of the underlying parameters.
On a coupled 396-dimensional multiscale Lorenz 96 system, our method significantly outperforms a typical parameter estimation method.
arXiv Detail & Related papers (2022-11-03T01:59:20Z) - Learning to Learn with Generative Models of Neural Network Checkpoints [71.06722933442956]
We construct a dataset of neural network checkpoints and train a generative model on the parameters.
We find that our approach successfully generates parameters for a wide range of loss prompts.
We apply our method to different neural network architectures and tasks in supervised and reinforcement learning.
arXiv Detail & Related papers (2022-09-26T17:59:58Z) - Federated Stochastic Gradient Descent Begets Self-Induced Momentum [151.4322255230084]
Federated learning (FL) is an emerging machine learning method that can be applied in mobile edge systems.
We show that running to the gradient descent (SGD) in such a setting can be viewed as adding a momentum-like term to the global aggregation process.
arXiv Detail & Related papers (2022-02-17T02:01:37Z) - Supervised DKRC with Images for Offline System Identification [77.34726150561087]
Modern dynamical systems are becoming increasingly non-linear and complex.
There is a need for a framework to model these systems in a compact and comprehensive representation for prediction and control.
Our approach learns these basis functions using a supervised learning approach.
arXiv Detail & Related papers (2021-09-06T04:39:06Z) - Using Data Assimilation to Train a Hybrid Forecast System that Combines
Machine-Learning and Knowledge-Based Components [52.77024349608834]
We consider the problem of data-assisted forecasting of chaotic dynamical systems when the available data is noisy partial measurements.
We show that by using partial measurements of the state of the dynamical system, we can train a machine learning model to improve predictions made by an imperfect knowledge-based model.
arXiv Detail & Related papers (2021-02-15T19:56:48Z) - Neural Dynamical Systems: Balancing Structure and Flexibility in
Physical Prediction [14.788494279754481]
We introduce Neural Dynamical Systems (NDS), a method of learning dynamical models in various gray-box settings.
NDS uses neural networks to estimate free parameters of the system, predicts residual terms, and numerically integrates over time to predict future states.
arXiv Detail & Related papers (2020-06-23T00:50:48Z) - Active Learning for Nonlinear System Identification with Guarantees [102.43355665393067]
We study a class of nonlinear dynamical systems whose state transitions depend linearly on a known feature embedding of state-action pairs.
We propose an active learning approach that achieves this by repeating three steps: trajectory planning, trajectory tracking, and re-estimation of the system from all available data.
We show that our method estimates nonlinear dynamical systems at a parametric rate, similar to the statistical rate of standard linear regression.
arXiv Detail & Related papers (2020-06-18T04:54:11Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.