Physics-Informed Echo State Networks

• URL: http://arxiv.org/abs/2011.02280v1
• Date: Sat, 31 Oct 2020 11:47:33 GMT
• Title: Physics-Informed Echo State Networks
• Authors: Nguyen Anh Khoa Doan, Wolfgang Polifke, Luca Magri
• Abstract summary: We propose a physics-informed Echo State Network (ESN) to predict the evolution of chaotic systems. Compared to conventional ESNs, the physics-informed ESNs are trained to solve supervised learning tasks. The proposed framework shows the potential of using machine learning combined with prior physical knowledge to improve the time-accurate prediction of chaotic systems.
• Score: 5.8010446129208155
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We propose a physics-informed Echo State Network (ESN) to predict the evolution of chaotic systems. Compared to conventional ESNs, the physics-informed ESNs are trained to solve supervised learning tasks while ensuring that their predictions do not violate physical laws. This is achieved by introducing an additional loss function during the training, which is based on the system's governing equations. The additional loss function penalizes non-physical predictions without the need of any additional training data. This approach is demonstrated on a chaotic Lorenz system and a truncation of the Charney-DeVore system. Compared to the conventional ESNs, the physics-informed ESNs improve the predictability horizon by about two Lyapunov times. This approach is also shown to be robust with regard to noise. The proposed framework shows the potential of using machine learning combined with prior physical knowledge to improve the time-accurate prediction of chaotic dynamical systems.

Related papers

• Physics-Informed Echo State Networks for Modeling Controllable Dynamical Systems [5.217516787417401]
  Physics-Informed ESNs (PI-ESNs) were proposed initially to model chaotic dynamic systems without external inputs. PI-ESNs can regularize an ESN model with external inputs previously trained on just a few datapoints, reducing its overfitting and improving its generalization error.
  arXiv  Detail & Related papers  (2024-09-27T21:06:24Z)
• Physics-Informed Neural Network for Discovering Systems with Unmeasurable States with Application to Lithium-Ion Batteries [6.375364752891239]
  We introduce a robust method for training PINN that uses fewer loss terms and thus constructs a less complex landscape for optimization. Instead of having loss terms from each differential equation, this method embeds the dynamics into a loss function that quantifies the error between observed and predicted system outputs. This is accomplished by numerically integrating the predicted states from the neural network(NN) using known dynamics and transforming them to obtain a sequence of predicted outputs.
  arXiv  Detail & Related papers  (2023-11-27T23:35:40Z)
• ShadowNet for Data-Centric Quantum System Learning [188.683909185536]
  We propose a data-centric learning paradigm combining the strength of neural-network protocols and classical shadows. Capitalizing on the generalization power of neural networks, this paradigm can be trained offline and excel at predicting previously unseen systems. We present the instantiation of our paradigm in quantum state tomography and direct fidelity estimation tasks and conduct numerical analysis up to 60 qubits.
  arXiv  Detail & Related papers  (2023-08-22T09:11:53Z)
• Tipping Point Forecasting in Non-Stationary Dynamics on Function Spaces [78.08947381962658]
  Tipping points are abrupt, drastic, and often irreversible changes in the evolution of non-stationary dynamical systems. We learn the evolution of such non-stationary systems using a novel recurrent neural operator (RNO), which learns mappings between function spaces. We propose a conformal prediction framework to forecast tipping points by monitoring deviations from physics constraints.
  arXiv  Detail & Related papers  (2023-08-17T05:42:27Z)
• Stabilizing Machine Learning Prediction of Dynamics: Noise and Noise-inspired Regularization [58.720142291102135]
  Recent has shown that machine learning (ML) models can be trained to accurately forecast the dynamics of chaotic dynamical systems. In the absence of mitigating techniques, this technique can result in artificially rapid error growth, leading to inaccurate predictions and/or climate instability. We introduce Linearized Multi-Noise Training (LMNT), a regularization technique that deterministically approximates the effect of many small, independent noise realizations added to the model input during training.
  arXiv  Detail & Related papers  (2022-11-09T23:40:52Z)
• Physics-Inspired Temporal Learning of Quadrotor Dynamics for Accurate Model Predictive Trajectory Tracking [76.27433308688592]
  Accurately modeling quadrotor's system dynamics is critical for guaranteeing agile, safe, and stable navigation. We present a novel Physics-Inspired Temporal Convolutional Network (PI-TCN) approach to learning quadrotor's system dynamics purely from robot experience. Our approach combines the expressive power of sparse temporal convolutions and dense feed-forward connections to make accurate system predictions.
  arXiv  Detail & Related papers  (2022-06-07T13:51:35Z)
• Physically Explainable CNN for SAR Image Classification [59.63879146724284]
  In this paper, we propose a novel physics guided and injected neural network for SAR image classification. The proposed framework comprises three parts: (1) generating physics guided signals using existing explainable models, (2) learning physics-aware features with physics guided network, and (3) injecting the physics-aware features adaptively to the conventional classification deep learning model for prediction. The experimental results show that our proposed method substantially improve the classification performance compared with the counterpart data-driven CNN.
  arXiv  Detail & Related papers  (2021-10-27T03:30:18Z)
• Using Data Assimilation to Train a Hybrid Forecast System that Combines Machine-Learning and Knowledge-Based Components [52.77024349608834]
  We consider the problem of data-assisted forecasting of chaotic dynamical systems when the available data is noisy partial measurements. We show that by using partial measurements of the state of the dynamical system, we can train a machine learning model to improve predictions made by an imperfect knowledge-based model.
  arXiv  Detail & Related papers  (2021-02-15T19:56:48Z)
• Neural Dynamical Systems: Balancing Structure and Flexibility in Physical Prediction [14.788494279754481]
  We introduce Neural Dynamical Systems (NDS), a method of learning dynamical models in various gray-box settings. NDS uses neural networks to estimate free parameters of the system, predicts residual terms, and numerically integrates over time to predict future states.
  arXiv  Detail & Related papers  (2020-06-23T00:50:48Z)
• Learning ergodic averages in chaotic systems [6.85316573653194]
  We propose a machine learning method to predict the time average of a chaotic attractor. The method is based on the hybrid echo state network (hESN)
  arXiv  Detail & Related papers  (2020-01-09T18:12:39Z)
• Learning Hidden States in a Chaotic System: A Physics-Informed Echo State Network Approach [5.8010446129208155]
  We extend the Physics-Informed Echo State Network (PI-ESN) framework to reconstruct the evolution of an unmeasured state (hidden state) in a chaotic system. Non-noisy and noisy datasets are considered.
  arXiv  Detail & Related papers  (2020-01-06T15:04:02Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.