Automatically identifying ordinary differential equations from data
- URL: http://arxiv.org/abs/2304.11182v2
- Date: Wed, 3 May 2023 13:54:05 GMT
- Title: Automatically identifying ordinary differential equations from data
- Authors: Kevin Egan and Weizhen Li and Rui Carvalho
- Abstract summary: We propose a methodology to identify dynamical laws by integrating denoising techniques to smooth the signal.
We evaluate our method on well-known ordinary differential equations with an ensemble of random initial conditions.
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Discovering nonlinear differential equations that describe system dynamics
from empirical data is a fundamental challenge in contemporary science. Here,
we propose a methodology to identify dynamical laws by integrating denoising
techniques to smooth the signal, sparse regression to identify the relevant
parameters, and bootstrap confidence intervals to quantify the uncertainty of
the estimates. We evaluate our method on well-known ordinary differential
equations with an ensemble of random initial conditions, time series of
increasing length, and varying signal-to-noise ratios. Our algorithm
consistently identifies three-dimensional systems, given moderately-sized time
series and high levels of signal quality relative to background noise. By
accurately discovering dynamical systems automatically, our methodology has the
potential to impact the understanding of complex systems, especially in fields
where data are abundant, but developing mathematical models demands
considerable effort.
Related papers
- Towards stable real-world equation discovery with assessing
differentiating quality influence [52.2980614912553]
We propose alternatives to the commonly used finite differences-based method.
We evaluate these methods in terms of applicability to problems, similar to the real ones, and their ability to ensure the convergence of equation discovery algorithms.
arXiv Detail & Related papers (2023-11-09T23:32:06Z) - On Robust Numerical Solver for ODE via Self-Attention Mechanism [82.95493796476767]
We explore training efficient and robust AI-enhanced numerical solvers with a small data size by mitigating intrinsic noise disturbances.
We first analyze the ability of the self-attention mechanism to regulate noise in supervised learning and then propose a simple-yet-effective numerical solver, Attr, which introduces an additive self-attention mechanism to the numerical solution of differential equations.
arXiv Detail & Related papers (2023-02-05T01:39:21Z) - Benchmarking sparse system identification with low-dimensional chaos [1.5849413067450229]
We systematically benchmark sparse regression variants by utilizing the dysts standardized database of chaotic systems.
We demonstrate how this open-source tool can be used to quantitatively compare different methods of system identification.
In all cases, we used ensembling to improve the noise robustness of SINDy and provide statistical comparisons.
arXiv Detail & Related papers (2023-02-04T18:49:52Z) - Bayesian Spline Learning for Equation Discovery of Nonlinear Dynamics
with Quantified Uncertainty [8.815974147041048]
We develop a novel framework to identify parsimonious governing equations of nonlinear (spatiotemporal) dynamics from sparse, noisy data with quantified uncertainty.
The proposed algorithm is evaluated on multiple nonlinear dynamical systems governed by canonical ordinary and partial differential equations.
arXiv Detail & Related papers (2022-10-14T20:37:36Z) - Identifiability and Asymptotics in Learning Homogeneous Linear ODE Systems from Discrete Observations [114.17826109037048]
Ordinary Differential Equations (ODEs) have recently gained a lot of attention in machine learning.
theoretical aspects, e.g., identifiability and properties of statistical estimation are still obscure.
This paper derives a sufficient condition for the identifiability of homogeneous linear ODE systems from a sequence of equally-spaced error-free observations sampled from a single trajectory.
arXiv Detail & Related papers (2022-10-12T06:46:38Z) - A Causality-Based Learning Approach for Discovering the Underlying
Dynamics of Complex Systems from Partial Observations with Stochastic
Parameterization [1.2882319878552302]
This paper develops a new iterative learning algorithm for complex turbulent systems with partial observations.
It alternates between identifying model structures, recovering unobserved variables, and estimating parameters.
Numerical experiments show that the new algorithm succeeds in identifying the model structure and providing suitable parameterizations for many complex nonlinear systems.
arXiv Detail & Related papers (2022-08-19T00:35:03Z) - A Priori Denoising Strategies for Sparse Identification of Nonlinear
Dynamical Systems: A Comparative Study [68.8204255655161]
We investigate and compare the performance of several local and global smoothing techniques to a priori denoise the state measurements.
We show that, in general, global methods, which use the entire measurement data set, outperform local methods, which employ a neighboring data subset around a local point.
arXiv Detail & Related papers (2022-01-29T23:31:25Z) - Consistency of mechanistic causal discovery in continuous-time using
Neural ODEs [85.7910042199734]
We consider causal discovery in continuous-time for the study of dynamical systems.
We propose a causal discovery algorithm based on penalized Neural ODEs.
arXiv Detail & Related papers (2021-05-06T08:48:02Z) - Using Data Assimilation to Train a Hybrid Forecast System that Combines
Machine-Learning and Knowledge-Based Components [52.77024349608834]
We consider the problem of data-assisted forecasting of chaotic dynamical systems when the available data is noisy partial measurements.
We show that by using partial measurements of the state of the dynamical system, we can train a machine learning model to improve predictions made by an imperfect knowledge-based model.
arXiv Detail & Related papers (2021-02-15T19:56:48Z) - A non-autonomous equation discovery method for time signal
classification [1.933681537640272]
We develop a framework for analyzing time signals based on non-autonomous dynamical equations.
We show how gradients can be efficiently computed using the adjoint method.
We also demonstrate how the proposed method yields interpretability in the form of phase portraits.
arXiv Detail & Related papers (2020-11-22T20:03:46Z) - Automatic Differentiation to Simultaneously Identify Nonlinear Dynamics
and Extract Noise Probability Distributions from Data [4.996878640124385]
SINDy is a framework for the discovery of parsimonious dynamic models and equations from time-series data.
We develop a variant of the SINDy algorithm that integrates automatic differentiation and recent time-stepping constrained by Rudy et al.
We show the method can identify a diversity of probability distributions including Gaussian, uniform, Gamma, and Rayleigh.
arXiv Detail & Related papers (2020-09-12T23:52:25Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.