An Empirical Investigation of Neural ODEs and Symbolic Regression for Dynamical Systems
- URL: http://arxiv.org/abs/2601.20637v1
- Date: Wed, 28 Jan 2026 14:23:59 GMT
- Title: An Empirical Investigation of Neural ODEs and Symbolic Regression for Dynamical Systems
- Authors: Panayiotis Ioannou, Pietro Liò, Pietro Cicuta,
- Abstract summary: We show that NODEs can extrapolate effectively to new boundary conditions, provided the resulting trajectories share dynamic similarity with the training data.<n> SR successfully recovers the equations from noisy ground-truth data, though its performance is contingent on the correct selection of input variables.<n>While this last finding highlights an area for future work, our results suggest that using NODEs to enrich limited data represents a promising new approach for scientific discovery.
- Score: 12.033026184739539
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Accurately modelling the dynamics of complex systems and discovering their governing differential equations are critical tasks for accelerating scientific discovery. Using noisy, synthetic data from two damped oscillatory systems, we explore the extrapolation capabilities of Neural Ordinary Differential Equations (NODEs) and the ability of Symbolic Regression (SR) to recover the underlying equations. Our study yields three key insights. First, we demonstrate that NODEs can extrapolate effectively to new boundary conditions, provided the resulting trajectories share dynamic similarity with the training data. Second, SR successfully recovers the equations from noisy ground-truth data, though its performance is contingent on the correct selection of input variables. Finally, we find that SR recovers two out of the three governing equations, along with a good approximation for the third, when using data generated by a NODE trained on just 10% of the full simulation. While this last finding highlights an area for future work, our results suggest that using NODEs to enrich limited data and enable symbolic regression to infer physical laws represents a promising new approach for scientific discovery.
Related papers
- Automated Discovery of Conservation Laws via Hybrid Neural ODE-Transformers [0.0]
We propose a hybrid framework to automate the discovery of conserved quantities from noisy trajectory data.<n>Our approach integrates three components: (1) a Neural Ordinary Differential Equation that learns a continuous model of the system's dynamics, (2) a Transformer that generates symbolic candidate invariants conditioned on the learned vector field, and (3) a symbolic-numeric verifier that provides a strong numerical certificate for the validity of these candidates.
arXiv Detail & Related papers (2025-10-30T17:32:04Z) - Continuous-Time SO(3) Forecasting with Savitzky--Golay Neural Controlled Differential Equations [51.510040541600176]
This work proposes modeling continuous-time rotational object dynamics on $SO(3)$.<n>Unlike existing methods that rely on simplified motion assumptions, our method learns a general latent dynamical system of the underlying object trajectory.<n> Experimental results on real-world data demonstrate compelling forecasting capabilities compared to existing approaches.
arXiv Detail & Related papers (2025-06-07T12:41:50Z) - Reconstruction of dynamic systems using genetic algorithms with dynamic search limits [0.0]
evolutionary computing techniques are presented to estimate the governing equations of a dynamical system using time-series data.<n>Some of the main contributions of the present study are an adequate modification of the genetic algorithm to remove terms with minimal contributions, and a mechanism to escape local optima.<n>Our results demonstrate a reconstruction with an Integral Square Error below 0.22 and a coefficient of determination R-squared of 0.99 for all systems.
arXiv Detail & Related papers (2024-12-03T22:58:25Z) - BrainODE: Dynamic Brain Signal Analysis via Graph-Aided Neural Ordinary Differential Equations [67.79256149583108]
We propose a novel model called BrainODE to achieve continuous modeling of dynamic brain signals.
By learning latent initial values and neural ODE functions from irregular time series, BrainODE effectively reconstructs brain signals at any time point.
arXiv Detail & Related papers (2024-04-30T10:53:30Z) - Learning Governing Equations of Unobserved States in Dynamical Systems [0.0]
We employ a hybrid neural ODE structure to learn governing equations of partially-observed dynamical systems.
We demonstrate that the method is capable of successfully learning the true underlying governing equations of unobserved states within these systems.
arXiv Detail & Related papers (2024-04-29T10:28:14Z) - Zero-shot Imputation with Foundation Inference Models for Dynamical Systems [5.549794481031468]
We offer a fresh perspective on the classical problem of imputing missing time series data, whose underlying dynamics are assumed to be determined by ODEs.<n>We propose a novel supervised learning framework for zero-shot time series imputation, through parametric functions satisfying some (hidden) ODEs.<n>We empirically demonstrate that one and the same (pretrained) recognition model can perform zero-shot imputation across 63 distinct time series with missing values.
arXiv Detail & Related papers (2024-02-12T11:48:54Z) - Deep Generative Symbolic Regression [83.04219479605801]
Symbolic regression aims to discover concise closed-form mathematical equations from data.
Existing methods, ranging from search to reinforcement learning, fail to scale with the number of input variables.
We propose an instantiation of our framework, Deep Generative Symbolic Regression.
arXiv Detail & Related papers (2023-12-30T17:05:31Z) - Discovering Interpretable Physical Models using Symbolic Regression and
Discrete Exterior Calculus [55.2480439325792]
We propose a framework that combines Symbolic Regression (SR) and Discrete Exterior Calculus (DEC) for the automated discovery of physical models.
DEC provides building blocks for the discrete analogue of field theories, which are beyond the state-of-the-art applications of SR to physical problems.
We prove the effectiveness of our methodology by re-discovering three models of Continuum Physics from synthetic experimental data.
arXiv Detail & Related papers (2023-10-10T13:23:05Z) - Active Learning in Symbolic Regression with Physical Constraints [0.4037357056611557]
Evolutionary symbolic regression (SR) fits a symbolic equation to data, which gives a concise interpretable model.
We explore using SR as a method to propose which data to gather in an active learning setting with physical constraints.
arXiv Detail & Related papers (2023-05-17T17:07:25Z) - Capturing dynamical correlations using implicit neural representations [85.66456606776552]
We develop an artificial intelligence framework which combines a neural network trained to mimic simulated data from a model Hamiltonian with automatic differentiation to recover unknown parameters from experimental data.
In doing so, we illustrate the ability to build and train a differentiable model only once, which then can be applied in real-time to multi-dimensional scattering data.
arXiv Detail & Related papers (2023-04-08T07:55:36Z) - Mixed Effects Neural ODE: A Variational Approximation for Analyzing the
Dynamics of Panel Data [50.23363975709122]
We propose a probabilistic model called ME-NODE to incorporate (fixed + random) mixed effects for analyzing panel data.
We show that our model can be derived using smooth approximations of SDEs provided by the Wong-Zakai theorem.
We then derive Evidence Based Lower Bounds for ME-NODE, and develop (efficient) training algorithms.
arXiv Detail & Related papers (2022-02-18T22:41:51Z) - Physics-informed learning of governing equations from scarce data [14.95055620484844]
This work introduces a physics-informed deep learning framework to discover governing partial differential equations (PDEs) from scarce and noisy representation data.
The efficacy and robustness of this method are demonstrated, both numerically and experimentally, on discovering a variety of PDE systems.
The resulting computational framework shows the potential for closed-form model discovery in practical applications.
arXiv Detail & Related papers (2020-05-05T22:13:22Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.