An analysis of Universal Differential Equations for data-driven discovery of Ordinary Differential Equations

• URL: http://arxiv.org/abs/2306.10335v1
• Date: Sat, 17 Jun 2023 12:26:50 GMT
• Title: An analysis of Universal Differential Equations for data-driven discovery of Ordinary Differential Equations
• Authors: Mattia Silvestri, Federico Baldo, Eleonora Misino, Michele Lombardi
• Abstract summary: We make a contribution by testing the UDE framework in the context of Ordinary Differential Equations (ODEs) discovery. We highlight some of the issues arising when combining data-driven approaches and numerical solvers. We believe that our analysis represents a significant contribution in investigating the capabilities and limitations of Physics-informed Machine Learning frameworks.
• Score: 7.48176340790825
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In the last decade, the scientific community has devolved its attention to the deployment of data-driven approaches in scientific research to provide accurate and reliable analysis of a plethora of phenomena. Most notably, Physics-informed Neural Networks and, more recently, Universal Differential Equations (UDEs) proved to be effective both in system integration and identification. However, there is a lack of an in-depth analysis of the proposed techniques. In this work, we make a contribution by testing the UDE framework in the context of Ordinary Differential Equations (ODEs) discovery. In our analysis, performed on two case studies, we highlight some of the issues arising when combining data-driven approaches and numerical solvers, and we investigate the importance of the data collection process. We believe that our analysis represents a significant contribution in investigating the capabilities and limitations of Physics-informed Machine Learning frameworks.

Related papers

• Comprehensive Review of Neural Differential Equations for Time Series Analysis [2.9687381456164004]
  This paper presents a comprehensive review of NDE-based methods for time series analysis. NDEs represent a paradigm shift by combining the flexibility of neural networks with the mathematical rigor of differential equations. We provide a detailed discussion of their mathematical formulations, numerical methods, and applications, highlighting their ability to model continuous-time dynamics.
  arXiv  Detail & Related papers  (2025-02-14T03:21:04Z)
• Simultaneous Dimensionality Reduction for Extracting Useful Representations of Large Empirical Multimodal Datasets [0.0]
  We focus on the sciences of dimensionality reduction as a means to obtain low-dimensional descriptions from high-dimensional data. We address the challenges posed by real-world data that defy conventional assumptions, such as complex interactions within systems or high-dimensional dynamical systems.
  arXiv  Detail & Related papers  (2024-10-23T21:27:40Z)
• Identifiability of Differential-Algebraic Systems [7.5929966855085755]
  This work introduces a novel identifiability test for models characterized by nonlinear DAEs. We employ our identifiability analysis across a diverse range of DAE models, illustrating how system identifiability depends on the choices of sensors, experimental conditions, and model structures.
  arXiv  Detail & Related papers  (2024-05-22T16:48:47Z)
• Towards stable real-world equation discovery with assessing differentiating quality influence [52.2980614912553]
  We propose alternatives to the commonly used finite differences-based method. We evaluate these methods in terms of applicability to problems, similar to the real ones, and their ability to ensure the convergence of equation discovery algorithms.
  arXiv  Detail & Related papers  (2023-11-09T23:32:06Z)
• Discovering Interpretable Physical Models using Symbolic Regression and Discrete Exterior Calculus [55.2480439325792]
  We propose a framework that combines Symbolic Regression (SR) and Discrete Exterior Calculus (DEC) for the automated discovery of physical models. DEC provides building blocks for the discrete analogue of field theories, which are beyond the state-of-the-art applications of SR to physical problems. We prove the effectiveness of our methodology by re-discovering three models of Continuum Physics from synthetic experimental data.
  arXiv  Detail & Related papers  (2023-10-10T13:23:05Z)
• Capturing dynamical correlations using implicit neural representations [85.66456606776552]
  We develop an artificial intelligence framework which combines a neural network trained to mimic simulated data from a model Hamiltonian with automatic differentiation to recover unknown parameters from experimental data. In doing so, we illustrate the ability to build and train a differentiable model only once, which then can be applied in real-time to multi-dimensional scattering data.
  arXiv  Detail & Related papers  (2023-04-08T07:55:36Z)
• AttNS: Attention-Inspired Numerical Solving For Limited Data Scenarios [51.94807626839365]
  We propose the attention-inspired numerical solver (AttNS) to solve differential equations due to limited data. AttNS is inspired by the effectiveness of attention modules in Residual Neural Networks (ResNet) in enhancing model generalization and robustness.
  arXiv  Detail & Related papers  (2023-02-05T01:39:21Z)
• D-CIPHER: Discovery of Closed-form Partial Differential Equations [80.46395274587098]
  We propose D-CIPHER, which is robust to measurement artifacts and can uncover a new and very general class of differential equations. We further design a novel optimization procedure, CoLLie, to help D-CIPHER search through this class efficiently.
  arXiv  Detail & Related papers  (2022-06-21T17:59:20Z)
• Mixed Effects Neural ODE: A Variational Approximation for Analyzing the Dynamics of Panel Data [50.23363975709122]
  We propose a probabilistic model called ME-NODE to incorporate (fixed + random) mixed effects for analyzing panel data. We show that our model can be derived using smooth approximations of SDEs provided by the Wong-Zakai theorem. We then derive Evidence Based Lower Bounds for ME-NODE, and develop (efficient) training algorithms.
  arXiv  Detail & Related papers  (2022-02-18T22:41:51Z)
• Optimization with learning-informed differential equation constraints and its applications [0.0]
  Inspired by applications in optimal control of semilinear elliptic partial differential equations and physics-integrated imaging, differential equation constrained optimization problems are studied. A particular focus is on the analysis and on numerical methods for problems with machine-learned components.
  arXiv  Detail & Related papers  (2020-08-25T09:05:55Z)
• Physics-informed learning of governing equations from scarce data [14.95055620484844]
  This work introduces a physics-informed deep learning framework to discover governing partial differential equations (PDEs) from scarce and noisy representation data. The efficacy and robustness of this method are demonstrated, both numerically and experimentally, on discovering a variety of PDE systems. The resulting computational framework shows the potential for closed-form model discovery in practical applications.
  arXiv  Detail & Related papers  (2020-05-05T22:13:22Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.