MDBench: Benchmarking Data-Driven Methods for Model Discovery

• URL: http://arxiv.org/abs/2509.20529v1
• Date: Wed, 24 Sep 2025 20:00:35 GMT
• Title: MDBench: Benchmarking Data-Driven Methods for Model Discovery
• Authors: Amirmohammad Ziaei Bideh, Aleksandra Georgievska, Jonathan Gryak,
• Abstract summary: We introduce MDBench, an open-source benchmarking framework for evaluating model discovery methods on dynamical systems.<n> MDBench assesses 12 algorithms on 14 partial differential equations (PDEs) and 63 ordinary differential equations (ODEs) under varying levels of noise.
• Score: 42.358431390359094
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Model discovery aims to uncover governing differential equations of dynamical systems directly from experimental data. Benchmarking such methods is essential for tracking progress and understanding trade-offs in the field. While prior efforts have focused mostly on identifying single equations, typically framed as symbolic regression, there remains a lack of comprehensive benchmarks for discovering dynamical models. To address this, we introduce MDBench, an open-source benchmarking framework for evaluating model discovery methods on dynamical systems. MDBench assesses 12 algorithms on 14 partial differential equations (PDEs) and 63 ordinary differential equations (ODEs) under varying levels of noise. Evaluation metrics include derivative prediction accuracy, model complexity, and equation fidelity. We also introduce seven challenging PDE systems from fluid dynamics and thermodynamics, revealing key limitations in current methods. Our findings illustrate that linear methods and genetic programming methods achieve the lowest prediction error for PDEs and ODEs, respectively. Moreover, linear models are in general more robust against noise. MDBench accelerates the advancement of model discovery methods by offering a rigorous, extensible benchmarking framework and a rich, diverse collection of dynamical system datasets, enabling systematic evaluation, comparison, and improvement of equation accuracy and robustness.

Related papers

• Expanding the Chaos: Neural Operator for Stochastic (Partial) Differential Equations [65.80144621950981]
  We build on Wiener chaos expansions (WCE) to design neural operator (NO) architectures for SPDEs and SDEs.<n>We show that WCE-based neural operators provide a practical and scalable way to learn SDE/SPDE solution operators.
  arXiv  Detail & Related papers  (2026-01-03T00:59:25Z)
• A joint optimization approach to identifying sparse dynamics using least squares kernel collocation [70.13783231186183]
  We develop an all-at-once modeling framework for learning systems of ordinary differential equations (ODE) from scarce, partial, and noisy observations of the states.<n>The proposed methodology amounts to a combination of sparse recovery strategies for the ODE over a function library combined with techniques from reproducing kernel Hilbert space (RKHS) theory for estimating the state and discretizing the ODE.
  arXiv  Detail & Related papers  (2025-11-23T18:04:15Z)
• Deficiency of equation-finding approach to data-driven modeling of dynamical systems [0.0]
  We show that for many chaotic systems, sparse-optimization methods for discovering governing equations produce models that depend sensitively on the measurement procedure.<n>Finding the governing equations of the system and attempting to interpret them physically may lead to misleading conclusions.
  arXiv  Detail & Related papers  (2025-09-03T23:30:26Z)
• SODAs: Sparse Optimization for the Discovery of Differential and Algebraic Equations [0.0]
  We introduce Sparse Optimization for Differential-Algebraic Systems (SODAs)<n>SODAs is a data-driven method for the identification of DAEs in their explicit form.<n>We demonstrate its robustness to noise in both simulated time series and real-time experimental data.
  arXiv  Detail & Related papers  (2025-03-08T00:29:00Z)
• Data-Driven Stochastic Closure Modeling via Conditional Diffusion Model and Neural Operator [0.0]
  Closure models are widely used in simulating complex multiscale dynamical systems such as turbulence and the earth system.<n>For systems without a clear scale, generalization deterministic and local closure models often lack enough capability.<n>We propose a datadriven modeling framework for constructing neural operator and non-local closure models.
  arXiv  Detail & Related papers  (2024-08-06T05:21:31Z)
• Automating the Discovery of Partial Differential Equations in Dynamical Systems [0.0]
  We present an extension to the ARGOS framework, ARGOS-RAL, which leverages sparse regression with the recurrent adaptive lasso to identify PDEs automatically. We rigorously evaluate the performance of ARGOS-RAL in identifying canonical PDEs under various noise levels and sample sizes. Our results show that ARGOS-RAL effectively and reliably identifies the underlying PDEs from data, outperforming the sequential threshold ridge regression method in most cases.
  arXiv  Detail & Related papers  (2024-04-25T09:23:03Z)
• A Geometric Perspective on Diffusion Models [57.27857591493788]
  We inspect the ODE-based sampling of a popular variance-exploding SDE. We establish a theoretical relationship between the optimal ODE-based sampling and the classic mean-shift (mode-seeking) algorithm.
  arXiv  Detail & Related papers  (2023-05-31T15:33:16Z)
• Analysis of Numerical Integration in RNN-Based Residuals for Fault Diagnosis of Dynamic Systems [0.6999740786886536]
  The paper includes a case study of a heavy-duty truck's after-treatment system to highlight the potential of these techniques for improving fault diagnosis performance. Data-driven modeling and machine learning are widely used to model the behavior of dynamic systems.
  arXiv  Detail & Related papers  (2023-05-08T12:48:18Z)
• Discrepancy Modeling Framework: Learning missing physics, modeling systematic residuals, and disambiguating between deterministic and random effects [4.459306403129608]
  In modern dynamical systems, discrepancies between model and measurement can lead to poor quantification. We introduce a discrepancy modeling framework to identify the missing physics and resolve the model-measurement mismatch.
  arXiv  Detail & Related papers  (2022-03-10T05:37:24Z)
• Capturing Actionable Dynamics with Structured Latent Ordinary Differential Equations [68.62843292346813]
  We propose a structured latent ODE model that captures system input variations within its latent representation. Building on a static variable specification, our model learns factors of variation for each input to the system, thus separating the effects of the system inputs in the latent space.
  arXiv  Detail & Related papers  (2022-02-25T20:00:56Z)
• A Priori Denoising Strategies for Sparse Identification of Nonlinear Dynamical Systems: A Comparative Study [68.8204255655161]
  We investigate and compare the performance of several local and global smoothing techniques to a priori denoise the state measurements. We show that, in general, global methods, which use the entire measurement data set, outperform local methods, which employ a neighboring data subset around a local point.
  arXiv  Detail & Related papers  (2022-01-29T23:31:25Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.