DUE: A Deep Learning Framework and Library for Modeling Unknown Equations

• URL: http://arxiv.org/abs/2504.10373v1
• Date: Mon, 14 Apr 2025 16:20:55 GMT
• Title: DUE: A Deep Learning Framework and Library for Modeling Unknown Equations
• Authors: Junfeng Chen, Kailiang Wu, Dongbin Xiu,
• Abstract summary: Deep Unknown Equations (DUE) is an open-source software package designed to facilitate the data-driven modeling of unknown equations.<n>We introduce a systematic framework for data-driven modeling of unknown equations using deep learning.<n>DUE serves as an educational tool for classroom instruction, enabling students and newcomers to gain hands-on experience with differential equations.
• Score: 2.832405269873282
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Equations, particularly differential equations, are fundamental for understanding natural phenomena and predicting complex dynamics across various scientific and engineering disciplines. However, the governing equations for many complex systems remain unknown due to intricate underlying mechanisms. Recent advancements in machine learning and data science offer a new paradigm for modeling unknown equations from measurement or simulation data. This paradigm shift, known as data-driven discovery or modeling, stands at the forefront of AI for science, with significant progress made in recent years. In this paper, we introduce a systematic framework for data-driven modeling of unknown equations using deep learning. This versatile framework is capable of learning unknown ODEs, PDEs, DAEs, IDEs, SDEs, reduced or partially observed systems, and non-autonomous differential equations. Based on this framework, we have developed Deep Unknown Equations (DUE), an open-source software package designed to facilitate the data-driven modeling of unknown equations using modern deep learning techniques. DUE serves as an educational tool for classroom instruction, enabling students and newcomers to gain hands-on experience with differential equations, data-driven modeling, and contemporary deep learning approaches such as FNN, ResNet, generalized ResNet, operator semigroup networks (OSG-Net), and Transformers. Additionally, DUE is a versatile and accessible toolkit for researchers across various scientific and engineering fields. It is applicable not only for learning unknown equations from data but also for surrogate modeling of known, yet complex, equations that are costly to solve using traditional numerical methods. We provide detailed descriptions of DUE and demonstrate its capabilities through diverse examples, which serve as templates that can be easily adapted for other applications.

Related papers

• Differentiable programming across the PDE and Machine Learning barrier [0.6554326244334868]
  We introduce a generic differentiable programming abstraction that provides scientists with a highly productive way of specifying end-to-end differentiable models. Our interface automates the coupling of arbitrary PDE-based systems and machine learning models. Our framework has been adopted in the Firedrake finite-element library and supports the PyTorch and JAXP ecosystems.
  arXiv  Detail & Related papers  (2024-09-09T21:36:38Z)
• Physics-informed nonlinear vector autoregressive models for the prediction of dynamical systems [0.36248657646376703]
  We focus on one class of models called nonlinear vector autoregression (N VAR) to solve ordinary differential equations (ODEs) Motivated by connections to numerical integration and physics-informed neural networks, we explicitly derive the physics-informed N VAR. Because N VAR and piN VAR completely share their learned parameters, we propose an augmented procedure to jointly train the two models. We evaluate the ability of the piN VAR model to predict solutions to various ODE systems, such as the undamped spring, a Lotka-Volterra predator-prey nonlinear model, and the chaotic Lorenz system.
  arXiv  Detail & Related papers  (2024-07-25T14:10:42Z)
• Learning Governing Equations of Unobserved States in Dynamical Systems [0.0]
  We employ a hybrid neural ODE structure to learn governing equations of partially-observed dynamical systems. We demonstrate that the method is capable of successfully learning the true underlying governing equations of unobserved states within these systems.
  arXiv  Detail & Related papers  (2024-04-29T10:28:14Z)
• Mechanistic Neural Networks for Scientific Machine Learning [58.99592521721158]
  We present Mechanistic Neural Networks, a neural network design for machine learning applications in the sciences. It incorporates a new Mechanistic Block in standard architectures to explicitly learn governing differential equations as representations. Central to our approach is a novel Relaxed Linear Programming solver (NeuRLP) inspired by a technique that reduces solving linear ODEs to solving linear programs.
  arXiv  Detail & Related papers  (2024-02-20T15:23:24Z)
• Training Deep Surrogate Models with Large Scale Online Learning [48.7576911714538]
  Deep learning algorithms have emerged as a viable alternative for obtaining fast solutions for PDEs. Models are usually trained on synthetic data generated by solvers, stored on disk and read back for training. It proposes an open source online training framework for deep surrogate models.
  arXiv  Detail & Related papers  (2023-06-28T12:02:27Z)
• Advancing Reacting Flow Simulations with Data-Driven Models [50.9598607067535]
  Key to effective use of machine learning tools in multi-physics problems is to couple them to physical and computer models. The present chapter reviews some of the open opportunities for the application of data-driven reduced-order modeling of combustion systems.
  arXiv  Detail & Related papers  (2022-09-05T16:48:34Z)
• D-CIPHER: Discovery of Closed-form Partial Differential Equations [80.46395274587098]
  We propose D-CIPHER, which is robust to measurement artifacts and can uncover a new and very general class of differential equations. We further design a novel optimization procedure, CoLLie, to help D-CIPHER search through this class efficiently.
  arXiv  Detail & Related papers  (2022-06-21T17:59:20Z)
• Learning differential equations from data [0.0]
  In recent times, due to the abundance of data, there is an active search for data-driven methods to learn Differential equation models from data. We propose a forward-Euler based neural network model and test its performance by learning ODEs from data using different number of hidden layers and different neural network width.
  arXiv  Detail & Related papers  (2022-05-23T17:36:28Z)
• Constructing Neural Network-Based Models for Simulating Dynamical Systems [59.0861954179401]
  Data-driven modeling is an alternative paradigm that seeks to learn an approximation of the dynamics of a system using observations of the true system. This paper provides a survey of the different ways to construct models of dynamical systems using neural networks. In addition to the basic overview, we review the related literature and outline the most significant challenges from numerical simulations that this modeling paradigm must overcome.
  arXiv  Detail & Related papers  (2021-11-02T10:51:42Z)
• Model-Based Deep Learning [155.063817656602]
  Signal processing, communications, and control have traditionally relied on classical statistical modeling techniques. Deep neural networks (DNNs) use generic architectures which learn to operate from data, and demonstrate excellent performance. We are interested in hybrid techniques that combine principled mathematical models with data-driven systems to benefit from the advantages of both approaches.
  arXiv  Detail & Related papers  (2020-12-15T16:29:49Z)
• Physics-informed learning of governing equations from scarce data [14.95055620484844]
  This work introduces a physics-informed deep learning framework to discover governing partial differential equations (PDEs) from scarce and noisy representation data. The efficacy and robustness of this method are demonstrated, both numerically and experimentally, on discovering a variety of PDE systems. The resulting computational framework shows the potential for closed-form model discovery in practical applications.
  arXiv  Detail & Related papers  (2020-05-05T22:13:22Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.