Finite Expression Methods for Discovering Physical Laws from Data
- URL: http://arxiv.org/abs/2305.08342v2
- Date: Mon, 18 Sep 2023 16:18:32 GMT
- Title: Finite Expression Methods for Discovering Physical Laws from Data
- Authors: Zhongyi Jiang and Chunmei Wang and Haizhao Yang
- Abstract summary: We present a novel deep symbolic learning method called the "finite expression method" (FEX)
FEX generates analytical expressions of the governing equations by learning the derivatives of partial differential equation (PDE) solutions through convolutions.
Results demonstrate FEX's flexibility and expressive power in accurately approximating symbolic governing equations.
- Score: 6.460951804337735
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Nonlinear dynamics is a pervasive phenomenon observed in scientific and
engineering disciplines. However, the task of deriving analytical expressions
to describe nonlinear dynamics from limited data remains challenging. In this
paper, we shall present a novel deep symbolic learning method called the
"finite expression method" (FEX) to discover governing equations within a
function space containing a finite set of analytic expressions, based on
observed dynamic data. The key concept is to employ FEX to generate analytical
expressions of the governing equations by learning the derivatives of partial
differential equation (PDE) solutions through convolutions. Our numerical
results demonstrate that our FEX surpasses other existing methods (such as
PDE-Net, SINDy, GP, and SPL) in terms of numerical performance across a range
of problems, including time-dependent PDE problems and nonlinear dynamical
systems with time-varying coefficients. Moreover, the results highlight FEX's
flexibility and expressive power in accurately approximating symbolic governing
equations.
Related papers
- Graph Neural Regularizers for PDE Inverse Problems [62.49743146797144]
We present a framework for solving a broad class of ill-posed inverse problems governed by partial differential equations (PDEs)<n>The forward problem is numerically solved using the finite element method (FEM)<n>We employ physics-inspired graph neural networks as learned regularizers, providing a robust, interpretable, and generalizable alternative to standard approaches.
arXiv Detail & Related papers (2025-10-23T21:43:25Z) - Towards Interpretable Deep Learning and Analysis of Dynamical Systems via the Discrete Empirical Interpolation Method [2.225353152447347]
We present a differentiable framework that leverages the Discrete Empirical Interpolation Method (DEIM) for interpretable deep learning and dynamical system analysis.<n>We first develop a differentiable adaptive DEIM for the one-dimensional viscous Burgers equation.<n>We then apply DEIM as an interpretable analysis tool for examining the learned dynamics of a pre-trained Neural Ordinary Differential Equation (NODE) on a two-dimensional vortex-merging problem.
arXiv Detail & Related papers (2025-10-22T20:39:00Z) - Physics-Informed Linear Model (PILM): Analytical Representations and Application to Crustal Strain Rate Estimation [0.0]
We investigate a physics-informed linear model (PILM) that uses linear combinations of basis functions to represent solutions.<n>The PILM provides an analytically solvable framework applicable to linear forward and inverse problems, underdetermined systems, and physical regularization.
arXiv Detail & Related papers (2025-07-16T13:23:39Z) - Governing Equation Discovery from Data Based on Differential Invariants [52.2614860099811]
We propose a pipeline for governing equation discovery based on differential invariants.<n>Specifically, we compute the set of differential invariants corresponding to the infinitesimal generators of the symmetry group.<n>Taking DI-SINDy as an example, we demonstrate that its success rate and accuracy in PDE discovery surpass those of other symmetry-informed governing equation discovery methods.
arXiv Detail & Related papers (2025-05-24T17:19:02Z) - Identifying Unknown Stochastic Dynamics via Finite expression methods [2.4715271879679395]
This paper introduces the Finite Expression Method (FEX), a symbolic learning approach designed to derive interpretable mathematical representations of the deterministic component of differential equations (SDEs)
Experiments on linear, nonlinear, and multidimensional SDEs demonstrate that FEX generalizes well beyond the training domain and delivers more accurate long-term predictions compared to neural network-based methods.
arXiv Detail & Related papers (2025-04-09T17:57:54Z) - In-Context Learning of Stochastic Differential Equations with Foundation Inference Models [6.785438664749581]
differential equations (SDEs) describe dynamical systems where deterministic flows, governed by a drift function, are superimposed with random fluctuations, dictated by a diffusion function.<n>We introduce FIM-SDE (Foundation Inference Model for SDEs), a pretrained recognition model that delivers accurate in-context estimation of the drift and diffusion functions of low-dimensional SDEs.<n>We demonstrate that FIM-SDE achieves robust in-context function estimation across a wide range of synthetic and real-world processes.
arXiv Detail & Related papers (2025-02-26T11:04:02Z) - Mechanistic PDE Networks for Discovery of Governing Equations [52.492158106791365]
We present Mechanistic PDE Networks, a model for discovery of partial differential equations from data.
The represented PDEs are then solved and decoded for specific tasks.
We develop a native, GPU-capable, parallel, sparse, and differentiable multigrid solver specialized for linear partial differential equations.
arXiv Detail & Related papers (2025-02-25T17:21:44Z) - Advancing Generalization in PINNs through Latent-Space Representations [71.86401914779019]
Physics-informed neural networks (PINNs) have made significant strides in modeling dynamical systems governed by partial differential equations (PDEs)
We propose PIDO, a novel physics-informed neural PDE solver designed to generalize effectively across diverse PDE configurations.
We validate PIDO on a range of benchmarks, including 1D combined equations and 2D Navier-Stokes equations.
arXiv Detail & Related papers (2024-11-28T13:16:20Z) - Shape Arithmetic Expressions: Advancing Scientific Discovery Beyond Closed-Form Equations [56.78271181959529]
Generalized Additive Models (GAMs) can capture non-linear relationships between variables and targets, but they cannot capture intricate feature interactions.
We propose Shape Expressions Arithmetic ( SHAREs) that fuses GAM's flexible shape functions with the complex feature interactions found in mathematical expressions.
We also design a set of rules for constructing SHAREs that guarantee transparency of the found expressions beyond the standard constraints.
arXiv Detail & Related papers (2024-04-15T13:44:01Z) - Discovering Interpretable Physical Models using Symbolic Regression and
Discrete Exterior Calculus [55.2480439325792]
We propose a framework that combines Symbolic Regression (SR) and Discrete Exterior Calculus (DEC) for the automated discovery of physical models.
DEC provides building blocks for the discrete analogue of field theories, which are beyond the state-of-the-art applications of SR to physical problems.
We prove the effectiveness of our methodology by re-discovering three models of Continuum Physics from synthetic experimental data.
arXiv Detail & Related papers (2023-10-10T13:23:05Z) - Semi-supervised Learning of Partial Differential Operators and Dynamical
Flows [68.77595310155365]
We present a novel method that combines a hyper-network solver with a Fourier Neural Operator architecture.
We test our method on various time evolution PDEs, including nonlinear fluid flows in one, two, and three spatial dimensions.
The results show that the new method improves the learning accuracy at the time point of supervision point, and is able to interpolate and the solutions to any intermediate time.
arXiv Detail & Related papers (2022-07-28T19:59:14Z) - Learning differentiable solvers for systems with hard constraints [48.54197776363251]
We introduce a practical method to enforce partial differential equation (PDE) constraints for functions defined by neural networks (NNs)
We develop a differentiable PDE-constrained layer that can be incorporated into any NN architecture.
Our results show that incorporating hard constraints directly into the NN architecture achieves much lower test error when compared to training on an unconstrained objective.
arXiv Detail & Related papers (2022-07-18T15:11:43Z) - Finite Expression Method for Solving High-Dimensional Partial
Differential Equations [5.736353542430439]
This paper introduces a new methodology that seeks an approximate PDE solution in the space of functions with finitely many analytic expressions.
It is proved in approximation theory that FEX can avoid the curse of dimensionality.
An approximate solution with finite analytic expressions also provides interpretable insights into the ground truth PDE solution.
arXiv Detail & Related papers (2022-06-21T05:51:10Z) - Physics-constrained Unsupervised Learning of Partial Differential
Equations using Meshes [1.066048003460524]
Graph neural networks show promise in accurately representing irregularly meshed objects and learning their dynamics.
In this work, we represent meshes naturally as graphs, process these using Graph Networks, and formulate our physics-based loss to provide an unsupervised learning framework for partial differential equations (PDE)
Our framework will enable the application of PDE solvers in interactive settings, such as model-based control of soft-body deformations.
arXiv Detail & Related papers (2022-03-30T19:22:56Z) - Capturing Actionable Dynamics with Structured Latent Ordinary
Differential Equations [68.62843292346813]
We propose a structured latent ODE model that captures system input variations within its latent representation.
Building on a static variable specification, our model learns factors of variation for each input to the system, thus separating the effects of the system inputs in the latent space.
arXiv Detail & Related papers (2022-02-25T20:00:56Z) - Approximate Latent Force Model Inference [1.3927943269211591]
latent force models offer an interpretable alternative to purely data driven tools for inference in dynamical systems.
We show that a neural operator approach can scale our model to thousands of instances, enabling fast, distributed computation.
arXiv Detail & Related papers (2021-09-24T09:55:00Z) - Physics-Guided Discovery of Highly Nonlinear Parametric Partial
Differential Equations [29.181177365252925]
Partial differential equations (PDEs) that fit scientific data can represent physical laws with explainable mechanisms.
We propose a novel physics-guided learning method, which encodes observation knowledge and incorporates basic physical principles and laws.
Experiments show that our proposed method is more robust against data noise, and can reduce the estimation error by a large margin.
arXiv Detail & Related papers (2021-06-02T11:24:49Z) - Physics-informed learning of governing equations from scarce data [14.95055620484844]
This work introduces a physics-informed deep learning framework to discover governing partial differential equations (PDEs) from scarce and noisy representation data.
The efficacy and robustness of this method are demonstrated, both numerically and experimentally, on discovering a variety of PDE systems.
The resulting computational framework shows the potential for closed-form model discovery in practical applications.
arXiv Detail & Related papers (2020-05-05T22:13:22Z) - Learning Stochastic Behaviour from Aggregate Data [52.012857267317784]
Learning nonlinear dynamics from aggregate data is a challenging problem because the full trajectory of each individual is not available.
We propose a novel method using the weak form of Fokker Planck Equation (FPE) to describe the density evolution of data in a sampled form.
In such a sample-based framework we are able to learn the nonlinear dynamics from aggregate data without explicitly solving the partial differential equation (PDE) FPE.
arXiv Detail & Related papers (2020-02-10T03:20:13Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.