Multi-Scale Finite Expression Method for PDEs with Oscillatory Solutions on Complex Domains
- URL: http://arxiv.org/abs/2510.22497v1
- Date: Sun, 26 Oct 2025 02:26:49 GMT
- Title: Multi-Scale Finite Expression Method for PDEs with Oscillatory Solutions on Complex Domains
- Authors: Gareth Hardwick, Haizhao Yang,
- Abstract summary: High-frequency oscillations and intricate geometries result in prohibitively expensive representations for traditional numerical methods.<n>We introduce an enhanced Finite Expression Method (FEX) designed to address these challenges with improved accuracy, interpretability, and computational efficiency.
- Score: 5.8296917468117835
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Solving partial differential equations (PDEs) with highly oscillatory solutions on complex domains remains a challenging and important problem. High-frequency oscillations and intricate geometries often result in prohibitively expensive representations for traditional numerical methods and lead to difficult optimization landscapes for machine learning-based approaches. In this work, we introduce an enhanced Finite Expression Method (FEX) designed to address these challenges with improved accuracy, interpretability, and computational efficiency. The proposed framework incorporates three key innovations: a symbolic spectral composition module that enables FEX to learn and represent multiscale oscillatory behavior; a redesigned linear input layer that significantly expands the expressivity of the model; and an eigenvalue formulation that extends FEX to a new class of problems involving eigenvalue PDEs. Through extensive numerical experiments, we demonstrate that FEX accurately resolves oscillatory PDEs on domains containing multiple holes of varying shapes and sizes. Compared with existing neural network-based solvers, FEX achieves substantially higher accuracy while yielding interpretable, closed-form solutions that expose the underlying structure of the problem. These advantages, often absent in conventional finite element, finite difference, and black-box neural approaches, highlight FEX as a powerful and transparent framework for solving complex PDEs.
Related papers
- Fourier Neural Operators Explained: A Practical Perspective [75.12291469255794]
The Fourier Neural Operator (FNO) has become the most influential and widely adopted due to its elegant spectral formulation.<n>This guide aims to establish a clear and reliable framework for applying FNOs effectively across diverse scientific and engineering fields.
arXiv Detail & Related papers (2025-12-01T08:56:21Z) - Graph Neural Regularizers for PDE Inverse Problems [62.49743146797144]
We present a framework for solving a broad class of ill-posed inverse problems governed by partial differential equations (PDEs)<n>The forward problem is numerically solved using the finite element method (FEM)<n>We employ physics-inspired graph neural networks as learned regularizers, providing a robust, interpretable, and generalizable alternative to standard approaches.
arXiv Detail & Related papers (2025-10-23T21:43:25Z) - Enhancing Fourier Neural Operators with Local Spatial Features [16.887523262913234]
We introduce a convolutional neural network (CNN)-based feature pre-extractor to capture Local Spatial Features (LSFs) directly from input data.<n>Our findings show that this simple yet impactful modification enhances the representational capacity of FNOs.
arXiv Detail & Related papers (2025-03-22T15:11:56Z) - Efficient Training of Neural Fractional-Order Differential Equation via Adjoint Backpropagation [19.331085375128048]
Fractional-order differential equations (FDEs) enhance traditional differential equations by extending the order of differential operators from integers to real numbers.<n>Recent progress at the intersection of FDEs and deep learning has catalyzed a new wave of innovative models.<n>We propose a scalable adjoint backpropagation method for training neural FDEs by solving an augmented FDE backward in time.
arXiv Detail & Related papers (2025-03-20T19:26:54Z) - Unisolver: PDE-Conditional Transformers Towards Universal Neural PDE Solvers [53.79279286773326]
We present Unisolver, a novel Transformer model trained on diverse data and conditioned on diverse PDEs.<n>Unisolver achieves consistent state-of-the-art on three challenging large-scale benchmarks, showing impressive performance and generalizability.
arXiv Detail & Related papers (2024-05-27T15:34:35Z) - Deep Equilibrium Based Neural Operators for Steady-State PDEs [100.88355782126098]
We study the benefits of weight-tied neural network architectures for steady-state PDEs.
We propose FNO-DEQ, a deep equilibrium variant of the FNO architecture that directly solves for the solution of a steady-state PDE.
arXiv Detail & Related papers (2023-11-30T22:34:57Z) - Enhancing Solutions for Complex PDEs: Introducing Complementary Convolution and Equivariant Attention in Fourier Neural Operators [17.91230192726962]
We propose a novel hierarchical Fourier neural operator along with convolution-residual layers and attention mechanisms to solve complex PDEs.
We find that the proposed method achieves superior performance in these PDE benchmarks, especially for equations characterized by rapid coefficient variations.
arXiv Detail & Related papers (2023-11-21T11:04:13Z) - A Deep Learning Framework for Solving Hyperbolic Partial Differential
Equations: Part I [0.0]
This research focuses on the development of a physics informed deep learning framework to approximate solutions to nonlinear PDEs.
The framework naturally handles imposition of boundary conditions (Neumann/Dirichlet), entropy conditions, and regularity requirements.
arXiv Detail & Related papers (2023-07-09T08:27:17Z) - Finite Expression Methods for Discovering Physical Laws from Data [6.460951804337735]
We present a novel deep symbolic learning method called the "finite expression method" (FEX)
FEX generates analytical expressions of the governing equations by learning the derivatives of partial differential equation (PDE) solutions through convolutions.
Results demonstrate FEX's flexibility and expressive power in accurately approximating symbolic governing equations.
arXiv Detail & Related papers (2023-05-15T04:26:35Z) - Learning differentiable solvers for systems with hard constraints [48.54197776363251]
We introduce a practical method to enforce partial differential equation (PDE) constraints for functions defined by neural networks (NNs)
We develop a differentiable PDE-constrained layer that can be incorporated into any NN architecture.
Our results show that incorporating hard constraints directly into the NN architecture achieves much lower test error when compared to training on an unconstrained objective.
arXiv Detail & Related papers (2022-07-18T15:11:43Z) - Finite Expression Method for Solving High-Dimensional Partial Differential Equations [9.238700679836857]
This paper introduces a new methodology that seeks an approximate PDE solution in the space of functions with finitely many analytic expressions.<n>It is proved in approximation theory that FEX can avoid the curse of dimensionality.<n>An approximate solution with finite analytic expressions also provides interpretable insights into the ground truth PDE solution.
arXiv Detail & Related papers (2022-06-21T05:51:10Z) - Message Passing Neural PDE Solvers [60.77761603258397]
We build a neural message passing solver, replacing allally designed components in the graph with backprop-optimized neural function approximators.
We show that neural message passing solvers representationally contain some classical methods, such as finite differences, finite volumes, and WENO schemes.
We validate our method on various fluid-like flow problems, demonstrating fast, stable, and accurate performance across different domain topologies, equation parameters, discretizations, etc., in 1D and 2D.
arXiv Detail & Related papers (2022-02-07T17:47:46Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.