Multiwavelet-based Operator Learning for Differential Equations
- URL: http://arxiv.org/abs/2109.13459v1
- Date: Tue, 28 Sep 2021 03:21:47 GMT
- Title: Multiwavelet-based Operator Learning for Differential Equations
- Authors: Gaurav Gupta, Xiongye Xiao, Paul Bogdan
- Abstract summary: We introduce a textitmultiwavelet-based neural operator learning scheme that compresses the associated operator's kernel.
By explicitly embedding the inverse multiwavelet filters, we learn the projection of the kernel onto fixed multiwavelet bases.
Compared with the existing neural operator approaches, our model shows significantly higher accuracy and state-of-the-art in a range of datasets.
- Score: 3.0824316066680484
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: The solution of a partial differential equation can be obtained by computing
the inverse operator map between the input and the solution space. Towards this
end, we introduce a \textit{multiwavelet-based neural operator learning scheme}
that compresses the associated operator's kernel using fine-grained wavelets.
By explicitly embedding the inverse multiwavelet filters, we learn the
projection of the kernel onto fixed multiwavelet polynomial bases. The
projected kernel is trained at multiple scales derived from using repeated
computation of multiwavelet transform. This allows learning the complex
dependencies at various scales and results in a resolution-independent scheme.
Compare to the prior works, we exploit the fundamental properties of the
operator's kernel which enable numerically efficient representation. We perform
experiments on the Korteweg-de Vries (KdV) equation, Burgers' equation, Darcy
Flow, and Navier-Stokes equation. Compared with the existing neural operator
approaches, our model shows significantly higher accuracy and achieves
state-of-the-art in a range of datasets. For the time-varying equations, the
proposed method exhibits a ($2X-10X$) improvement ($0.0018$ ($0.0033$) relative
$L2$ error for Burgers' (KdV) equation). By learning the mappings between
function spaces, the proposed method has the ability to find the solution of a
high-resolution input after learning from lower-resolution data.
Related papers
- Learning Partial Differential Equations with Deep Parallel Neural Operators [11.121415128908566]
A novel methodology is to learn an operator as a means of approximating the mapping between outputs.
In practical physical science problems, the numerical solutions of partial differential equations are complex.
We propose a deep parallel operator model (DPNO) for efficiently and accurately solving partial differential equations.
arXiv Detail & Related papers (2024-09-30T06:04:04Z) - Dilated convolution neural operator for multiscale partial differential equations [11.093527996062058]
We propose the Dilated Convolutional Neural Operator (DCNO) for multiscale partial differential equations.
The DCNO architecture effectively captures both high-frequency and low-frequency features while maintaining a low computational cost.
We show that DCNO strikes an optimal balance between accuracy and computational cost and offers a promising solution for multiscale operator learning.
arXiv Detail & Related papers (2024-07-16T08:17:02Z) - Multi-Grid Tensorized Fourier Neural Operator for High-Resolution PDEs [93.82811501035569]
We introduce a new data efficient and highly parallelizable operator learning approach with reduced memory requirement and better generalization.
MG-TFNO scales to large resolutions by leveraging local and global structures of full-scale, real-world phenomena.
We demonstrate superior performance on the turbulent Navier-Stokes equations where we achieve less than half the error with over 150x compression.
arXiv Detail & Related papers (2023-09-29T20:18:52Z) - Learning High-Dimensional Nonparametric Differential Equations via
Multivariate Occupation Kernel Functions [0.31317409221921133]
Learning a nonparametric system of ordinary differential equations requires learning $d$ functions of $d$ variables.
Explicit formulations scale quadratically in $d$ unless additional knowledge about system properties, such as sparsity and symmetries, is available.
We propose a linear approach to learning using the implicit formulation provided by vector-valued Reproducing Kernel Hilbert Spaces.
arXiv Detail & Related papers (2023-06-16T21:49:36Z) - Coupled Multiwavelet Neural Operator Learning for Coupled Partial
Differential Equations [13.337268390844745]
We propose a textitcoupled multiwavelets neural operator (CMWNO) learning scheme by decoupling the coupled integral kernels.
The proposed model achieves significantly higher accuracy compared to previous learning-based solvers.
arXiv Detail & Related papers (2023-03-04T03:06:47Z) - Fast Differentiable Matrix Square Root and Inverse Square Root [65.67315418971688]
We propose two more efficient variants to compute the differentiable matrix square root and the inverse square root.
For the forward propagation, one method is to use Matrix Taylor Polynomial (MTP), and the other method is to use Matrix Pad'e Approximants (MPA)
A series of numerical tests show that both methods yield considerable speed-up compared with the SVD or the NS iteration.
arXiv Detail & Related papers (2022-01-29T10:00:35Z) - Factorized Fourier Neural Operators [77.47313102926017]
The Factorized Fourier Neural Operator (F-FNO) is a learning-based method for simulating partial differential equations.
We show that our model maintains an error rate of 2% while still running an order of magnitude faster than a numerical solver.
arXiv Detail & Related papers (2021-11-27T03:34:13Z) - Fourier Neural Operator for Parametric Partial Differential Equations [57.90284928158383]
We formulate a new neural operator by parameterizing the integral kernel directly in Fourier space.
We perform experiments on Burgers' equation, Darcy flow, and Navier-Stokes equation.
It is up to three orders of magnitude faster compared to traditional PDE solvers.
arXiv Detail & Related papers (2020-10-18T00:34:21Z) - Multipole Graph Neural Operator for Parametric Partial Differential
Equations [57.90284928158383]
One of the main challenges in using deep learning-based methods for simulating physical systems is formulating physics-based data.
We propose a novel multi-level graph neural network framework that captures interaction at all ranges with only linear complexity.
Experiments confirm our multi-graph network learns discretization-invariant solution operators to PDEs and can be evaluated in linear time.
arXiv Detail & Related papers (2020-06-16T21:56:22Z) - The data-driven physical-based equations discovery using evolutionary
approach [77.34726150561087]
We describe the algorithm for the mathematical equations discovery from the given observations data.
The algorithm combines genetic programming with the sparse regression.
It could be used for governing analytical equation discovery as well as for partial differential equations (PDE) discovery.
arXiv Detail & Related papers (2020-04-03T17:21:57Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.