Finite Element Operator Network for Solving Parametric PDEs
- URL: http://arxiv.org/abs/2308.04690v2
- Date: Tue, 19 Dec 2023 13:41:47 GMT
- Title: Finite Element Operator Network for Solving Parametric PDEs
- Authors: Jae Yong Lee, Seungchan Ko, Youngjoon Hong
- Abstract summary: Partial differential equations (PDEs) underlie our understanding and prediction of natural phenomena.
We propose a novel approach for solving parametric PDEs using a Finite Element Operator Network (FEONet)
- Score: 10.855582917943092
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Partial differential equations (PDEs) underlie our understanding and
prediction of natural phenomena across numerous fields, including physics,
engineering, and finance. However, solving parametric PDEs is a complex task
that necessitates efficient numerical methods. In this paper, we propose a
novel approach for solving parametric PDEs using a Finite Element Operator
Network (FEONet). Our proposed method leverages the power of deep learning in
conjunction with traditional numerical methods, specifically the finite element
method, to solve parametric PDEs in the absence of any paired input-output
training data. We performed various experiments on several benchmark problems
and confirmed that our approach has demonstrated excellent performance across
various settings and environments, proving its versatility in terms of
accuracy, generalization, and computational flexibility. Our FEONet framework
shows potential for application in various fields where PDEs play a crucial
role in modeling complex domains with diverse boundary conditions and singular
behavior. Furthermore, we provide theoretical convergence analysis to support
our approach, utilizing finite element approximation in numerical analysis.
Related papers
- DimOL: Dimensional Awareness as A New 'Dimension' in Operator Learning [63.5925701087252]
We introduce DimOL (Dimension-aware Operator Learning), drawing insights from dimensional analysis.
To implement DimOL, we propose the ProdLayer, which can be seamlessly integrated into FNO-based and Transformer-based PDE solvers.
Empirically, DimOL models achieve up to 48% performance gain within the PDE datasets.
arXiv Detail & Related papers (2024-10-08T10:48:50Z) - Base Models for Parabolic Partial Differential Equations [30.565534769404536]
Parabolic partial differential equations (PDEs) appear in many disciplines to model the evolution of various mathematical objects.
It is often necessary to compute the solutions or a function of the solutions to a parametric PDE in multiple scenarios corresponding to different parameters of this PDE.
We propose a framework for finding solutions to parabolic PDEs across different scenarios by meta-learning an underlying base.
arXiv Detail & Related papers (2024-07-17T01:04:28Z) - Unisolver: PDE-Conditional Transformers Are Universal PDE Solvers [55.0876373185983]
We present the Universal PDE solver (Unisolver) capable of solving a wide scope of PDEs.
Our key finding is that a PDE solution is fundamentally under the control of a series of PDE components.
Unisolver achieves consistent state-of-the-art results on three challenging large-scale benchmarks.
arXiv Detail & Related papers (2024-05-27T15:34:35Z) - Physics-informed Discretization-independent Deep Compositional Operator Network [1.2430809884830318]
We introduce a novel physics-informed model architecture which can generalize to various discrete representations of PDE parameters and irregular domain shapes.
Inspired by deep operator neural networks, our model involves a discretization-independent learning of parameter embedding repeatedly.
Numerical results demonstrate the accuracy and efficiency of the proposed method.
arXiv Detail & Related papers (2024-04-21T12:41:30Z) - Pretraining Codomain Attention Neural Operators for Solving Multiphysics PDEs [85.40198664108624]
We propose Codomain Attention Neural Operator (CoDA-NO) to solve multiphysics problems with PDEs.
CoDA-NO tokenizes functions along the codomain or channel space, enabling self-supervised learning or pretraining of multiple PDE systems.
We find CoDA-NO to outperform existing methods by over 36% on complex downstream tasks with limited data.
arXiv Detail & Related papers (2024-03-19T08:56:20Z) - Deep Equilibrium Based Neural Operators for Steady-State PDEs [100.88355782126098]
We study the benefits of weight-tied neural network architectures for steady-state PDEs.
We propose FNO-DEQ, a deep equilibrium variant of the FNO architecture that directly solves for the solution of a steady-state PDE.
arXiv Detail & Related papers (2023-11-30T22:34:57Z) - Spectral operator learning for parametric PDEs without data reliance [6.7083321695379885]
We introduce a novel operator learning-based approach for solving parametric partial differential equations (PDEs) without the need for data harnessing.
The proposed framework demonstrates superior performance compared to existing scientific machine learning techniques.
arXiv Detail & Related papers (2023-10-03T12:37:15Z) - Efficient Neural PDE-Solvers using Quantization Aware Training [71.0934372968972]
We show that quantization can successfully lower the computational cost of inference while maintaining performance.
Our results on four standard PDE datasets and three network architectures show that quantization-aware training works across settings and three orders of FLOPs magnitudes.
arXiv Detail & Related papers (2023-08-14T09:21:19Z) - Learning differentiable solvers for systems with hard constraints [48.54197776363251]
We introduce a practical method to enforce partial differential equation (PDE) constraints for functions defined by neural networks (NNs)
We develop a differentiable PDE-constrained layer that can be incorporated into any NN architecture.
Our results show that incorporating hard constraints directly into the NN architecture achieves much lower test error when compared to training on an unconstrained objective.
arXiv Detail & Related papers (2022-07-18T15:11:43Z) - Finite Expression Method for Solving High-Dimensional Partial
Differential Equations [5.736353542430439]
This paper introduces a new methodology that seeks an approximate PDE solution in the space of functions with finitely many analytic expressions.
It is proved in approximation theory that FEX can avoid the curse of dimensionality.
An approximate solution with finite analytic expressions also provides interpretable insights into the ground truth PDE solution.
arXiv Detail & Related papers (2022-06-21T05:51:10Z) - Spectrally Adapted Physics-Informed Neural Networks for Solving
Unbounded Domain Problems [0.0]
In this work, we combine two classes of numerical methods: (i) physics-informed neural networks (PINNs) and (ii) adaptive spectral methods.
The numerical methods that we develop take advantage of the ability of physics-informed neural networks to easily implement high-order numerical schemes to efficiently solve PDEs.
We then show how recently introduced adaptive techniques for spectral methods can be integrated into PINN-based PDE solvers to obtain numerical solutions of unbounded domain problems that cannot be efficiently approximated by standard PINNs.
arXiv Detail & Related papers (2022-02-06T05:25:22Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.