Estimates on the generalization error of Physics Informed Neural Networks (PINNs) for approximating PDEs

• URL: http://arxiv.org/abs/2006.16144v3
• Date: Wed, 6 Dec 2023 09:20:09 GMT
• Title: Estimates on the generalization error of Physics Informed Neural Networks (PINNs) for approximating PDEs
• Authors: Siddhartha Mishra and Roberto Molinaro
• Abstract summary: We provide rigorous upper bounds on the generalization error of PINNs approximating solutions of the forward problem for PDEs. An abstract formalism is introduced and stability properties of the underlying PDE are leveraged to derive an estimate for the generalization error.
• Score: 16.758334184623152
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Physics informed neural networks (PINNs) have recently been widely used for robust and accurate approximation of PDEs. We provide rigorous upper bounds on the generalization error of PINNs approximating solutions of the forward problem for PDEs. An abstract formalism is introduced and stability properties of the underlying PDE are leveraged to derive an estimate for the generalization error in terms of the training error and number of training samples. This abstract framework is illustrated with several examples of nonlinear PDEs. Numerical experiments, validating the proposed theory, are also presented.

Related papers

• Error Bounds for Deep Learning-based Uncertainty Propagation in SDEs [11.729744197698718]
  probability density function (PDF) represents uncertainty of processes. It is generally infeasible to solve the Fokker-Planck partial differential equation (FP-PDE) in closed form. We show that physics-informed neural networks (PINNs) can be trained to approximate the solution PDF using existing methods.
  arXiv  Detail & Related papers  (2024-10-28T23:25:55Z)
• Unisolver: PDE-Conditional Transformers Are Universal PDE Solvers [55.0876373185983]
  We present the Universal PDE solver (Unisolver) capable of solving a wide scope of PDEs. Our key finding is that a PDE solution is fundamentally under the control of a series of PDE components. Unisolver achieves consistent state-of-the-art results on three challenging large-scale benchmarks.
  arXiv  Detail & Related papers  (2024-05-27T15:34:35Z)
• RoPINN: Region Optimized Physics-Informed Neural Networks [66.38369833561039]
  Physics-informed neural networks (PINNs) have been widely applied to solve partial differential equations (PDEs) This paper proposes and theoretically studies a new training paradigm as region optimization. A practical training algorithm, Region Optimized PINN (RoPINN), is seamlessly derived from this new paradigm.
  arXiv  Detail & Related papers  (2024-05-23T09:45:57Z)
• Deep Equilibrium Based Neural Operators for Steady-State PDEs [100.88355782126098]
  We study the benefits of weight-tied neural network architectures for steady-state PDEs. We propose FNO-DEQ, a deep equilibrium variant of the FNO architecture that directly solves for the solution of a steady-state PDE.
  arXiv  Detail & Related papers  (2023-11-30T22:34:57Z)
• Lie Point Symmetry and Physics Informed Networks [59.56218517113066]
  We propose a loss function that informs the network about Lie point symmetries in the same way that PINN models try to enforce the underlying PDE through a loss function. Our symmetry loss ensures that the infinitesimal generators of the Lie group conserve the PDE solutions. Empirical evaluations indicate that the inductive bias introduced by the Lie point symmetries of the PDEs greatly boosts the sample efficiency of PINNs.
  arXiv  Detail & Related papers  (2023-11-07T19:07:16Z)
• Solving PDEs on Spheres with Physics-Informed Convolutional Neural Networks [17.69666422395703]
  Physics-informed neural networks (PINNs) have been demonstrated to be efficient in solving partial differential equations (PDEs) In this paper, we establish rigorous analysis of the physics-informed convolutional neural network (PICNN) for solving PDEs on the sphere.
  arXiv  Detail & Related papers  (2023-08-18T14:58:23Z)
• Physics-Aware Neural Networks for Boundary Layer Linear Problems [0.0]
  Physics-Informed Neural Networks (PINNs) approximate the solution of general partial differential equations (PDEs) by adding them in some form as terms of the loss/cost of a Neural Network. This paper explores PINNs for linear PDEs whose solutions may present one or more boundary layers.
  arXiv  Detail & Related papers  (2022-07-15T21:15:06Z)
• Lie Point Symmetry Data Augmentation for Neural PDE Solvers [69.72427135610106]
  We present a method, which can partially alleviate this problem, by improving neural PDE solver sample complexity. In the context of PDEs, it turns out that we are able to quantitatively derive an exhaustive list of data transformations. We show how it can easily be deployed to improve neural PDE solver sample complexity by an order of magnitude.
  arXiv  Detail & Related papers  (2022-02-15T18:43:17Z)
• Physics-Informed Neural Operator for Learning Partial Differential Equations [55.406540167010014]
  PINO is the first hybrid approach incorporating data and PDE constraints at different resolutions to learn the operator. The resulting PINO model can accurately approximate the ground-truth solution operator for many popular PDE families.
  arXiv  Detail & Related papers  (2021-11-06T03:41:34Z)
• Error analysis for physics informed neural networks (PINNs) approximating Kolmogorov PDEs [0.0]
  We derive rigorous bounds on the error incurred by PINNs in approximating the solutions of a large class of parabolic PDEs. We construct neural networks, whose PINN residual (generalization error) can be made as small as desired. These results enable us to provide a comprehensive error analysis for PINNs in approximating Kolmogorov PDEs.
  arXiv  Detail & Related papers  (2021-06-28T08:37:56Z)
• Estimates on the generalization error of Physics Informed Neural Networks (PINNs) for approximating a class of inverse problems for PDEs [16.758334184623152]
  We focus on a particular class of inverse problems, the so-called data assimilation or unique continuation problems. We prove rigorous estimates on the generalization error of PINNs approximating them.
  arXiv  Detail & Related papers  (2020-06-29T16:23:58Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.