Taper-based scattering formulation of the Helmholtz equation to improve the training process of Physics-Informed Neural Networks

• URL: http://arxiv.org/abs/2404.09794v1
• Date: Mon, 15 Apr 2024 13:51:20 GMT
• Title: Taper-based scattering formulation of the Helmholtz equation to improve the training process of Physics-Informed Neural Networks
• Authors: W. Dörfler, M. Elasmi, T. Laufer,
• Abstract summary: This work addresses the scattering problem of an incident wave at a junction connecting two semi-infinite waveguides. PINNs are known to suffer from a spectral bias and from the hyperbolic nature of the Helmholtz equation. We suggest an equivalent formulation of the Helmholtz Boundary Value Problem.
• Score: 0.0
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: This work addresses the scattering problem of an incident wave at a junction connecting two semi-infinite waveguides, which we intend to solve using Physics-Informed Neural Networks (PINNs). As with other deep learning-based approaches, PINNs are known to suffer from a spectral bias and from the hyperbolic nature of the Helmholtz equation. This makes the training process challenging, especially for higher wave numbers. We show an example where these limitations are present. In order to improve the learning capability of our model, we suggest an equivalent formulation of the Helmholtz Boundary Value Problem (BVP) that is based on splitting the total wave into a tapered continuation of the incoming wave and a remaining scattered wave. This allows the introduction of an inhomogeneity in the BVP, leveraging the information transmitted during back-propagation, thus, enhancing and accelerating the training process of our PINN model. The presented numerical illustrations are in accordance with the expected behavior, paving the way to a possible alternative approach to predicting scattering problems using PINNs.

Related papers

• An efficient wavelet-based physics-informed neural networks for singularly perturbed problems [0.0]
  Physics-informed neural networks (PINNs) are a class of deep learning models that utilize physics as differential equations. We present an efficient wavelet-based PINNs model to solve singularly perturbed differential equations. The architecture allows the training process to search for a solution within wavelet space, making the process faster and more accurate.
  arXiv  Detail & Related papers  (2024-09-18T10:01:37Z)
• Solving Poisson Equations using Neural Walk-on-Spheres [80.1675792181381]
  We propose Neural Walk-on-Spheres (NWoS), a novel neural PDE solver for the efficient solution of high-dimensional Poisson equations. We demonstrate the superiority of NWoS in accuracy, speed, and computational costs.
  arXiv  Detail & Related papers  (2024-06-05T17:59:22Z)
• Approximating Families of Sharp Solutions to Fisher's Equation with Physics-Informed Neural Networks [9.271640666465364]
  This paper employs physics-informed neural networks (PINNs) to solve Fisher's equation. A residual weighting scheme is introduced to address optimization challenges associated with the standard PINN approach. A specific network architecture is studied which is tailored for solutions in the form of traveling waves.
  arXiv  Detail & Related papers  (2024-02-13T09:17:20Z)
• GaborPINN: Efficient physics informed neural networks using multiplicative filtered networks [0.0]
  Physics-informed neural networks (PINNs) provide functional wavefield solutions represented by neural networks (NNs) We propose a modified PINN using multiplicative filtered networks, which embeds some of the known characteristics of the wavefield in training. The proposed method achieves up to a two-magnitude increase in the speed of convergence as compared with conventional PINNs.
  arXiv  Detail & Related papers  (2023-08-10T19:51:00Z)
• Error Analysis of Physics-Informed Neural Networks for Approximating Dynamic PDEs of Second Order in Time [1.123111111659464]
  We consider the approximation of a class of dynamic partial differential equations (PDE) of second order in time by the physics-informed neural network (PINN) approach. Our analyses show that, with feed-forward neural networks having two hidden layers and the $tanh$ activation function, the PINN approximation errors for the solution field can be effectively bounded by the training loss and the number of training data points. We present ample numerical experiments with the new PINN algorithm for the wave equation, the Sine-Gordon equation and the linear elastodynamic equation, which show that the method can capture
  arXiv  Detail & Related papers  (2023-03-22T00:51:11Z)
• Implicit Stochastic Gradient Descent for Training Physics-informed Neural Networks [51.92362217307946]
  Physics-informed neural networks (PINNs) have effectively been demonstrated in solving forward and inverse differential equation problems. PINNs are trapped in training failures when the target functions to be approximated exhibit high-frequency or multi-scale features. In this paper, we propose to employ implicit gradient descent (ISGD) method to train PINNs for improving the stability of training process.
  arXiv  Detail & Related papers  (2023-03-03T08:17:47Z)
• Wave simulation in non-smooth media by PINN with quadratic neural network and PML condition [2.7651063843287718]
  The recently proposed physics-informed neural network (PINN) has achieved successful applications in solving a wide range of partial differential equations (PDEs) In this paper, we solve the acoustic and visco-acoustic scattered-field wave equation in the frequency domain with PINN instead of the wave equation to remove source perturbation. We show that PML and quadratic neurons improve the results as well as attenuation and discuss the reason for this improvement.
  arXiv  Detail & Related papers  (2022-08-16T13:29:01Z)
• Neural Basis Functions for Accelerating Solutions to High Mach Euler Equations [63.8376359764052]
  We propose an approach to solving partial differential equations (PDEs) using a set of neural networks. We regress a set of neural networks onto a reduced order Proper Orthogonal Decomposition (POD) basis. These networks are then used in combination with a branch network that ingests the parameters of the prescribed PDE to compute a reduced order approximation to the PDE.
  arXiv  Detail & Related papers  (2022-08-02T18:27:13Z)
• Momentum Diminishes the Effect of Spectral Bias in Physics-Informed Neural Networks [72.09574528342732]
  Physics-informed neural network (PINN) algorithms have shown promising results in solving a wide range of problems involving partial differential equations (PDEs) They often fail to converge to desirable solutions when the target function contains high-frequency features, due to a phenomenon known as spectral bias. In the present work, we exploit neural tangent kernels (NTKs) to investigate the training dynamics of PINNs evolving under gradient descent with momentum (SGDM)
  arXiv  Detail & Related papers  (2022-06-29T19:03:10Z)
• Learning Physics-Informed Neural Networks without Stacked Back-propagation [82.26566759276105]
  We develop a novel approach that can significantly accelerate the training of Physics-Informed Neural Networks. In particular, we parameterize the PDE solution by the Gaussian smoothed model and show that, derived from Stein's Identity, the second-order derivatives can be efficiently calculated without back-propagation. Experimental results show that our proposed method can achieve competitive error compared to standard PINN training but is two orders of magnitude faster.
  arXiv  Detail & Related papers  (2022-02-18T18:07:54Z)
• Machine Learning S-Wave Scattering Phase Shifts Bypassing the Radial Schr\"odinger Equation [77.34726150561087]
  We present a proof of concept machine learning model resting on a convolutional neural network capable to yield accurate scattering s-wave phase shifts. We discuss how the Hamiltonian can serve as a guiding principle in the construction of a physically-motivated descriptor.
  arXiv  Detail & Related papers  (2021-06-25T17:25:38Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.