An Overview on Machine Learning Methods for Partial Differential Equations: from Physics Informed Neural Networks to Deep Operator Learning

• URL: http://arxiv.org/abs/2408.13222v1
• Date: Fri, 23 Aug 2024 16:57:34 GMT
• Title: An Overview on Machine Learning Methods for Partial Differential Equations: from Physics Informed Neural Networks to Deep Operator Learning
• Authors: Lukas Gonon, Arnulf Jentzen, Benno Kuckuck, Siyu Liang, Adrian Riekert, Philippe von Wurstemberger,
• Abstract summary: approximation of solutions of partial differential equations with numerical algorithms is a central topic in applied mathematics. One class of methods which has received a lot of attention in recent years are machine learning-based methods. This article aims to provide an introduction to some of these methods and the mathematical theory on which they are based.
• Score: 5.75055574132362
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The approximation of solutions of partial differential equations (PDEs) with numerical algorithms is a central topic in applied mathematics. For many decades, various types of methods for this purpose have been developed and extensively studied. One class of methods which has received a lot of attention in recent years are machine learning-based methods, which typically involve the training of artificial neural networks (ANNs) by means of stochastic gradient descent type optimization methods. While approximation methods for PDEs using ANNs have first been proposed in the 1990s they have only gained wide popularity in the last decade with the rise of deep learning. This article aims to provide an introduction to some of these methods and the mathematical theory on which they are based. We discuss methods such as physics-informed neural networks (PINNs) and deep BSDE methods and consider several operator learning approaches.

Related papers

• Mathematical Introduction to Deep Learning: Methods, Implementations, and Theory [4.066869900592636]
  This book aims to provide an introduction to the topic of deep learning algorithms. We review essential components of deep learning algorithms in full mathematical detail.
  arXiv  Detail & Related papers  (2023-10-31T11:01:23Z)
• Learning the solution operator of two-dimensional incompressible Navier-Stokes equations using physics-aware convolutional neural networks [68.8204255655161]
  We introduce a technique with which it is possible to learn approximate solutions to the steady-state Navier--Stokes equations in varying geometries without the need of parametrization. The results of our physics-aware CNN are compared to a state-of-the-art data-based approach.
  arXiv  Detail & Related papers  (2023-08-04T05:09:06Z)
• Deep learning applied to computational mechanics: A comprehensive review, state of the art, and the classics [77.34726150561087]
  Recent developments in artificial neural networks, particularly deep learning (DL), are reviewed in detail. Both hybrid and pure machine learning (ML) methods are discussed. History and limitations of AI are recounted and discussed, with particular attention at pointing out misstatements or misconceptions of the classics.
  arXiv  Detail & Related papers  (2022-12-18T02:03:00Z)
• Deep Learning Methods for Partial Differential Equations and Related Parameter Identification Problems [1.7150329136228712]
  More and more neural network architectures have been developed to solve specific classes of partial differential equations (PDEs) Such methods exploit properties that are inherent to PDEs and thus solve the PDEs better than standard feed-forward neural networks, recurrent neural networks, or convolutional neural networks. This has had a great impact in the area of mathematical modeling where parametric PDEs are widely used to model most natural and physical processes arising in science and engineering.
  arXiv  Detail & Related papers  (2022-12-06T16:53:34Z)
• Partial Differential Equations Meet Deep Neural Networks: A Survey [10.817323756266527]
  Problems in science and engineering can be represented by a set of partial differential equations (PDEs) through mathematical modeling. Mechanism-based computation following PDEs has long been an essential paradigm for studying topics such as computational fluid dynamics. Deep Neural Networks (DNNs) for PDEs have emerged as an effective means of solving PDEs.
  arXiv  Detail & Related papers  (2022-10-27T07:01:56Z)
• Unsupervised Legendre-Galerkin Neural Network for Stiff Partial Differential Equations [9.659504024299896]
  We propose an unsupervised machine learning algorithm based on the Legendre-Galerkin neural network to find an accurate approximation to the solution of different types of PDEs. The proposed neural network is applied to the general 1D and 2D PDEs as well as singularly perturbed PDEs that possess boundary layer behavior.
  arXiv  Detail & Related papers  (2022-07-21T00:47:47Z)
• Model-Based Deep Learning: On the Intersection of Deep Learning and Optimization [101.32332941117271]
  Decision making algorithms are used in a multitude of different applications. Deep learning approaches that use highly parametric architectures tuned from data without relying on mathematical models are becoming increasingly popular. Model-based optimization and data-centric deep learning are often considered to be distinct disciplines.
  arXiv  Detail & Related papers  (2022-05-05T13:40:08Z)
• Physical Gradients for Deep Learning [101.36788327318669]
  We find that state-of-the-art training techniques are not well-suited to many problems that involve physical processes. We propose a novel hybrid training approach that combines higher-order optimization methods with machine learning techniques.
  arXiv  Detail & Related papers  (2021-09-30T12:14:31Z)
• A Survey on Deep Semi-supervised Learning [51.26862262550445]
  We first present a taxonomy for deep semi-supervised learning that categorizes existing methods. We then offer a detailed comparison of these methods in terms of the type of losses, contributions, and architecture differences.
  arXiv  Detail & Related papers  (2021-02-28T16:22:58Z)
• An overview on deep learning-based approximation methods for partial differential equations [2.4087148947930634]
  It is one of the most challenging problems in applied mathematics to approximatively solve high-dimensional partial differential equations (PDEs) Several deep learning-based approximation algorithms for attacking this problem have been proposed and tested numerically on a number of examples of high-dimensional PDEs. This has given rise to a lively field of research in which deep learning-based methods and related Monte Carlo methods are applied to the approximation of high-dimensional PDEs.
  arXiv  Detail & Related papers  (2020-12-22T20:48:20Z)
• Model-Based Deep Learning [155.063817656602]
  Signal processing, communications, and control have traditionally relied on classical statistical modeling techniques. Deep neural networks (DNNs) use generic architectures which learn to operate from data, and demonstrate excellent performance. We are interested in hybrid techniques that combine principled mathematical models with data-driven systems to benefit from the advantages of both approaches.
  arXiv  Detail & Related papers  (2020-12-15T16:29:49Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.