Related papers: Practical Aspects on Solving Differential Equations Using Deep Learning: A Primer

Practical Aspects on Solving Differential Equations Using Deep Learning: A Primer

URL: http://arxiv.org/abs/2408.11266v2
Date: Tue, 17 Sep 2024 19:25:51 GMT
Title: Practical Aspects on Solving Differential Equations Using Deep Learning: A Primer
Authors: Georgios Is. Detorakis,
Abstract summary: This primer aims to provide technical and practical insights into the Deep Galerkin method. We demonstrate how to solve the one-dimensional heat equation step-by-step. We also show how to apply the Deep Galerkin method to solve systems of ordinary differential equations and integral equations.
Score: 0.0
License: http://creativecommons.org/licenses/by-sa/4.0/
Abstract: Deep learning has become a popular tool across many scientific fields, including the study of differential equations, particularly partial differential equations. This work introduces the basic principles of deep learning and the Deep Galerkin method, which uses deep neural networks to solve differential equations. This primer aims to provide technical and practical insights into the Deep Galerkin method and its implementation. We demonstrate how to solve the one-dimensional heat equation step-by-step. We also show how to apply the Deep Galerkin method to solve systems of ordinary differential equations and integral equations, such as the Fredholm of the second kind. Additionally, we provide code snippets within the text and the complete source code on Github. The examples are designed so that one can run them on a simple computer without needing a GPU.

Related papers

An Overview on Machine Learning Methods for Partial Differential Equations: from Physics Informed Neural Networks to Deep Operator Learning [5.75055574132362]
approximation of solutions of partial differential equations with numerical algorithms is a central topic in applied mathematics. One class of methods which has received a lot of attention in recent years are machine learning-based methods. This article aims to provide an introduction to some of these methods and the mathematical theory on which they are based.
arXiv Detail & Related papers (2024-08-23T16:57:34Z)
MultiSTOP: Solving Functional Equations with Reinforcement Learning [56.073581097785016]
We develop MultiSTOP, a Reinforcement Learning framework for solving functional equations in physics. This new methodology produces actual numerical solutions instead of bounds on them.
arXiv Detail & Related papers (2024-04-23T10:51:31Z)
Differential Equations for Continuous-Time Deep Learning [2.163953126557988]
It primarily targets readers familiar with ordinary and partial differential equations and their analysis. We will see how neural ODEs can provide new insights into deep learning and a foundation for more efficient algorithms.
arXiv Detail & Related papers (2024-01-08T15:40:11Z)
Learning the solution operator of two-dimensional incompressible Navier-Stokes equations using physics-aware convolutional neural networks [68.8204255655161]
We introduce a technique with which it is possible to learn approximate solutions to the steady-state Navier--Stokes equations in varying geometries without the need of parametrization. The results of our physics-aware CNN are compared to a state-of-the-art data-based approach.
arXiv Detail & Related papers (2023-08-04T05:09:06Z)
Solving differential equations using physics informed deep learning: a hand-on tutorial with benchmark tests [0.0]
We revisit the original approach of using deep learning and neural networks to solve differential equations. We focus on the possibility to use the least possible amount of data into the training process. A tutorial on a simple equation model illustrates how to put into practice the method for ordinary differential equations.
arXiv Detail & Related papers (2023-02-23T16:08:39Z)
Deep learning for gradient flows using the Brezis-Ekeland principle [0.0]
We propose a deep learning method for the numerical solution of partial differential equations that arise as gradient flows. The method relies on the Brezis--Ekeland principle, which naturally defines an objective function to be minimized.
arXiv Detail & Related papers (2022-09-28T14:06:32Z)
Fourier Neural Operator for Parametric Partial Differential Equations [57.90284928158383]
We formulate a new neural operator by parameterizing the integral kernel directly in Fourier space. We perform experiments on Burgers' equation, Darcy flow, and Navier-Stokes equation. It is up to three orders of magnitude faster compared to traditional PDE solvers.
arXiv Detail & Related papers (2020-10-18T00:34:21Z)
Learning Manifold Implicitly via Explicit Heat-Kernel Learning [63.354671267760516]
We propose the concept of implicit manifold learning, where manifold information is implicitly obtained by learning the associated heat kernel. The learned heat kernel can be applied to various kernel-based machine learning models, including deep generative models (DGM) for data generation and Stein Variational Gradient Descent for Bayesian inference.
arXiv Detail & Related papers (2020-10-05T03:39:58Z)
Physarum Powered Differentiable Linear Programming Layers and Applications [48.77235931652611]
We propose an efficient and differentiable solver for general linear programming problems. We show the use of our solver in a video segmentation task and meta-learning for few-shot learning.
arXiv Detail & Related papers (2020-04-30T01:50:37Z)
Backward Feature Correction: How Deep Learning Performs Deep (Hierarchical) Learning [66.05472746340142]
This paper analyzes how multi-layer neural networks can perform hierarchical learning _efficiently_ and _automatically_ by SGD on the training objective. We establish a new principle called "backward feature correction", where the errors in the lower-level features can be automatically corrected when training together with the higher-level layers.
arXiv Detail & Related papers (2020-01-13T17:28:29Z)

This list is automatically generated from the titles and abstracts of the papers in this site.