PINNIES: An Efficient Physics-Informed Neural Network Framework to Integral Operator Problems

• URL: http://arxiv.org/abs/2409.01899v1
• Date: Tue, 3 Sep 2024 13:43:58 GMT
• Title: PINNIES: An Efficient Physics-Informed Neural Network Framework to Integral Operator Problems
• Authors: Alireza Afzal Aghaei, Mahdi Movahedian Moghaddam, Kourosh Parand,
• Abstract summary: This paper introduces an efficient tensor-vector product technique for the approximation of integral operators within physics-informed deep learning frameworks. We demonstrate the applicability of this method to both Fredholm and Volterra integral operators. We also propose a fast matrix-vector product algorithm for efficiently computing the fractional Caputo derivative.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: This paper introduces an efficient tensor-vector product technique for the rapid and accurate approximation of integral operators within physics-informed deep learning frameworks. Our approach leverages neural network architectures to evaluate problem dynamics at specific points, while employing Gaussian quadrature formulas to approximate the integral components, even in the presence of infinite domains or singularities. We demonstrate the applicability of this method to both Fredholm and Volterra integral operators, as well as to optimal control problems involving continuous time. Additionally, we outline how this approach can be extended to approximate fractional derivatives and integrals and propose a fast matrix-vector product algorithm for efficiently computing the fractional Caputo derivative. In the numerical section, we conduct comprehensive experiments on forward and inverse problems. For forward problems, we evaluate the performance of our method on over 50 diverse mathematical problems, including multi-dimensional integral equations, systems of integral equations, partial and fractional integro-differential equations, and various optimal control problems in delay, fractional, multi-dimensional, and nonlinear configurations. For inverse problems, we test our approach on several integral equations and fractional integro-differential problems. Finally, we introduce the pinnies Python package to facilitate the implementation and usability of the proposed method.

Related papers

• Neural Control Variates with Automatic Integration [49.91408797261987]
  This paper proposes a novel approach to construct learnable parametric control variates functions from arbitrary neural network architectures. We use the network to approximate the anti-derivative of the integrand. We apply our method to solve partial differential equations using the Walk-on-sphere algorithm.
  arXiv  Detail & Related papers  (2024-09-23T06:04:28Z)
• KANtrol: A Physics-Informed Kolmogorov-Arnold Network Framework for Solving Multi-Dimensional and Fractional Optimal Control Problems [0.0]
  We introduce the KANtrol framework to solve optimal control problems involving continuous time variables. We show how automatic differentiation is utilized to compute exact derivatives for integer-order dynamics. We tackle multi-dimensional problems, including the optimal control of a 2D partial heat differential equation.
  arXiv  Detail & Related papers  (2024-09-10T17:12:37Z)
• A Physics-Informed Machine Learning Approach for Solving Distributed Order Fractional Differential Equations [0.0]
  This paper introduces a novel methodology for solving distributed-order fractional differential equations using a physics-informed machine learning framework. By embedding the distributed-order functional equation into the SVR framework, we incorporate physical laws directly into the learning process. The effectiveness of the proposed approach is validated through a series of numerical experiments on Caputo-based distributed-order fractional differential equations.
  arXiv  Detail & Related papers  (2024-09-05T13:20:10Z)
• Fredholm Integral Equations Neural Operator (FIE-NO) for Data-Driven Boundary Value Problems [0.0]
  We present a physics-guided operator learning method (FIE-NO) for solving Boundary Value Problems (BVPs) with irregular boundaries. We demonstrate that the proposed method achieves superior performance in addressing BVPs. Our approach can generalize across multiple scenarios, including those with unknown equation forms and intricate boundary shapes.
  arXiv  Detail & Related papers  (2024-08-20T00:15:27Z)
• MultiSTOP: Solving Functional Equations with Reinforcement Learning [56.073581097785016]
  We develop MultiSTOP, a Reinforcement Learning framework for solving functional equations in physics. This new methodology produces actual numerical solutions instead of bounds on them.
  arXiv  Detail & Related papers  (2024-04-23T10:51:31Z)
• Spectral methods for Neural Integral Equations [0.6993026261767287]
  We introduce a framework for neural integral equations based on spectral methods. We show various theoretical guarantees regarding the approximation capabilities of the model. We provide numerical experiments to demonstrate the practical effectiveness of the resulting model.
  arXiv  Detail & Related papers  (2023-12-09T19:42:36Z)
• Linearization Algorithms for Fully Composite Optimization [61.20539085730636]
  This paper studies first-order algorithms for solving fully composite optimization problems convex compact sets. We leverage the structure of the objective by handling differentiable and non-differentiable separately, linearizing only the smooth parts.
  arXiv  Detail & Related papers  (2023-02-24T18:41:48Z)
• Backpropagation of Unrolled Solvers with Folded Optimization [55.04219793298687]
  The integration of constrained optimization models as components in deep networks has led to promising advances on many specialized learning tasks. One typical strategy is algorithm unrolling, which relies on automatic differentiation through the operations of an iterative solver. This paper provides theoretical insights into the backward pass of unrolled optimization, leading to a system for generating efficiently solvable analytical models of backpropagation.
  arXiv  Detail & Related papers  (2023-01-28T01:50:42Z)
• Semi-supervised Learning of Partial Differential Operators and Dynamical Flows [68.77595310155365]
  We present a novel method that combines a hyper-network solver with a Fourier Neural Operator architecture. We test our method on various time evolution PDEs, including nonlinear fluid flows in one, two, and three spatial dimensions. The results show that the new method improves the learning accuracy at the time point of supervision point, and is able to interpolate and the solutions to any intermediate time.
  arXiv  Detail & Related papers  (2022-07-28T19:59:14Z)
• Optimization on manifolds: A symplectic approach [127.54402681305629]
  We propose a dissipative extension of Dirac's theory of constrained Hamiltonian systems as a general framework for solving optimization problems. Our class of (accelerated) algorithms are not only simple and efficient but also applicable to a broad range of contexts.
  arXiv  Detail & Related papers  (2021-07-23T13:43:34Z)
• Revisiting the Role of Euler Numerical Integration on Acceleration and Stability in Convex Optimization [25.171367662119113]
  We propose a novel ordinary differential equation that questions the connection between acceleration and the quality of the integrator. Although semi-implicit methods are well-known in numerical analysis to enjoy many desirable features for the integration of physical systems, our findings show that these properties do not necessarily relate to acceleration.
  arXiv  Detail & Related papers  (2021-02-23T08:05:05Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.