Clifford Neural Layers for PDE Modeling

• URL: http://arxiv.org/abs/2209.04934v1
• Date: Thu, 8 Sep 2022 17:35:30 GMT
• Title: Clifford Neural Layers for PDE Modeling
• Authors: Johannes Brandstetter, Rianne van den Berg, Max Welling, Jayesh K. Gupta
• Abstract summary: Partial differential equations (PDEs) see widespread use in sciences and engineering to describe simulation of physical processes as scalar and vector fields interacting and coevolving over time. Current methods do not explicitly take into account the relationship between different fields and their internal components, which are often correlated. This paper presents the first usage of such multivector representations together with Clifford convolutions and Clifford Fourier transforms in the context of deep learning. The resulting Clifford neural layers are universally applicable and will find direct use in the areas of fluid dynamics, weather forecasting, and the modeling of physical systems in general.
• Score: 61.07764203014727
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: Partial differential equations (PDEs) see widespread use in sciences and engineering to describe simulation of physical processes as scalar and vector fields interacting and coevolving over time. Due to the computationally expensive nature of their standard solution methods, neural PDE surrogates have become an active research topic to accelerate these simulations. However, current methods do not explicitly take into account the relationship between different fields and their internal components, which are often correlated. Viewing the time evolution of such correlated fields through the lens of multivector fields allows us to overcome these limitations. Multivector fields consist of scalar, vector, as well as higher-order components, such as bivectors and trivectors. Their algebraic properties, such as multiplication, addition and other arithmetic operations can be described by Clifford algebras. To our knowledge, this paper presents the first usage of such multivector representations together with Clifford convolutions and Clifford Fourier transforms in the context of deep learning. The resulting Clifford neural layers are universally applicable and will find direct use in the areas of fluid dynamics, weather forecasting, and the modeling of physical systems in general. We empirically evaluate the benefit of Clifford neural layers by replacing convolution and Fourier operations in common neural PDE surrogates by their Clifford counterparts on two-dimensional Navier-Stokes and weather modeling tasks, as well as three-dimensional Maxwell equations. Clifford neural layers consistently improve generalization capabilities of the tested neural PDE surrogates.

Related papers

• DimOL: Dimensional Awareness as A New 'Dimension' in Operator Learning [63.5925701087252]
  We introduce DimOL (Dimension-aware Operator Learning), drawing insights from dimensional analysis. To implement DimOL, we propose the ProdLayer, which can be seamlessly integrated into FNO-based and Transformer-based PDE solvers. Empirically, DimOL models achieve up to 48% performance gain within the PDE datasets.
  arXiv  Detail & Related papers  (2024-10-08T10:48:50Z)
• Equivariant Graph Neural Operator for Modeling 3D Dynamics [148.98826858078556]
  We propose Equivariant Graph Neural Operator (EGNO) to directly models dynamics as trajectories instead of just next-step prediction. EGNO explicitly learns the temporal evolution of 3D dynamics where we formulate the dynamics as a function over time and learn neural operators to approximate it. Comprehensive experiments in multiple domains, including particle simulations, human motion capture, and molecular dynamics, demonstrate the significantly superior performance of EGNO against existing methods.
  arXiv  Detail & Related papers  (2024-01-19T21:50:32Z)
• Neural Operators for Accelerating Scientific Simulations and Design [85.89660065887956]
  An AI framework, known as Neural Operators, presents a principled framework for learning mappings between functions defined on continuous domains. Neural Operators can augment or even replace existing simulators in many applications, such as computational fluid dynamics, weather forecasting, and material modeling.
  arXiv  Detail & Related papers  (2023-09-27T00:12:07Z)
• Learning Generic Solutions for Multiphase Transport in Porous Media via the Flux Functions Operator [0.0]
  DeepDeepONet has emerged as a powerful tool for accelerating rendering fluxDEs. We use Physics-In DeepONets (PI-DeepONets) to achieve this mapping without any input paired-output observations.
  arXiv  Detail & Related papers  (2023-07-03T21:10:30Z)
• Physics-constrained neural differential equations for learning multi-ionic transport [0.0]
  We develop the first physics-informed deep learning model to learn ion transport behaviour across polyamide nanopores. We use neural differential equations in conjunction with classical closure models as inductive biases directly into the neural framework.
  arXiv  Detail & Related papers  (2023-03-07T17:18:52Z)
• Multi-scale Physical Representations for Approximating PDE Solutions with Graph Neural Operators [14.466945570499183]
  We study three multi-resolution schema with integral kernel operators approximated with emphMessage Passing Graph Neural Networks (MPGNNs) To validate our study, we make extensive MPGNNs experiments with well-chosen metrics considering steady and unsteady PDEs.
  arXiv  Detail & Related papers  (2022-06-29T14:42:03Z)
• Equivariant vector field network for many-body system modeling [65.22203086172019]
  Equivariant Vector Field Network (EVFN) is built on a novel equivariant basis and the associated scalarization and vectorization layers. We evaluate our method on predicting trajectories of simulated Newton mechanics systems with both full and partially observed data.
  arXiv  Detail & Related papers  (2021-10-26T14:26:25Z)
• A Gradient-based Deep Neural Network Model for Simulating Multiphase Flow in Porous Media [1.5791732557395552]
  We describe a gradient-based deep neural network (GDNN) constrained by the physics related to multiphase flow in porous media. We demonstrate that GDNN can effectively predict the nonlinear patterns of subsurface responses.
  arXiv  Detail & Related papers  (2021-04-30T02:14:00Z)
• Fourier Neural Operator for Parametric Partial Differential Equations [57.90284928158383]
  We formulate a new neural operator by parameterizing the integral kernel directly in Fourier space. We perform experiments on Burgers' equation, Darcy flow, and Navier-Stokes equation. It is up to three orders of magnitude faster compared to traditional PDE solvers.
  arXiv  Detail & Related papers  (2020-10-18T00:34:21Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.