Isotropic Fourier Neural Operators

• URL: http://arxiv.org/abs/2605.02597v1
• Date: Mon, 04 May 2026 13:47:45 GMT
• Title: Isotropic Fourier Neural Operators
• Abstract summary: We propose a modification to the linear transformations that ensures spatial symmetries are respected.<n>This improves model performance and reduces the number of parameters by up to a factor of 16 in 2D and 96 in 3D.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Fourier Neural Operators are deep learning models that learn mappings between function spaces and can be used to learn and solve partial differential equations (PDEs), in some cases significantly faster than traditional PDE solvers. Within the model are Fourier layers, which apply linear transformations directly to the Fourier modes, with parameters depending on the wave numbers. However, most physical systems are isotropic, with the results being independent of the coordinate system chosen, but the linear transformations do not necessarily respect these symmetries. We propose a modification to the linear transformations that ensures spatial symmetries are respected, called the Isotropic Fourier Neural Operator, which both improves model performance and reduces the number of parameters by up to a factor of 16 in 2D and 96 in 3D.

Related papers

• Learning Metamaterial Eigenmodes with Wavelet-Encoded Fourier Neural Operators [57.64362886310329]
  We show that a machine learning surrogate based on neural operators can learn and predict multiple eigenmodes of the elastic wave equation.<n>For metamaterial design, the resulting surrogate accelerates the simulation stage of the design cycle by three orders of magnitude relative to finite element analysis on a consumer-grade CPU.<n>These results also carry broader implications for designing input encodings in other multi-mode PDE solvers based on spectral neural operators.
  arXiv  Detail & Related papers  (2026-09-08T01:21:46Z)
• Equation Recast for Canonical Operator Learning Across Parametric PDEs [59.44573033543284]
  We introduce equation recast, which reformulates parametric operator learning as the learning of a single canonical operator.<n>In high-fidelity tokamak simulations for nuclear fusion, the framework unifies electron-temperature data across four device geometries.
  arXiv  Detail & Related papers  (2026-09-02T13:15:50Z)
• Flash EQ-Linear: Accelerating Equivariant Linear Layers via Group-wise Discrete Fourier Transform [65.89510337046077]
  Equivariant networks embed geometric symmetries as structural priors through weight sharing.<n>Existing implementations unroll the structured weights into dense matrices and dispatch them to generic dense kernels.<n>This is the first time equivariant networks strictly dominate their non-equivariant counterparts along all three axes simultaneously.
  arXiv  Detail & Related papers  (2026-07-23T12:45:21Z)
• Higher-Order Fourier Neural Operator: Explicit Mode Mixer for Nonlinear PDEs [41.60180166000317]
  We introduce the Higher-Order Spectral Convolution, a spectral mixer that extends FNO from diagonal modulation to explicit n-linear mode mixing.<n>Experiments show that the proposed Higher-Order FNO (HO-FNO) retains the efficiency of FNO-based architectures and consistently improves over other spectral neural operators.
  arXiv  Detail & Related papers  (2026-06-26T14:22:30Z)
• Operator Learning for Cubic Nonlinear Schrödinger Equation on Periodic Domains [0.0]
  We consider the cubic nonlinear Schrdinger (NLS) equation on two-dimensional flat tori with varying aspect ratios.<n>We present a geometry-conditioned Fourier neural operator (FNO) for the cubic defocusing NLS equation.
  arXiv  Detail & Related papers  (2026-06-25T18:33:53Z)
• EqGINO: Equivariant Geometry-Informed Fourier Neural Operators for 3D PDEs [12.013314817711054]
  We introduce EqGINO, a geometrically robust framework that enforces isotropy in the spectral domain.<n>Our method robustly models coordinate-invariant physical laws on complex irregular 3D geometries.
  arXiv  Detail & Related papers  (2026-06-02T07:23:06Z)
• Equivariant U-Shaped Neural Operators for the Cahn-Hilliard Phase-Field Model [4.79907962230318]
  We show that an equivariant U-shaped neural operator (E-UNO) can learn the evolution of the phase-field variable from short histories of past dynamics.<n>By encoding symmetry and scale hierarchy, the model generalizes better, requires less training data, and yields physically consistent dynamics.
  arXiv  Detail & Related papers  (2025-09-01T09:25:31Z)
• Generalized Linear Mode Connectivity for Transformers [87.32299363530996]
  A striking phenomenon is linear mode connectivity (LMC), where independently trained models can be connected by low- or zero-loss paths.<n>Prior work has predominantly focused on neuron re-ordering through permutations, but such approaches are limited in scope.<n>We introduce a unified framework that captures four symmetry classes: permutations, semi-permutations, transformations, and general invertible maps.<n>This generalization enables, for the first time, the discovery of low- and zero-barrier linear paths between independently trained Vision Transformers and GPT-2 models.
  arXiv  Detail & Related papers  (2025-06-28T01:46:36Z)
• Fourier-Invertible Neural Encoder (FINE) for Homogeneous Flows [4.095418032380801]
  Invertible neural networks have attracted attention for their compactness, interpretability, and information-preserving properties.<n>We propose the Fourier-Invertible Neural (FINE), which combines invertible monotonic activation functions with reversible filter structures.
  arXiv  Detail & Related papers  (2025-05-21T10:02:59Z)
• Equivariant Graph Neural Operator for Modeling 3D Dynamics [148.98826858078556]
  We propose Equivariant Graph Neural Operator (EGNO) to directly models dynamics as trajectories instead of just next-step prediction. EGNO explicitly learns the temporal evolution of 3D dynamics where we formulate the dynamics as a function over time and learn neural operators to approximate it. Comprehensive experiments in multiple domains, including particle simulations, human motion capture, and molecular dynamics, demonstrate the significantly superior performance of EGNO against existing methods.
  arXiv  Detail & Related papers  (2024-01-19T21:50:32Z)
• Group Equivariant Fourier Neural Operators for Partial Differential Equations [33.71890280061319]
  We consider solving partial differential equations with Fourier neural operators (FNOs) In this work, we extend group convolutions to the frequency domain and design Fourier layers that are equivariant to rotations, translations, and reflections. The resulting $G$-FNO architecture generalizes well across input resolutions and performs well in settings with varying levels of symmetry.
  arXiv  Detail & Related papers  (2023-06-09T06:34:16Z)
• Fourier Neural Operator with Learned Deformations for PDEs on General Geometries [75.91055304134258]
  We propose a new framework, viz., geo-FNO, to solve PDEs on arbitrary geometries. Geo-FNO learns to deform the input (physical) domain, which may be irregular, into a latent space with a uniform grid. We consider a variety of PDEs such as the Elasticity, Plasticity, Euler's, and Navier-Stokes equations, and both forward modeling and inverse design problems.
  arXiv  Detail & Related papers  (2022-07-11T21:55:47Z)
• Fourier Neural Operator for Parametric Partial Differential Equations [57.90284928158383]
  We formulate a new neural operator by parameterizing the integral kernel directly in Fourier space. We perform experiments on Burgers' equation, Darcy flow, and Navier-Stokes equation. It is up to three orders of magnitude faster compared to traditional PDE solvers.
  arXiv  Detail & Related papers  (2020-10-18T00:34:21Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.