Higher-Order Fourier Neural Operator: Explicit Mode Mixer for Nonlinear PDEs

• URL: http://arxiv.org/abs/2606.28122v1
• Date: Fri, 26 Jun 2026 14:22:30 GMT
• Title: Higher-Order Fourier Neural Operator: Explicit Mode Mixer for Nonlinear PDEs
• Abstract summary: We introduce the Higher-Order Spectral Convolution, a spectral mixer that extends FNO from diagonal modulation to explicit n-linear mode mixing.<n>Experiments show that the proposed Higher-Order FNO (HO-FNO) retains the efficiency of FNO-based architectures and consistently improves over other spectral neural operators.
• Score: 41.60180166000317
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Neural operators provide deep neural networks for learning mappings between function spaces. Among them, the Fourier Neural Operator (FNO) is particularly effective: its spectral convolution relies on low-dimensional Fourier-domain representations and can handle inputs at different resolutions. This design aligns well with settings where the Fourier basis diagonalizes the underlying operator, such as linear, constant-coefficient PDEs on periodic domains, in which Fourier modes evolve independently. However, nonlinear PDEs may benefit from an additional inductive bias, as they exhibit structured interactions between modes, governed by polynomial nonlinearities. To capture this inductive bias, we introduce the Higher-Order Spectral Convolution, a spectral mixer that extends FNO from diagonal modulation to explicit n-linear mode mixing, aligned with the dynamics of nonlinear PDEs. Our experiments on standard benchmarks show that the proposed Higher-Order FNO (HO-FNO) retains the efficiency of FNO-based architectures and consistently improves over other spectral neural operators. HO-FNO also performs on par with or better than state-of-the-art transformers and state-space models on several datasets, with stronger gains in highly nonlinear regimes, such as the Poisson equation with polynomial forcing, where a single HO-FNO layer outperforms FNO models with up to 16 layers. We open-source our code for reproducibility at: https://github.com/AlexColagrande/HO-FNO.

Related papers

• Learning Metamaterial Eigenmodes with Wavelet-Encoded Fourier Neural Operators [57.64362886310329]
  We show that a machine learning surrogate based on neural operators can learn and predict multiple eigenmodes of the elastic wave equation.<n>For metamaterial design, the resulting surrogate accelerates the simulation stage of the design cycle by three orders of magnitude relative to finite element analysis on a consumer-grade CPU.<n>These results also carry broader implications for designing input encodings in other multi-mode PDE solvers based on spectral neural operators.
  arXiv  Detail & Related papers  (2026-09-08T01:21:46Z)
• Alternating Levenberg-Marquardt Training of Physics-Informed Neural Networks with Fourier-Enhanced Features [7.1865646765394215]
  Physics-informed neural networks (PINNs) often fail to accurately resolve partial differential equations (PDEs) with high-frequency or multi-scale solutions.<n>We show that FALM-PINN achieves relative $L2$ errors up to two magnitude lower than state-of-the-art baselines.
  arXiv  Detail & Related papers  (2026-08-06T11:18:10Z)
• From Spectral Methods to Sample Complexity Bounds for Fourier Neural Operators [5.169752999102176]
  We introduce classes of evolution operators defined through spectral methods and derive FNO bounds for these classes.<n>For equations with nonlinearities, the learning rates depend primarily on the smoothness of the input space and the dimension of the physical domain.<n>Our results hold uniformly over broad families of dissipative equations, rather than for a single fixed PDE, and apply in particular to the Navier--Stokes, Allen--Cahn, and Cahn--Hilliard equations.
  arXiv  Detail & Related papers  (2026-07-01T01:35:15Z)
• Isotropic Fourier Neural Operators [0.0]
  We propose a modification to the linear transformations that ensures spatial symmetries are respected.<n>This improves model performance and reduces the number of parameters by up to a factor of 16 in 2D and 96 in 3D.
  arXiv  Detail & Related papers  (2026-05-04T13:47:45Z)
• Shearlet Neural Operators for Anisotropic-Shock-Dominated and Multi-scale parametric partial differential equations [0.0]
  We introduce the Shearlet Neural Operator (SNO), a neural operator architecture that replaces the Fourier transform with a shearlet-based representation.<n>SNO consistently improves predictive accuracy and feature fidelity over FNO baselines, with the largest gains observed in anisotropic and discontinuity-dominated settings.
  arXiv  Detail & Related papers  (2026-04-28T03:38:32Z)
• Linear-Nonlinear Fusion Neural Operator for Partial Differential Equations [4.892307363245757]
  We find that explicitly decoupling linear and nonlinear effects within operator mappings leads to markedly improved learning efficiency.<n>This yields a novel network structure, namely the Linear-Nonlinear Fusion Neural Operator (LNF-NO)<n>LNF-NO naturally supports multiple functional inputs and is applicable to both regular grids and irregular geometries.
  arXiv  Detail & Related papers  (2026-03-25T10:10:53Z)
• Beyond Regular Grids: Fourier-Based Neural Operators on Arbitrary Domains [13.56018270837999]
  We propose a simple method to extend neural operators to arbitrary domains. An efficient implementation* of such direct spectral evaluations is coupled with existing neural operator models. We demonstrate that the proposed method allows us to extend neural operators to arbitrary point distributions with significant gains in training speed over baselines.
  arXiv  Detail & Related papers  (2023-05-31T09:01:20Z)
• FC-PINO: High Precision Physics-Informed Neural Operators via Fourier Continuation [60.706803227003995]
  We introduce the FC-PINO (Fourier-Continuation-based PINO) architecture which extends the accuracy and efficiency of PINO to non-periodic and non-smooth PDEs.<n>We demonstrate that standard PINO struggles to solve non-periodic and non-smooth PDEs with high precision, across challenging benchmarks.<n>In contrast, the proposed FC-PINO provides accurate, robust, and scalable solutions, substantially outperforming PINO alternatives.
  arXiv  Detail & Related papers  (2022-11-29T06:37:54Z)
• Incremental Spatial and Spectral Learning of Neural Operators for Solving Large-Scale PDEs [86.35471039808023]
  We introduce the Incremental Fourier Neural Operator (iFNO), which progressively increases the number of frequency modes used by the model. We show that iFNO reduces total training time while maintaining or improving generalization performance across various datasets. Our method demonstrates a 10% lower testing error, using 20% fewer frequency modes compared to the existing Fourier Neural Operator, while also achieving a 30% faster training.
  arXiv  Detail & Related papers  (2022-11-28T09:57:15Z)
• Fourier Neural Operator with Learned Deformations for PDEs on General Geometries [75.91055304134258]
  We propose a new framework, viz., geo-FNO, to solve PDEs on arbitrary geometries. Geo-FNO learns to deform the input (physical) domain, which may be irregular, into a latent space with a uniform grid. We consider a variety of PDEs such as the Elasticity, Plasticity, Euler's, and Navier-Stokes equations, and both forward modeling and inverse design problems.
  arXiv  Detail & Related papers  (2022-07-11T21:55:47Z)
• Factorized Fourier Neural Operators [77.47313102926017]
  The Factorized Fourier Neural Operator (F-FNO) is a learning-based method for simulating partial differential equations. We show that our model maintains an error rate of 2% while still running an order of magnitude faster than a numerical solver.
  arXiv  Detail & Related papers  (2021-11-27T03:34:13Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.