Spherical Fourier Neural Operators: Learning Stable Dynamics on the Sphere

• URL: http://arxiv.org/abs/2306.03838v1
• Date: Tue, 6 Jun 2023 16:27:17 GMT
• Title: Spherical Fourier Neural Operators: Learning Stable Dynamics on the Sphere
• Authors: Boris Bonev, Thorsten Kurth, Christian Hundt, Jaideep Pathak, Maximilian Baust, Karthik Kashinath, Anima Anandkumar
• Abstract summary: We introduce Spherical FNOs (SFNOs) for learning operators on spherical geometries. SFNOs have important implications for machine learning-based simulation of climate dynamics.
• Score: 53.63505583883769
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Fourier Neural Operators (FNOs) have proven to be an efficient and effective method for resolution-independent operator learning in a broad variety of application areas across scientific machine learning. A key reason for their success is their ability to accurately model long-range dependencies in spatio-temporal data by learning global convolutions in a computationally efficient manner. To this end, FNOs rely on the discrete Fourier transform (DFT), however, DFTs cause visual and spectral artifacts as well as pronounced dissipation when learning operators in spherical coordinates since they incorrectly assume a flat geometry. To overcome this limitation, we generalize FNOs on the sphere, introducing Spherical FNOs (SFNOs) for learning operators on spherical geometries. We apply SFNOs to forecasting atmospheric dynamics, and demonstrate stable auto\-regressive rollouts for a year of simulated time (1,460 steps), while retaining physically plausible dynamics. The SFNO has important implications for machine learning-based simulation of climate dynamics that could eventually help accelerate our response to climate change.

Related papers

• DimOL: Dimensional Awareness as A New 'Dimension' in Operator Learning [63.5925701087252]
  We introduce DimOL (Dimension-aware Operator Learning), drawing insights from dimensional analysis. To implement DimOL, we propose the ProdLayer, which can be seamlessly integrated into FNO-based and Transformer-based PDE solvers. Empirically, DimOL models achieve up to 48% performance gain within the PDE datasets.
  arXiv  Detail & Related papers  (2024-10-08T10:48:50Z)
• On the importance of learning non-local dynamics for stable data-driven climate modeling: A 1D gravity wave-QBO testbed [0.0]
  Machine learning (ML) techniques have shown promise in learning subgrid-scale parameterizations for climate models. However, a major problem with data-driven parameterizations is model instability. Here, we combine ML theory and climate physics to address a source of instability in NN-based parameterization.
  arXiv  Detail & Related papers  (2024-07-07T01:15:52Z)
• Global-local Fourier Neural Operator for Accelerating Coronal Magnetic Field Model [17.256941005824576]
  We propose a global-local Fourier Neural Operator (GL-FNO) that contains two branches of FNO. The performance of the GLFNO is compared with state-of-the-art deep learning methods, including FNO, U-NO, U-FNO, Vision Transformer, CNN-RNN, and CNN-LSTM. The results demonstrate that GL-FNO not only accelerates the MHD simulation (a few seconds for prediction, more than times 20,000 speed up) but also provides reliable prediction capabilities, thus greatly contributing to the understanding of space weather dynamics.
  arXiv  Detail & Related papers  (2024-05-21T13:04:53Z)
• Equivariant Graph Neural Operator for Modeling 3D Dynamics [148.98826858078556]
  We propose Equivariant Graph Neural Operator (EGNO) to directly models dynamics as trajectories instead of just next-step prediction. EGNO explicitly learns the temporal evolution of 3D dynamics where we formulate the dynamics as a function over time and learn neural operators to approximate it. Comprehensive experiments in multiple domains, including particle simulations, human motion capture, and molecular dynamics, demonstrate the significantly superior performance of EGNO against existing methods.
  arXiv  Detail & Related papers  (2024-01-19T21:50:32Z)
• Geometry-Informed Neural Operator for Large-Scale 3D PDEs [76.06115572844882]
  We propose the geometry-informed neural operator (GINO) to learn the solution operator of large-scale partial differential equations. We successfully trained GINO to predict the pressure on car surfaces using only five hundred data points.
  arXiv  Detail & Related papers  (2023-09-01T16:59:21Z)
• Machine learning enabled experimental design and parameter estimation for ultrafast spin dynamics [54.172707311728885]
  We introduce a methodology that combines machine learning with Bayesian optimal experimental design (BOED) Our method employs a neural network model for large-scale spin dynamics simulations for precise distribution and utility calculations in BOED. Our numerical benchmarks demonstrate the superior performance of our method in guiding XPFS experiments, predicting model parameters, and yielding more informative measurements within limited experimental time.
  arXiv  Detail & Related papers  (2023-06-03T06:19:20Z)
• Domain Agnostic Fourier Neural Operators [15.29112632863168]
  We introduce domain agnostic Fourier neural operator (DAFNO) for learning surrogates with irregular geometries and evolving domains. The key idea is to incorporate a smoothed characteristic function in the integral layer architecture of FNOs. DAFNO has achieved state-of-the-art accuracy as compared to baseline neural operator models.
  arXiv  Detail & Related papers  (2023-04-30T13:29:06Z)
• Physics-Inspired Temporal Learning of Quadrotor Dynamics for Accurate Model Predictive Trajectory Tracking [76.27433308688592]
  Accurately modeling quadrotor's system dynamics is critical for guaranteeing agile, safe, and stable navigation. We present a novel Physics-Inspired Temporal Convolutional Network (PI-TCN) approach to learning quadrotor's system dynamics purely from robot experience. Our approach combines the expressive power of sparse temporal convolutions and dense feed-forward connections to make accurate system predictions.
  arXiv  Detail & Related papers  (2022-06-07T13:51:35Z)
• Airfoil's Aerodynamic Coefficients Prediction using Artificial Neural Network [0.0]
  Figuring out the right airfoil is a crucial step in the preliminary stage of any aerial vehicle design. This study compares different network architectures and training datasets in an attempt to gain insight as to how the network perceives the given airfoil geometries.
  arXiv  Detail & Related papers  (2021-09-24T19:07:19Z)
• Physics-Coupled Spatio-Temporal Active Learning for Dynamical Systems [15.923190628643681]
  One of the major challenges is to infer the underlying causes, which generate the perceived data stream. Success of machine learning based predictive models requires massive annotated data for model training. Our experiments on both synthetic and real-world datasets exhibit that the proposed ST-PCNN with active learning converges to optimal accuracy with substantially fewer instances.
  arXiv  Detail & Related papers  (2021-08-11T18:05:55Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.