Surrogate Modeling of 3D Rayleigh-Benard Convection with Equivariant Autoencoders

• URL: http://arxiv.org/abs/2505.13569v1
• Date: Mon, 19 May 2025 12:26:54 GMT
• Title: Surrogate Modeling of 3D Rayleigh-Benard Convection with Equivariant Autoencoders
• Authors: Fynn Fromme, Christine Allen-Blanchette, Hans Harder, Sebastian Peitz,
• Abstract summary: We present an end-to-end equivariant surrogate model consisting of an equivariant convolutional autoencoder and an equivariant convolutional LSTM.<n>As a case study, we consider the three-dimensional Rayleigh-B'enard convection, which describes the buoyancy-driven fluid flow between a heated bottom and a cooled top plate.<n>Our results demonstrate significant gains both in sample and parameter efficiency, as well as a better scaling to more complex dynamics, that is, larger numbers.
• Score: 2.3936613583728064
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The use of machine learning for modeling, understanding, and controlling large-scale physics systems is quickly gaining in popularity, with examples ranging from electromagnetism over nuclear fusion reactors and magneto-hydrodynamics to fluid mechanics and climate modeling. These systems -- governed by partial differential equations -- present unique challenges regarding the large number of degrees of freedom and the complex dynamics over many scales both in space and time, and additional measures to improve accuracy and sample efficiency are highly desirable. We present an end-to-end equivariant surrogate model consisting of an equivariant convolutional autoencoder and an equivariant convolutional LSTM using $G$-steerable kernels. As a case study, we consider the three-dimensional Rayleigh-B\'enard convection, which describes the buoyancy-driven fluid flow between a heated bottom and a cooled top plate. While the system is E(2)-equivariant in the horizontal plane, the boundary conditions break the translational equivariance in the vertical direction. Our architecture leverages vertically stacked layers of $D_4$-steerable kernels, with additional partial kernel sharing in the vertical direction for further efficiency improvement. Our results demonstrate significant gains both in sample and parameter efficiency, as well as a better scaling to more complex dynamics, that is, larger Rayleigh numbers. The accompanying code is available under https://github.com/FynnFromme/equivariant-rb-forecasting.

Related papers

• Geometric Operator Learning with Optimal Transport [77.16909146519227]
  We propose integrating optimal transport (OT) into operator learning for partial differential equations (PDEs) on complex geometries.<n>For 3D simulations focused on surfaces, our OT-based neural operator embeds the surface geometry into a 2D parameterized latent space.<n> Experiments with Reynolds-averaged Navier-Stokes equations (RANS) on the ShapeNet-Car and DrivAerNet-Car datasets show that our method achieves better accuracy and also reduces computational expenses.
  arXiv  Detail & Related papers  (2025-07-26T21:28:25Z)
• Equivariant Volumetric Grasping [2.9144754050161503]
  We propose a new volumetric grasp model that is equivariant to rotations around the vertical axis.<n>Our results demonstrate that the proposed projection-based design significantly reduces both computational and memory costs.
  arXiv  Detail & Related papers  (2025-07-24T23:18:32Z)
• Self-Supervised Coarsening of Unstructured Grid with Automatic Differentiation [55.88862563823878]
  In this work, we present an original algorithm to coarsen an unstructured grid based on the concepts of differentiable physics.<n>We demonstrate performance of the algorithm on two PDEs: a linear equation which governs slightly compressible fluid flow in porous media and the wave equation.<n>Our results show that in the considered scenarios, we reduced the number of grid points up to 10 times while preserving the modeled variable dynamics in the points of interest.
  arXiv  Detail & Related papers  (2025-07-24T11:02:13Z)
• Large Language-Geometry Model: When LLM meets Equivariance [53.8505081745406]
  We propose EquiLLM, a novel framework for representing 3D physical systems.<n>We show that EquiLLM delivers significant improvements over previous methods across molecular dynamics simulation, human motion simulation, and antibody design.
  arXiv  Detail & Related papers  (2025-02-16T14:50:49Z)
• Equivariant Graph Neural Operator for Modeling 3D Dynamics [148.98826858078556]
  We propose Equivariant Graph Neural Operator (EGNO) to directly models dynamics as trajectories instead of just next-step prediction. EGNO explicitly learns the temporal evolution of 3D dynamics where we formulate the dynamics as a function over time and learn neural operators to approximate it. Comprehensive experiments in multiple domains, including particle simulations, human motion capture, and molecular dynamics, demonstrate the significantly superior performance of EGNO against existing methods.
  arXiv  Detail & Related papers  (2024-01-19T21:50:32Z)
• Stochastic Latent Transformer: Efficient Modelling of Stochastically Forced Zonal Jets [0.0]
  We present a novel deep probabilistic learning approach, the 'Stochastic Latent Transformer' (SLT) The SLT accurately reproduces system dynamics across various integration periods, validated through quantitative diagnostics. It achieves a five-order-of-magnitude speedup in emulating the zonally-averaged flow.
  arXiv  Detail & Related papers  (2023-10-25T16:17:00Z)
• 2-D SSM: A General Spatial Layer for Visual Transformers [79.4957965474334]
  A central objective in computer vision is to design models with appropriate 2-D inductive bias. We leverage an expressive variation of the multidimensional State Space Model. Our approach introduces efficient parameterization, accelerated computation, and a suitable normalization scheme.
  arXiv  Detail & Related papers  (2023-06-11T09:41:37Z)
• Learning Lagrangian Fluid Mechanics with E($3$)-Equivariant Graph Neural Networks [2.1401663582288144]
  equivariant graph neural networks have the potential to learn more accurate dynamic-interaction models. We benchmark two well-studied fluid-flow systems, namely 3D decaying Taylor-Green vortex and 3D reverse Poiseuille flow. We find that while currently being rather slow to train and evaluate, equivariant models with our proposed history embeddings learn more accurate physical interactions.
  arXiv  Detail & Related papers  (2023-05-24T22:26:38Z)
• Equivariant geometric convolutions for emulation of dynamical systems [6.3003220645859175]
  We use geometric convolutions to enforce coordinate freedom in surrogate machine learning models. In numerical experiments emulating 2D compressible Navier-Stokes, we see better accuracy and improved stability. The ease of enforcing coordinate freedom without making major changes to the model architecture provides an exciting recipe for any CNN-based method applied to an appropriate class of problems.
  arXiv  Detail & Related papers  (2023-05-21T22:44:18Z)
• E($3$) Equivariant Graph Neural Networks for Particle-Based Fluid Mechanics [2.1401663582288144]
  We demonstrate that equivariant graph neural networks have the potential to learn more accurate dynamic-interaction models. We benchmark two well-studied fluid flow systems, namely the 3D decaying Taylor-Green vortex and the 3D reverse Poiseuille flow.
  arXiv  Detail & Related papers  (2023-03-31T21:56:35Z)
• Data-driven Control of Agent-based Models: an Equation/Variable-free Machine Learning Approach [0.0]
  We present an Equation/Variable free machine learning (EVFML) framework for the control of the collective dynamics of complex/multiscale systems. The proposed implementation consists of three steps: (A) from high-dimensional agent-based simulations, machine learning (in particular, non-linear manifold learning (DMs)) We exploit the Equation-free approach to perform numerical bifurcation analysis of the emergent dynamics. We design data-driven embedded wash-out controllers that drive the agent-based simulators to their intrinsic, imprecisely known, emergent open-loop unstable steady-states.
  arXiv  Detail & Related papers  (2022-07-12T18:16:22Z)
• Equivariant vector field network for many-body system modeling [65.22203086172019]
  Equivariant Vector Field Network (EVFN) is built on a novel equivariant basis and the associated scalarization and vectorization layers. We evaluate our method on predicting trajectories of simulated Newton mechanics systems with both full and partially observed data.
  arXiv  Detail & Related papers  (2021-10-26T14:26:25Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.