Mesh Based Simulations with Spatial and Temporal awareness
- URL: http://arxiv.org/abs/2605.01542v1
- Date: Sat, 02 May 2026 17:09:31 GMT
- Title: Mesh Based Simulations with Spatial and Temporal awareness
- Abstract summary: We propose a unified framework to bridge the gap between geometric deep learning and rigorous numerical analysis.<n>We introduce three key innovations: (1) Multi Node Prediction, a stencil-level objective that predicts field values for a node's full local topology, enforcing spatial derivative consistency; (2) Temporal Correction, replacing unstable explicit schemes with a predictor-corrector via temporal Cross-Attention; and (3) Geometric Inductive Biases, leveraging 3D Rotary Positional Embeddings (RoPE) to robustly capture rotational symmetries in unstructured meshes.
- Score: 2.867517731896504
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Machine Learning surrogates for Computational Fluid Dynamics (CFD), particularly Graph Neural Networks (GNNs) and Transformers, have become a new important approach for accelerating physics simulations. However, we identify a critical bottleneck in the field: while architectures have advanced significantly, the common underlying training paradigms remain bound to naive assumptions, such as node-wise supervision and explicit Euler time-stepping. These legacy choices ignore the stiff dynamics and local flux continuity inherent to numerous partial differential equations resolution methods, such as Finite Element, Difference, or Volume (FEM). In this work, we propose a unified framework to bridge the gap between geometric deep learning and rigorous numerical analysis. We introduce three key innovations: (1) Multi Node Prediction, a stencil-level objective that predicts field values for a node's full local topology, enforcing spatial derivative consistency; (2) Temporal Correction, replacing unstable explicit schemes with a predictor-corrector via temporal Cross-Attention; and (3) Geometric Inductive Biases, leveraging 3D Rotary Positional Embeddings (RoPE) to robustly capture rotational symmetries in unstructured meshes. We evaluate this framework across three architectures (MeshGraphNet, Transolver, and a Transformer) on diverse physics datasets. Our approach yields consistent improvements in accuracy and stability, particularly in long-horizon rollouts, while producing latent representations that generalize to unseen subtasks such as Wall Shear Stress or Pressure prediction. Code is available at https://github.com/DonsetPG/graph-physics.
Related papers
- ONE CYLinder: A Benchmark for Graph-Based Surrogate Modeling of Unsteady Bluff-Body Flows [0.769672852567215]
Graph-based surrogate models offer a promising route to accelerate computational fluid dynamics (CFD) simulations on unstructured meshes.<n>We introduce ONECYL, a new benchmark for unsteady flow past a circular cylinder across laminarational, transitional, and high-Reynolds-number regimes.<n>The benchmark comprises 450 high-fidelity Vari Multiscale finite-element simulations with randomized cylinder geometries.
arXiv Detail & Related papers (2026-09-08T16:06:08Z) - Physics-Informed Coarsening for Multigrid Graph Neural Surrogates [0.769672852567215]
We introduce a graph neural network for solid mechanics that couples an encoder-processor-decoder backbone with a physics-informed coarsening strategy.<n>Our results highlight the importance of physics-informed coarsening for scalable surrogate modeling in solid mechanics.
arXiv Detail & Related papers (2026-05-29T08:47:04Z) - FEM-Informed Hypergraph Neural Networks for Efficient Elastoplasticity [3.211924713637672]
Graph neural networks (GNNs) naturally align with sparse operators and unstructured discretizations.<n>Motivated by discrete physics losses, we embed finite-element computations at nodes and Gauss points directly into message-passing layers.<n>We propose a numerically consistent FEM-Informed Hypergraph Neural Networks (FHGNN)
arXiv Detail & Related papers (2026-02-07T05:11:12Z) - Adaptive Mesh-Quantization for Neural PDE Solvers [51.26961483962011]
Graph Neural Networks can handle the irregular meshes required for complex geometries and boundary conditions, but still apply uniform computational effort across all nodes.<n>We propose Adaptive Mesh Quantization: spatially adaptive quantization across mesh node, edge, and cluster features, dynamically adjusting the bit-width used by a quantized model.<n>We demonstrate our framework's effectiveness by integrating it with two state-of-the-art models, MP-PDE and GraphViT, to evaluate performance across multiple tasks.
arXiv Detail & Related papers (2025-11-23T14:47:24Z) - Topology-Aware Modeling for Unsupervised Simulation-to-Reality Point Cloud Recognition [63.55828203989405]
We introduce a novel Topology-Aware Modeling (TAM) framework for Sim2Real UDA on object point clouds.<n>Our approach mitigates the domain gap by leveraging global spatial topology, characterized by low-level, high-frequency 3D structures.<n>We propose an advanced self-training strategy that combines cross-domain contrastive learning with self-training.
arXiv Detail & Related papers (2025-06-26T11:53:59Z) - Multivariate Long-term Time Series Forecasting with Fourier Neural Filter [42.60778405812048]
We introduce FNF as the backbone and DBD as architecture to provide excellent learning capabilities and optimal learning pathways for spatial-temporal modeling.<n>We show that FNF unifies local time-domain and global frequency-domain information processing within a single backbone that extends naturally to spatial modeling.
arXiv Detail & Related papers (2025-06-10T18:40:20Z) - Diffusion-Based Hierarchical Graph Neural Networks for Simulating Nonlinear Solid Mechanics [20.95722391593829]
Rolling Diffusion-Batched Inference Network (ROBIN) is a novel learned simulator that integrates two key innovations.<n>ROBIN captures both fine-scale local dynamics and global structural effects critical for phenomena like beam bending or multi-body contact.<n>We validate ROBIN on challenging 2D and 3D solid mechanics benchmarks involving geometric, material, and contact nonlinearities.
arXiv Detail & Related papers (2025-06-06T12:46:36Z) - 3D Equivariant Pose Regression via Direct Wigner-D Harmonics Prediction [50.07071392673984]
Existing methods learn 3D rotations parametrized in the spatial domain using angles or quaternions.
We propose a frequency-domain approach that directly predicts Wigner-D coefficients for 3D rotation regression.
Our method achieves state-of-the-art results on benchmarks such as ModelNet10-SO(3) and PASCAL3D+.
arXiv Detail & Related papers (2024-11-01T12:50:38Z) - Implicit Neural Representation For Accurate CFD Flow Field Prediction [0.0]
We present a deep learning framework for 3D flow field prediction applied to blades of aircraft engine turbines and compressors.
We view any 3D field as a function from coordinates modeled by a neural network we call the backbone-net.
It can accurately render important flow characteristics such as boundary layers, wakes and shock waves.
arXiv Detail & Related papers (2024-08-12T20:41:07Z) - Enhancing lattice kinetic schemes for fluid dynamics with Lattice-Equivariant Neural Networks [79.16635054977068]
We present a new class of equivariant neural networks, dubbed Lattice-Equivariant Neural Networks (LENNs)
Our approach develops within a recently introduced framework aimed at learning neural network-based surrogate models Lattice Boltzmann collision operators.
Our work opens towards practical utilization of machine learning-augmented Lattice Boltzmann CFD in real-world simulations.
arXiv Detail & Related papers (2024-05-22T17:23:15Z) - Multivariate Time Series Forecasting with Dynamic Graph Neural ODEs [65.18780403244178]
We propose a continuous model to forecast Multivariate Time series with dynamic Graph neural Ordinary Differential Equations (MTGODE)
Specifically, we first abstract multivariate time series into dynamic graphs with time-evolving node features and unknown graph structures.
Then, we design and solve a neural ODE to complement missing graph topologies and unify both spatial and temporal message passing.
arXiv Detail & Related papers (2022-02-17T02:17:31Z) - A Point-Cloud Deep Learning Framework for Prediction of Fluid Flow
Fields on Irregular Geometries [62.28265459308354]
Network learns end-to-end mapping between spatial positions and CFD quantities.
Incompress laminar steady flow past a cylinder with various shapes for its cross section is considered.
Network predicts the flow fields hundreds of times faster than our conventional CFD.
arXiv Detail & Related papers (2020-10-15T12:15:02Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.