PeSANet: Physics-encoded Spectral Attention Network for Simulating PDE-Governed Complex Systems

• URL: http://arxiv.org/abs/2505.01736v1
• Date: Sat, 03 May 2025 08:25:30 GMT
• Title: PeSANet: Physics-encoded Spectral Attention Network for Simulating PDE-Governed Complex Systems
• Abstract summary: We propose the Physics-encoded Spectral Attention Network (PeSANet) to forecast complex systems with limited data and incomplete physical priors.<n>The model consists of two key components: a physics-encoded block that uses hard constraints to approximate local differential operators from limited data, and a spectral-enhanced block that captures long-range global dependencies.
• Score: 17.821949355119997
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Accurately modeling and forecasting complex systems governed by partial differential equations (PDEs) is crucial in various scientific and engineering domains. However, traditional numerical methods struggle in real-world scenarios due to incomplete or unknown physical laws. Meanwhile, machine learning approaches often fail to generalize effectively when faced with scarce observational data and the challenge of capturing local and global features. To this end, we propose the Physics-encoded Spectral Attention Network (PeSANet), which integrates local and global information to forecast complex systems with limited data and incomplete physical priors. The model consists of two key components: a physics-encoded block that uses hard constraints to approximate local differential operators from limited data, and a spectral-enhanced block that captures long-range global dependencies in the frequency domain. Specifically, we introduce a novel spectral attention mechanism to model inter-spectrum relationships and learn long-range spatial features. Experimental results demonstrate that PeSANet outperforms existing methods across all metrics, particularly in long-term forecasting accuracy, providing a promising solution for simulating complex systems with limited data and incomplete physics.

Related papers

• PILIR: Physics-Informed Local Implicit Representation [10.009790673923789]
  We introduce the Physics-Informed Local Implicit Representation (PILIR)<n>Our approach separates the global physical domain into a discrete latent feature space and a continuous generative decoder.<n>A generative neural operator then synthesizes these local latent features into continuous physical fields, allowing accurate reconstruction of fine-scale structures.
  arXiv  Detail & Related papers  (2026-05-01T04:07:39Z)
• Divide-and-Conquer Approach to Holistic Cognition in High-Similarity Contexts with Limited Data [73.20753799870282]
  We propose a novel Divide-and-Conquer Holistic Cognition Network (DHCNet)<n>DHCNet implements a divide-and-conquer strategy by decomposing holistic cues into spatially-associated subtle discrepancies.<n>DHCNet achieves remarkable performance on five widely-used Ultra-FGVC datasets.
  arXiv  Detail & Related papers  (2026-04-21T11:17:09Z)
• PhyG-MoE: A Physics-Guided Mixture-of-Experts Framework for Energy-Efficient GNSS Interference Recognition [49.955269674859004]
  This paper introduces PhyG-MoE (Physics-Guided Mixture-of-Experts), a framework designed to align model capacity with signal complexity.<n>Unlike static architectures, the proposed system employs a spectrum-based gating mechanism that routes signals based on their spectral feature entanglement.<n>A high-capacity TransNeXt expert is activated on-demand to disentangle complex features in saturated scenarios, while lightweight experts handle fundamental signals to minimize latency.
  arXiv  Detail & Related papers  (2026-01-19T07:57:52Z)
• Pattern recognition in complex systems via vector-field representations of spatio-temporal data [0.13814679165245242]
  A complex system comprises multiple interacting entities whose interdependencies form a unified whole, exhibiting emergent behaviours not present in individual components.<n>These systems exhibit high-dimensional, nonlinear dynamics, making their modelling, classification, and prediction particularly challenging.<n>This paper introduces a framework for analysing geometric-temporal data from complex systems, grounded in the theory of vector fields over discrete measure spaces.
  arXiv  Detail & Related papers  (2025-12-18T16:59:21Z)
• Stable spectral neural operator for learning stiff PDE systems from limited data [12.62991453201434]
  We introduce an equation-free learning framework, namely, the Stable Spectral Neural Operator (SSNO)<n>SSNO embeds spectrally inspired structures in its architecture, yielding strong inductive biases for learning the underlying physics.<n>It achieves prediction errors one to two orders of magnitude lower than leading models.
  arXiv  Detail & Related papers  (2025-12-12T16:09:38Z)
• Multivariate Long-term Time Series Forecasting with Fourier Neural Filter [55.09326865401653]
  We introduce FNF as the backbone and DBD as architecture to provide excellent learning capabilities and optimal learning pathways for spatial-temporal modeling.<n>We show that FNF unifies local time-domain and global frequency-domain information processing within a single backbone that extends naturally to spatial modeling.
  arXiv  Detail & Related papers  (2025-06-10T18:40:20Z)
• World Model-Based Learning for Long-Term Age of Information Minimization in Vehicular Networks [53.98633183204453]
  In this paper, a novel world model-based learning framework is proposed to minimize packet-completeness-aware age of information (CAoI) in a vehicular network.<n>A world model framework is proposed to jointly learn a dynamic model of the mmWave V2X environment and use it to imagine trajectories for learning how to perform link scheduling.<n>In particular, the long-term policy is learned in differentiable imagined trajectories instead of environment interactions.
  arXiv  Detail & Related papers  (2025-05-03T06:23:18Z)
• Physics-Informed Latent Neural Operator for Real-time Predictions of Complex Physical Systems [0.0]
  We propose PI-Latent-NO, a physics-informed latent neural operator framework that integrates governing physics directly into the learning process.<n>Our architecture features two coupled DeepONets trained end-to-end: a Latent-DeepONet that learns a low-dimensional representation of the solution, and a Reconstruction-DeepONet that maps this latent representation back to the physical space.
  arXiv  Detail & Related papers  (2025-01-14T20:38:30Z)
• Conservation-informed Graph Learning for Spatiotemporal Dynamics Prediction [84.26340606752763]
  In this paper, we introduce the conservation-informed GNN (CiGNN), an end-to-end explainable learning framework.<n>The network is designed to conform to the general symmetry conservation law via symmetry where conservative and non-conservative information passes over a multiscale space by a latent temporal marching strategy.<n>Results demonstrate that CiGNN exhibits remarkable baseline accuracy and generalizability, and is readily applicable to learning for prediction of varioustemporal dynamics.
  arXiv  Detail & Related papers  (2024-12-30T13:55:59Z)
• Spatio-spectral graph neural operator for solving computational mechanics problems on irregular domain and unstructured grid [0.9208007322096533]
  We introduce Spatio-Spectral Graph Neural Operator (Sp$2$GNO) that integrates spatial and spectral GNNs effectively. This framework mitigates the limitations of individual methods and enables the learning of solution operators across arbitrary geometries.
  arXiv  Detail & Related papers  (2024-09-01T03:59:40Z)
• Enforcing the Principle of Locality for Physical Simulations with Neural Operators [0.0]
  Time-dependent partial differential equations (PDEs) are strictly local-dependent according to the principle of locality in physics.<n>Deep learning architecture cannot strictly enforce the local-dependency as it inevitably increases the scope of information to make local predictions.<n>This paper proposes a data decomposition method to strictly limit the scope of information for neural operators making local predictions.
  arXiv  Detail & Related papers  (2024-05-02T14:24:56Z)
• GATGPT: A Pre-trained Large Language Model with Graph Attention Network for Spatiotemporal Imputation [19.371155159744934]
  In real-world settings, such data often contain missing elements due to issues like sensor malfunctions and data transmission errors. The objective oftemporal imputation is to estimate these missing values by understanding the inherent spatial and temporal relationships in the observed time series. Traditionally, intricatetemporal imputation has relied on specific architectures, which suffer from limited applicability and high computational complexity. In contrast our approach integrates pre-trained large language models (LLMs) into intricatetemporal imputation, introducing a groundbreaking framework, GATGPT.
  arXiv  Detail & Related papers  (2023-11-24T08:15:11Z)
• Solving High-Dimensional PDEs with Latent Spectral Models [74.1011309005488]
  We present Latent Spectral Models (LSM) toward an efficient and precise solver for high-dimensional PDEs. Inspired by classical spectral methods in numerical analysis, we design a neural spectral block to solve PDEs in the latent space. LSM achieves consistent state-of-the-art and yields a relative gain of 11.5% averaged on seven benchmarks.
  arXiv  Detail & Related papers  (2023-01-30T04:58:40Z)
• Towards Multi-spatiotemporal-scale Generalized PDE Modeling [4.924631198058705]
  We make a comparison between various FNO and U-Net like approaches on fluid mechanics problems in both vorticity-stream and velocity function form. We show promising results on generalization to different PDE parameters and time-scales with a single surrogate model.
  arXiv  Detail & Related papers  (2022-09-30T17:40:05Z)
• Leveraging the structure of dynamical systems for data-driven modeling [111.45324708884813]
  We consider the impact of the training set and its structure on the quality of the long-term prediction. We show how an informed design of the training set, based on invariants of the system and the structure of the underlying attractor, significantly improves the resulting models.
  arXiv  Detail & Related papers  (2021-12-15T20:09:20Z)
• Learning to Simulate Complex Physics with Graph Networks [68.43901833812448]
  We present a machine learning framework and model implementation that can learn to simulate a wide variety of challenging physical domains. Our framework---which we term "Graph Network-based Simulators" (GNS)--represents the state of a physical system with particles, expressed as nodes in a graph, and computes dynamics via learned message-passing. Our results show that our model can generalize from single-timestep predictions with thousands of particles during training, to different initial conditions, thousands of timesteps, and at least an order of magnitude more particles at test time.
  arXiv  Detail & Related papers  (2020-02-21T16:44:28Z)
• Using Deep Learning to Explore Local Physical Similarity for Global-scale Bridging in Thermal-hydraulic Simulation [4.350727579753697]
  Current system thermal-hydraulic codes have limited credibility in simulating real plant conditions. This paper proposes a data-driven approach, Feature Similarity Measurement FFSM, to overcome these difficulties. Deep learning is applied to construct and explore the relationship between the local physical features and simulation errors.
  arXiv  Detail & Related papers  (2020-01-06T20:14:46Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.