Geometry-aware Latent Autoregressive Generative Model for PDEs in Complex Domains
- URL: http://arxiv.org/abs/2609.00297v1
- Date: Mon, 31 Aug 2026 19:42:37 GMT
- Title: Geometry-aware Latent Autoregressive Generative Model for PDEs in Complex Domains
- Abstract summary: We propose a Geometry-aware Latent Autoregressive generative Model for PDEs (GeoLAMP) for solving physics within highly irregular and tortuous structures.<n>In the latent space, we propose a causal self-attention transformer with flow matching to model temporal dynamics.<n>A flexible decoder reconstructs high-resolution physical fields on arbitrary points.
- Score: 8.632599397258039
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Solving multiphysics partial differential equations (PDEs) remains a major challenge in scientific computing, especially for highly complex $μ$m-scale tortuous geometries critical to energy and chemical engineering. We address this challenge by proposing a Geometry-aware Latent Autoregressive generative Model for PDEs (GeoLAMP) for solving physics within highly irregular and tortuous structures. GeoLAMP introduces a dual-encoder architecture on graph representations to jointly capture global topology and fine-scale geometric features, enabling an effective transition from real-space fields to compact latent representations. In the latent space, we propose a causal self-attention transformer with flow matching to model temporal dynamics, allowing stable and scalable block-wise autoregressive prediction. A flexible decoder reconstructs high-resolution physical fields on arbitrary points. We establish three multiphysics benchmark datasets in complex geometries, covering reactive flow, heat convection, and elasticity. GeoLAMP consistently achieves the most stable autoregression performance on these datasets, maintaining low errors throughout the entire rollout horizon. Our results provide a systematic study of geometry-aware learning for PDEs in $μ$m-scale complex geometries and offer new insights into block-wise time marching of latent autoregressive PDE modeling via a flow matching framework.
Related papers
- Latent PDE mapping for efficient physics-informed learning across geometries with limited data [0.0]
We introduce latent PDE mapping to enable efficient geometric generalization with sparse training data.<n>We demonstrate the utility of latent PDE mapping in solving the anisotropic Aliev-Panfilov PDE of cardiac electrophysiology.<n>Our results show that the computational cost of applying latent PDE mapping was modest during network training, and negligible at inference.
arXiv Detail & Related papers (2026-07-24T11:33:50Z) - Riemannian Langevin Dynamics: Strong Convergence of Geometric Euler-Maruyama Scheme [51.56484100374058]
Low-dimensional structure in real-world data plays an important role in the success of generative models.<n>We prove convergence theory of numerical schemes for manifold-valued differential equations.
arXiv Detail & Related papers (2026-03-04T01:29:35Z) - Learning Transient Convective Heat Transfer with Geometry Aware World Models [41.969427056765014]
This paper introduces a geometry aware world model architecture, derived from a video generation architecture (LongVideoGAN) to learn transient physics.<n>We evaluate this approach on a 2D transient computational fluid dynamics (CFD) problem involving convective heat transfer from buoyancy-driven flow coupled to a heat flow in a solid structure.
arXiv Detail & Related papers (2026-01-29T18:24:24Z) - PGOT: A Physics-Geometry Operator Transformer for Complex PDEs [15.319296758227857]
We propose the Physics-Geometry Operator Transformer (PGOT) to reconstruct physical feature learning through explicit geometry awareness.<n>PGOT achieves consistent state-of-the-art performance across four standard benchmarks and excels in large-scale industrial tasks including airfoil and car designs.
arXiv Detail & Related papers (2025-12-29T04:05:01Z) - Efficient Generative Transformer Operators For Million-Point PDEs [12.324265832276538]
ECHO is a transformer-operator framework for generating million-point PDE trajectories.<n>We demonstrate state-of-the-art performance on million-point simulations featuring complex, high-frequency dynamics, and long-term horizons.
arXiv Detail & Related papers (2025-12-04T16:46:48Z) - GeoFunFlow: Geometric Function Flow Matching for Inverse Operator Learning over Complex Geometries [7.205211713278516]
Inverse problems governed by partial differential equations (PDEs) are crucial in science and engineering.<n>We introduce em GeoFunFlow, a geometric diffusion model framework for inverse problems on complex geometries.
arXiv Detail & Related papers (2025-09-28T23:21:52Z) - Mechanistic PDE Networks for Discovery of Governing Equations [52.492158106791365]
We present Mechanistic PDE Networks, a model for discovery of partial differential equations from data.<n>The represented PDEs are then solved and decoded for specific tasks.<n>We develop a native, GPU-capable, parallel, sparse, and differentiable multigrid solver specialized for linear partial differential equations.
arXiv Detail & Related papers (2025-02-25T17:21:44Z) - Advancing Generalization in PINNs through Latent-Space Representations [71.86401914779019]
Physics-informed neural networks (PINNs) have made significant strides in modeling dynamical systems governed by partial differential equations (PDEs)<n>We propose PIDO, a novel physics-informed neural PDE solver designed to generalize effectively across diverse PDE configurations.<n>We validate PIDO on a range of benchmarks, including 1D combined equations and 2D Navier-Stokes equations.
arXiv Detail & Related papers (2024-11-28T13:16:20Z) - Geometric Trajectory Diffusion Models [58.853975433383326]
Generative models have shown great promise in generating 3D geometric systems.
Existing approaches only operate on static structures, neglecting the fact that physical systems are always dynamic in nature.
We propose geometric trajectory diffusion models (GeoTDM), the first diffusion model for modeling the temporal distribution of 3D geometric trajectories.
arXiv Detail & Related papers (2024-10-16T20:36:41Z) - Transolver: A Fast Transformer Solver for PDEs on General Geometries [66.82060415622871]
We present Transolver, which learns intrinsic physical states hidden behind discretized geometries.
By calculating attention to physics-aware tokens encoded from slices, Transovler can effectively capture intricate physical correlations.
Transolver achieves consistent state-of-the-art with 22% relative gain across six standard benchmarks and also excels in large-scale industrial simulations.
arXiv Detail & Related papers (2024-02-04T06:37:38Z) - Solving High-Dimensional PDEs with Latent Spectral Models [74.1011309005488]
We present Latent Spectral Models (LSM) toward an efficient and precise solver for high-dimensional PDEs.
Inspired by classical spectral methods in numerical analysis, we design a neural spectral block to solve PDEs in the latent space.
LSM achieves consistent state-of-the-art and yields a relative gain of 11.5% averaged on seven benchmarks.
arXiv Detail & Related papers (2023-01-30T04:58:40Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.