A Graph Neural Network approach to zero-shot Digital Twins

• URL: http://arxiv.org/abs/2607.20535v1
• Date: Fri, 10 Jul 2026 16:04:58 GMT
• Title: A Graph Neural Network approach to zero-shot Digital Twins
• Abstract summary: We present a novel framework for textitZero-Shot Digital Twins that seamlessly couples real-time visual perception with a geometry-agnostic, physics-informed reasoning engine.
• Score: 2.86989372262348
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Traditional Predictive Digital Twins often remain geometrically rigid, requiring extensive retraining or fine-tuning whenever the underlying physical domain or boundary conditions change. To overcome this limitation, we present a novel framework for \textit{Zero-Shot Digital Twins} that seamlessly couples real-time visual perception with a geometry-agnostic, physics-informed reasoning engine. At the core of our architecture is the Thermodynamics-Informed Graph Neural Network architecture, a Geometric Deep Learning solver grounded in a metriplectic thermodynamic formalism that enforces energy conservation and non-negative entropy production locally through graph message passing. The framework integrates an auxiliary Graph Neural Network to infer unobservable fields (such as stress tensors or velocity and energy distributions) directly from sparse initial visual boundaries, mitigating numerical start-up transients. To bridge the sim-to-real gap, we implement a continuous closed-loop data assimilation mechanism; the pipeline tracks macroscopic deformations and free-surface fluid boundaries in real-time using deep segmentation networks combined with sparse optical flow, dynamically correcting the autoregressive simulation rollout and eliminating numerical drift. To test the validity of our approach, we demonstrate the extreme generalization capabilities of our approach across two disparate physical regimes: the large deformations of a viscoelastic beam and the non-linear sloshing of a viscous fluid. In both scenarios, the unified framework instantiates physically accurate simulations on novel, unseen geometries without case-specific retraining, operating well within real-time latency budgets (approximately 25 ms per frame) and enabling the direct projection of latent mechanical variables via Augmented Reality.

Related papers

• Fluid-DiT: Graph-Free Diffusion Transformers for Fluid Flow Simulations Learning [50.053186229257555]
  We propose a Graph-Free Diffusion Transformer that replaces graph message passing with attention-based denoising.<n>By leveraging the transformer's global receptive field, Fluid-DiT naturally captures both local flow structures and long-range correlations.<n>It consistently outperforms graph-based diffusion baselines in both sample quality and distributional accuracy.
  arXiv  Detail & Related papers  (2026-08-07T12:28:45Z)
• Emulating Cosmic Structure Formation with a Lagrangian Neural Cellular Automaton [0.0]
  We introduce a hybrid deep learning framework that can be applied to structure formation as a local, iterative dynamical process on a comoving lattice.<n>By training the network to learn only the textitresidual displacement corrections to the Zeldovich approximation, we achieve high-fidelity emulation of the non-linear physics.<n>Our trained model supports percent-level precision in the power and cross spectra well into the non-linear regime.
  arXiv  Detail & Related papers  (2026-07-29T18:00:01Z)
• Physics-Guided Dual-Stream Heterogeneous Graph Neural Network for Predicting Full-Field Structural Response of Stiffened Panels [0.0]
  Iterative design and optimization of large, complex structures require fast and accurate prediction of stress, displacement, and other fields.<n>Existing neural network surrogates often struggle with varying topologies and complex boundary conditions.<n>This study proposes the novel DualStream Heterogeneous Graph Neural Network (DS-HGNN) for full-field stress and displacement prediction in thin-walled structures.
  arXiv  Detail & Related papers  (2026-06-18T20:12:18Z)
• Eulerian Motion Guidance: Robust Image Animation via Bidirectional Geometric Consistency [74.90075313101933]
  This paper revisits the same optical-flow primitive through a more local supervision design.<n>We use adjacent-frame Eulerian motion fields to guide generation, where the motion signal always describes a short temporal hop.<n>To mitigate the drift artifacts common in adjacent frame generation, we introduce a Bidirectional Geometric Consistency mechanism.
  arXiv  Detail & Related papers  (2026-05-07T13:53:31Z)
• Mesh Based Simulations with Spatial and Temporal awareness [2.867517731896504]
  We propose a unified framework to bridge the gap between geometric deep learning and rigorous numerical analysis.<n>We introduce three key innovations: (1) Multi Node Prediction, a stencil-level objective that predicts field values for a node's full local topology, enforcing spatial derivative consistency; (2) Temporal Correction, replacing unstable explicit schemes with a predictor-corrector via temporal Cross-Attention; and (3) Geometric Inductive Biases, leveraging 3D Rotary Positional Embeddings (RoPE) to robustly capture rotational symmetries in unstructured meshes.
  arXiv  Detail & Related papers  (2026-05-02T17:09:31Z)
• Momentum-Conserving Graph Neural Networks for Deformable Objects [64.91655405516482]
  We propose MomentumGNN -- a novel architecture designed to accurately track momentum by construction.<n>Unlike existing GNNs that output unconstrained nodal accelerations, our model predicts per-edge stretching and bending impulses.<n>We show that our method outperforms baselines in a number of common scenarios where momentum plays a pivotal role.
  arXiv  Detail & Related papers  (2026-04-28T20:19:33Z)
• AeTHERON: Autoregressive Topology-aware Heterogeneous Graph Operator Network for Fluid-Structure Interaction [0.0]
  AeTHERON learns nonlinear fluid-structure coupling in a shared high-dimensional latent space.<n>AeTHERON captures large-scale vortex topology and wake structure with qualitative fidelity.<n>Inference requires milliseconds per timestep on a single GPU versus hours for equivalent DNS computation.
  arXiv  Detail & Related papers  (2026-04-15T00:31:20Z)
• Alternating Gradient Flow Utility: A Unified Metric for Structural Pruning and Dynamic Routing in Deep Networks [52.153950303594684]
  We propose a decoupled kinetic paradigm inspired by Alternating Gradient Flow (AGF)<n>AGF accurately captures the network's structural "kinetic utility"<n>We design a hybrid routing framework that decouples AGF-guided offline structural search from online execution via zero-cost physical priors.
  arXiv  Detail & Related papers  (2026-03-12T18:19:21Z)
• Diffusion-Based Hierarchical Graph Neural Networks for Simulating Nonlinear Solid Mechanics [20.95722391593829]
  Rolling Diffusion-Batched Inference Network (ROBIN) is a novel learned simulator that integrates two key innovations.<n>ROBIN captures both fine-scale local dynamics and global structural effects critical for phenomena like beam bending or multi-body contact.<n>We validate ROBIN on challenging 2D and 3D solid mechanics benchmarks involving geometric, material, and contact nonlinearities.
  arXiv  Detail & Related papers  (2025-06-06T12:46:36Z)
• Curve Your Attention: Mixed-Curvature Transformers for Graph Representation Learning [77.1421343649344]
  We propose a generalization of Transformers towards operating entirely on the product of constant curvature spaces. We also provide a kernelized approach to non-Euclidean attention, which enables our model to run in time and memory cost linear to the number of nodes and edges.
  arXiv  Detail & Related papers  (2023-09-08T02:44:37Z)
• NeuralClothSim: Neural Deformation Fields Meet the Thin Shell Theory [70.10550467873499]
  We propose NeuralClothSim, a new quasistatic cloth simulator using thin shells. Our memory-efficient solver operates on a new continuous coordinate-based surface representation called neural deformation fields.
  arXiv  Detail & Related papers  (2023-08-24T17:59:54Z)
• Physics Informed Neural Fields for Smoke Reconstruction with Sparse Data [73.8970871148949]
  High-fidelity reconstruction of fluids from sparse multiview RGB videos remains a formidable challenge. Existing solutions either assume knowledge of obstacles and lighting, or only focus on simple fluid scenes without obstacles or complex lighting. We present the first method to reconstruct dynamic fluid by leveraging the governing physics (ie, Navier -Stokes equations) in an end-to-end optimization.
  arXiv  Detail & Related papers  (2022-06-14T03:38:08Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.