Target Parameterization in Diffusion Models for Nonlinear Spatiotemporal System Identification

• URL: http://arxiv.org/abs/2604.17566v1
• Date: Sun, 19 Apr 2026 18:11:14 GMT
• Title: Target Parameterization in Diffusion Models for Nonlinear Spatiotemporal System Identification
• Abstract summary: Diffusion-based models have recently shown improved robustness in turbulent-flow regimes.<n>We consider a self-contained patch-based transformer that operates directly on physical fields.<n>Results show that clean-state prediction consistently improves rollout stability and reduces long-horizon error.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Machine learning is becoming increasingly important for nonlinear system identification, including dynamical systems with spatially distributed outputs. However, classical identification and forecasting approaches become markedly less reliable in turbulent-flow regimes, where the dynamics are high-dimensional, strongly nonlinear, and highly sensitive to compounding rollout errors. Diffusion-based models have recently shown improved robustness in this setting and offer probabilistic inference capabilities, but many current implementations inherit target parameterizations from image generation, most commonly noise or velocity prediction. In this work, we revisit this design choice in the context of nonlinear spatiotemporal system identification. We consider a simple, self-contained patch-based transformer that operates directly on physical fields and use turbulent flow simulation as a representative testbed. Our results show that clean-state prediction consistently improves rollout stability and reduces long-horizon error relative to velocity- and noise-based objectives, with the advantage becoming more pronounced as the per-token dimensionality increases. These findings identify target parameterization as a key modeling choice in diffusion-based identification of nonlinear systems with spatial outputs in turbulent regimes.

Related papers

• A Hybrid PEM-GP Framework for Uncertainty-Aware System Identification of Quadcopters [0.0]
  We propose a framework that combines physics-based modeling with data-driven learning, while explicitly accounting for uncertainty.<n>The proposed framework is validated on a Duckiedrone-like experimental setup.
  arXiv  Detail & Related papers  (2026-08-31T08:26:03Z)
• Adaptive Diffusion Posterior Sampling for Data and Model Fusion of Complex Nonlinear Dynamical Systems [1.9800280967139285]
  High-fidelity numerical simulations of chaotic, high dimensional nonlinear dynamical systems are computationally expensive.<n>Most surrogate models for such systems are deterministic, for example when neural operators are involved.<n>This work presents a surrogate modeling formulation that leverages generative machine learning.
  arXiv  Detail & Related papers  (2026-03-13T04:11:37Z)
• KoopGen: Koopman Generator Networks for Representing and Predicting Dynamical Systems with Continuous Spectra [65.11254608352982]
  We introduce a generator-based neural Koopman framework that models dynamics through a structured, state-dependent representation of Koopman generators.<n>By exploiting the intrinsic Cartesian decomposition into skew-adjoint and self-adjoint components, KoopGen separates conservative transport from irreversible dissipation.
  arXiv  Detail & Related papers  (2026-02-15T06:32:23Z)
• Is Flow Matching Just Trajectory Replay for Sequential Data? [46.770624059457724]
  Flow matching (FM) is increasingly used for time-series generation.<n>It is not well understood whether it learns a general dynamical structure or simply performs an effective "trajectory replay"<n>We show that the implied sampler is an ODE whose dynamics constitutes a nonparametric, memory-augmented continuous-time dynamical system.
  arXiv  Detail & Related papers  (2026-02-09T06:48:45Z)
• Model-Based Diffusion Sampling for Predictive Control in Offline Decision Making [48.998030470623384]
  offline decision-making requires reliable behaviors from fixed datasets without further interaction.<n>We propose a compositional model-based diffusion framework consisting of: (i) a planner that generates diverse, task-aligned trajectories; (ii) a dynamics model that enforces consistency with the underlying system dynamics; and (iii) a ranker module that selects behaviors aligned with the task objectives.
  arXiv  Detail & Related papers  (2025-12-09T06:26:02Z)
• Predicting partially observable dynamical systems via diffusion models with a multiscale inference scheme [43.7203026580194]
  In this paper, we tackle the probabilistic prediction of partially observable, long-memory dynamical systems.<n>We show that standard inference schemes, such as autoregressive rollouts, fail to capture long-range dependencies in the data.<n>Our method generates trajectories that are temporally fine-grained near the present and coarser as we move farther away.
  arXiv  Detail & Related papers  (2025-11-24T18:30:04Z)
• Stable-by-Design Neural Network-Based LPV State-Space Models for System Identification [6.5745172279769255]
  We propose a neural network-based state-space model that simultaneously learns latent states and internal scheduling variables.<n>The state-transition matrix is guaranteed to be stable through a Schur-based parameterization.<n>The proposed NN-SS is evaluated on benchmark nonlinear systems, and the results demonstrate that the model consistently matches or surpasses classical subspace identification methods.
  arXiv  Detail & Related papers  (2025-10-21T10:25:54Z)
• ResAD: Normalized Residual Trajectory Modeling for End-to-End Autonomous Driving [64.42138266293202]
  ResAD is a Normalized Residual Trajectory Modeling framework.<n>It reframes the learning task to predict the residual deviation from an inertial reference.<n>On the NAVSIM benchmark, ResAD achieves a state-of-the-art PDMS of 88.6 using a vanilla diffusion policy.
  arXiv  Detail & Related papers  (2025-10-09T17:59:36Z)
• UP-dROM : Uncertainty-Aware and Parametrised dynamic Reduced-Order Model, application to unsteady flows [27.50487430169627]
  Reduced order models (ROMs) play a critical role in fluid mechanics by providing low-cost predictions.<n>For ROMs to be widely applicable, they must not only generalise well across different regimes, but also provide a measure of confidence in their predictions.<n>We present a nonlinear reduction strategy specifically designed for transient flows.
  arXiv  Detail & Related papers  (2025-03-29T22:17:36Z)
• TANGO: Time-Reversal Latent GraphODE for Multi-Agent Dynamical Systems [43.39754726042369]
  We propose a simple-yet-effective self-supervised regularization term as a soft constraint that aligns the forward and backward trajectories predicted by a continuous graph neural network-based ordinary differential equation (GraphODE) It effectively imposes time-reversal symmetry to enable more accurate model predictions across a wider range of dynamical systems under classical mechanics. Experimental results on a variety of physical systems demonstrate the effectiveness of our proposed method.
  arXiv  Detail & Related papers  (2023-10-10T08:52:16Z)
• Robust identification of non-autonomous dynamical systems using stochastic dynamics models [0.0]
  This paper considers the problem of system identification (ID) of linear and nonlinear non-autonomous systems from noisy and sparse data. We propose and analyze an objective function derived from a Bayesian formulation for learning a hidden Markov model. We show that our proposed approach has improved smoothness and inherent regularization that make it well-suited for system ID.
  arXiv  Detail & Related papers  (2022-12-20T16:36:23Z)
• Coarse-Grained Nonlinear System Identification [0.0]
  We introduce Coarse-Grained Dynamics, an efficient and universal parameterization of nonlinear system dynamics based on the Volterra series expansion. We demonstrate the properties of this approach on a simple synthetic problem. We also demonstrate this approach experimentally, showing that it identifies an accurate model of the nonlinear voltage to dynamics of a tungsten filament with less than a second of experimental data.
  arXiv  Detail & Related papers  (2020-10-14T06:45:51Z)
• Bayesian differential programming for robust systems identification under uncertainty [14.169588600819546]
  This paper presents a machine learning framework for Bayesian systems identification from noisy, sparse and irregular observations of nonlinear dynamical systems. The proposed method takes advantage of recent developments in differentiable programming to propagate gradient information through ordinary differential equation solvers. The use of sparsity-promoting priors enables the discovery of interpretable and parsimonious representations for the underlying latent dynamics.
  arXiv  Detail & Related papers  (2020-04-15T00:51:14Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.