Unlocking Temporal Generalization in Hamiltonian Video Dynamics Models

• URL: http://arxiv.org/abs/2607.07763v1
• Date: Wed, 08 Jul 2026 15:31:53 GMT
• Title: Unlocking Temporal Generalization in Hamiltonian Video Dynamics Models
• Abstract summary: Hamiltonian Generative Networks (HGN) offer a principled path forward.<n>We show that HGN rollouts at step sizes beyond the training regime fail due to distinct failure modes.<n>In a detailed analysis, we recommend several strategies for enabling temporal generalization in continuous-time video generation.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: World models are typically trained to predict discrete-time physical dynamics with a fixed step size baked into the model weights, preventing prediction at variable temporal resolutions. This matters for hierarchical planning, sim-to-real transfer, and scientific or game-engine applications that must query the same dynamics at multiple timescales. Hamiltonian Generative Networks (HGN) offer a principled path forward, grounding predictions in a continuous-time energy function that is, in principle, independent of the observation frame rate. In practice, however, their temporal generalization breaks down in non-conservative settings. We show that in externally forced, dissipative environments, HGN rollouts at step sizes beyond the training regime fail due to distinct failure modes, including latent magnitude growth driven by an unconstrained action-force map, and global truncation error accumulation from an under-resolved integrator. We identify a targeted fix for each mechanism and demonstrate stable dynamics prediction at temporal resolutions well outside the training distribution. In a detailed analysis, we recommend several strategies for enabling temporal generalization in continuous-time video generation.

Related papers

• PnP-Corrector: A Universal Correction Framework for Coupled Spatiotemporal Forecasting [62.22445401483844]
  Existing methods are severely constrained by the bottleneck of compounding errors.<n>We propose a universal framework called -Cast-Corrector (Plug-and-Play Corrector)<n>Our method significantly enhances the long-term stability of coupled forecasting systems.
  arXiv  Detail & Related papers  (2026-05-09T13:12:33Z)
• LaWM: Least Action World Models for Long-Horizon Physical Consistency from Visual Observations [9.35652906982887]
  We propose Least Action World Models (LaWM) to operationalize the Principle of Least Action in learned visual latent space.<n>LaWM encodes observations into learned generalized coordinates, learns a latent discrete Lagrangian over consecutive latent states.<n>Because the transition is induced by a discrete variational principle, LaWM provides a structure-preserving bias for long-horizon visual prediction.
  arXiv  Detail & Related papers  (2026-05-08T07:03:13Z)
• The Global Neural World Model: Spatially Grounded Discrete Topologies for Action-Conditioned Planning [0.9137554315375919]
  We present the Global Neural World Model (GNWM), a self-stabilizing framework that achieves topological quantization.<n> operating as a continuous, action-conditioned Joint-Embedding Predictive Architecture (JEPA)<n>Our results show this architecture prevents manifold drift during autoregressive rollouts by using grid snapping'' as a native error-correction mechanism.
  arXiv  Detail & Related papers  (2026-04-17T15:12:15Z)
• CtrlAttack: A Unified Attack on World-Model Control in Diffusion Models [92.04182855442254]
  We analyze the vulnerability of I2V models, find that temporal control mechanisms constitute a new attack surface, and reveal the challenge of modeling them uniformly.<n>We propose a trajectory-control attack, called CtrlAttack, to interfere with state evolution during the generation process.<n> Experimental results show that even under low-dimensional and strongly regularized perturbation constraints, our method can still significantly disrupt temporal consistency.
  arXiv  Detail & Related papers  (2026-03-13T08:05:50Z)
• A Deep Surrogate Model for Robust and Generalizable Long-Term Blast Wave Prediction [12.76666434787901]
  We propose RGD-Blast, a robust and generalizable deep surrogate model for high-fidelity, long-term blast wave forecasting.<n> RGD-Blast incorporates a multi-scale module to capture both global flow patterns and local boundary interactions, effectively mitigating error accumulation during autoregressive prediction.<n> Experiments demonstrate that RGD-Blast achieves a two-order-of-magnitude speedup while maintaining comparable accuracy.
  arXiv  Detail & Related papers  (2026-02-20T12:14:28Z)
• KoopGen: Koopman Generator Networks for Representing and Predicting Dynamical Systems with Continuous Spectra [65.11254608352982]
  We introduce a generator-based neural Koopman framework that models dynamics through a structured, state-dependent representation of Koopman generators.<n>By exploiting the intrinsic Cartesian decomposition into skew-adjoint and self-adjoint components, KoopGen separates conservative transport from irreversible dissipation.
  arXiv  Detail & Related papers  (2026-02-15T06:32:23Z)
• Constraint Breeds Generalization: Temporal Dynamics as an Inductive Bias [1.219017431258669]
  We show that constraints shape dynamics to function not as limitations, but as a temporal inductive bias that breeds generalization.<n>We show that robust AI development requires not only scaling and removing limitations, but computationally mastering the temporal characteristics that naturally promote generalization.
  arXiv  Detail & Related papers  (2025-12-30T00:34:24Z)
• RainDiff: End-to-end Precipitation Nowcasting Via Token-wise Attention Diffusion [64.49056527678606]
  We propose a Token-wise Attention integrated into not only the U-Net diffusion model but also the radar-temporal encoder.<n>Unlike prior approaches, our method integrates attention into the architecture without incurring the high resource cost typical of pixel-space diffusion.<n>Our experiments and evaluations demonstrate that the proposed method significantly outperforms state-of-the-art approaches, robustness local fidelity, generalization, and superior in complex precipitation forecasting scenarios.
  arXiv  Detail & Related papers  (2025-10-16T17:59:13Z)
• Forecasting Continuous Non-Conservative Dynamical Systems in SO(3) [51.510040541600176]
  We propose a novel approach to modeling the rotation of moving objects in computer vision.<n>Our approach is agnostic to energy and momentum conservation while being robust to input noise.<n>By learning to approximate object dynamics from noisy states during training, our model attains robust extrapolation capabilities in simulation and various real-world settings.
  arXiv  Detail & Related papers  (2025-08-11T09:03:10Z)
• Stochastically forced ensemble dynamic mode decomposition for forecasting and analysis of near-periodic systems [65.44033635330604]
  We introduce a novel load forecasting method in which observed dynamics are modeled as a forced linear system. We show that its use of intrinsic linear dynamics offers a number of desirable properties in terms of interpretability and parsimony. Results are presented for a test case using load data from an electrical grid.
  arXiv  Detail & Related papers  (2020-10-08T20:25:52Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.