PH-Dreamer: A Physics-Driven World Model via Port-Hamiltonian Generative Dynamics

• URL: http://arxiv.org/abs/2605.18303v1
• Date: Mon, 18 May 2026 12:20:54 GMT
• Title: PH-Dreamer: A Physics-Driven World Model via Port-Hamiltonian Generative Dynamics
• Abstract summary: World models built on recurrent state space architectures produce dynamics that violate conservation and dissipative principles.<n>We introduce a unified Port-Hamiltonian framework that remedies this through three synergistic mechanisms.<n>Across visual control benchmarks, this paradigm not only attains superior returns but also elevates internal fidelity by establishing a tighter, lower variance alignment between imagined and real rewards, all while reducing latent phase space volume by 4.18-8.41%, energy consumption by up to 7.80%, and mean squared jerk by up to 9.38%.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: World models built on recurrent state space architectures enable efficient latent imagination, yet remain physically unstructured, producing dynamics that violate conservation and dissipative principles. We introduce a unified Port-Hamiltonian framework that remedies this through three synergistic mechanisms. First, we embed implicit physical priors into recurrent transitions by modeling projected latent evolution as action controlled energy routing governed by flow and dissipation, biasing the projected PH phase space toward a more compact and physically structured representation. Second, we develop a kinematics aware energy world model that estimates the Hamiltonian and power balance from proprioceptive observations, providing an explicit physical signal for thermodynamic reasoning. Third, leveraging these energy gradients, we establish an energy guided Actor-Critic that uses Lagrangian multipliers to regularize policy optimization toward lower energy and smoother control. Across visual control benchmarks, this paradigm not only attains superior asymptotic returns but also elevates internal simulator fidelity by establishing a tighter, lower variance alignment between imagined and real rewards, all while reducing latent phase space volume by 4.18-8.41%, energy consumption by up to 7.80%, and mean squared jerk by up to 9.38%.

Related papers

• Semigroup-JEPA: Latent Dynamics Consistency for Zero-Shot Physics Generalization [32.65135632960651]
  Joint-Embedding Predictive Architecture (JEPA) world models learn a compact latent representation of the world that supports prediction and planning.<n>We introduce SemiGroup-JEPA, which extends the LeWorldModel framework by supplying the parameter governing the physics to the temporal model.<n>We design dynamical tasks under different gravitational fields that, despite obeying the same physical law, exhibit qualitatively different dynamics.
  arXiv  Detail & Related papers  (2026-09-09T17:08:13Z)
• Energy-Structured Latent World Models with Neural Time Fields for Physically Constistent Open-World Motion Planning [25.402498594599013]
  We propose a novel Energy-Structured Latent World Model (ELWM)<n>Our key idea is to structure the ELWM latent state to explicitly carry energy and momentum, ensuring strictly causal transitions.<n>We further implement this for motion planning by constructing Physics-Conditioned Neural Time Fields (PC-NTF)<n>Compared to generic latent models, PC-NTF reduces 0.8-s motion-prediction NRMSE from 0.36 to 0.29.
  arXiv  Detail & Related papers  (2026-08-10T17:31:18Z)
• MeGAS: Thermomechanical Dynamic Gaussian Splatting for Thermophysical Scene Editing [53.96914021628847]
  We propose MeGAS, a framework that incorporates thermomechanical phase-change dynamics into 3D Gaussian Splatting (3DGS)<n>MeGAS produces physically consistent thermomechanical behavior while maintaining high-fidelity photorealistic rendering, advancing toward physics-integrated world models.
  arXiv  Detail & Related papers  (2026-06-22T15:05:59Z)
• Free energy Estimation on Any State Space [49.560935787029564]
  Recent work learns neural transports to significantly accelerate the efficiency in the finite-time regime.<n>In this paper, we generalize this framework to arbitrary state spaces.<n> Experiments validate the effectiveness and efficiency of the proposed method.
  arXiv  Detail & Related papers  (2026-05-29T09:34:53Z)
• LaWM: Least Action World Models for Long-Horizon Physical Consistency from Visual Observations [9.35652906982887]
  We propose Least Action World Models (LaWM) to operationalize the Principle of Least Action in learned visual latent space.<n>LaWM encodes observations into learned generalized coordinates, learns a latent discrete Lagrangian over consecutive latent states.<n>Because the transition is induced by a discrete variational principle, LaWM provides a structure-preserving bias for long-horizon visual prediction.
  arXiv  Detail & Related papers  (2026-05-08T07:03:13Z)
• HaM-World: Soft-Hamiltonian World Models with Selective Memory for Planning [2.28917458387011]
  HaM-World is a structured world model that decomposes the latent state into a canonical (q, p) subspace and a context subspace c.<n>On four DeepMind Control Suite tasks, HaM-World reaches the highest Avg. AUC (117.9, +9.5%), reduces long-horizon rollout error to 45% of a strong baseline model, and wins 11/12 k in 3,5,7 MSE cells.
  arXiv  Detail & Related papers  (2026-05-07T09:58:18Z)
• Detecting Deepfakes via Hamiltonian Dynamics [58.881686693914446]
  We propose a new perspective on deepfake detection: moving from static pattern recognition to dynamical stability analysis.<n>Our approach is motivated by physics-inspired priors.<n>Hamiltonian Action Anomaly Detection (HAAD) outperforms evaluated state-of-the-art baselines.
  arXiv  Detail & Related papers  (2026-05-06T01:55:38Z)
• PhyCo: Learning Controllable Physical Priors for Generative Motion [55.59209981836171]
  We present PhyCo, a framework that introduces continuous, interpretable, and physically grounded control into video generation.<n>Our approach integrates three key components: (i) a large-scale dataset of over 100K photorealistic simulation videos where friction, restitution, deformation, and force are systematically varied across diverse scenarios; (ii) physics-supervised fine-tuning of a pretrained diffusion model using a ControlNet conditioned on pixel-aligned physical property maps; and (iii) VLM-guided reward optimization, where a fine-tuned vision-language model evaluates generated videos with targeted physics queries and provides differentiable feedback.
  arXiv  Detail & Related papers  (2026-04-30T17:53:03Z)
• Resonance4D: Frequency-Domain Motion Supervision for Preset-Free Physical Parameter Learning in 4D Dynamic Physical Scene Simulation [53.141181758015186]
  We present Resonance4D, a physics-driven 4D dynamic simulation framework that couples 3D Gaussian Splatting with the Material Point Method.<n>Our key insight is that dynamic consistency can be enforced without dense temporal generation by jointly constraining motion in complementary domains.<n>We show that Resonance4D achieves strong physical fidelity and motion consistency while reducing peak GPU memory from over 35,GB to around 20,GB.
  arXiv  Detail & Related papers  (2026-04-02T13:00:22Z)
• When Should a Model Change Its Mind? An Energy-Based Theory and Regularizer for Concept Drift in Electrocardiogram (ECG) Signals [0.9239657838690226]
  Existing concept-drift frameworks are largely distributional and provide no principled guidance on how much a model's internal representation may move.<n>This study introduces Physiologic Energy Conservation Theory (PECT), an energy-based framework for concept stability in dynamic signals.<n>PECT posits that under virtual drift, normalized latent displacement should scale proportionally with normalized signal energy change, while persistent violations of this proportionality indicate real concept drift.
  arXiv  Detail & Related papers  (2026-02-25T15:23:15Z)
• PhysRVG: Physics-Aware Unified Reinforcement Learning for Video Generative Models [100.65199317765608]
  Physical principles are fundamental to realistic visual simulation, but remain a significant oversight in transformer-based video generation.<n>We introduce a physics-aware reinforcement learning paradigm for video generation models that enforces physical collision rules directly in high-dimensional spaces.<n>We extend this paradigm to a unified framework, termed Mimicry-Discovery Cycle (MDcycle), which allows substantial fine-tuning.
  arXiv  Detail & Related papers  (2026-01-16T08:40:10Z)
• Transformers as Intrinsic Optimizers: Forward Inference through the Energy Principle [22.02194689588116]
  This paper revisits the principle of energy as a lens to understand attention-based Transformer models.<n>We present a unified energy-based framework composed of three key components: the global energy $F*$, the energy function $E_i$ and the employed gradient descent (GD) form.<n>Inspired by classical GD algorithms, we extend the original attention formulation based on standard GD to the momentum-based GD, Nesterov Accelerated Gradient (NAG) and Newton's method variants, each inducing a corresponding new attention structure.
  arXiv  Detail & Related papers  (2025-11-02T11:58:50Z)
• Forecasting Continuous Non-Conservative Dynamical Systems in SO(3) [51.510040541600176]
  We propose a novel approach to modeling the rotation of moving objects in computer vision.<n>Our approach is agnostic to energy and momentum conservation while being robust to input noise.<n>By learning to approximate object dynamics from noisy states during training, our model attains robust extrapolation capabilities in simulation and various real-world settings.
  arXiv  Detail & Related papers  (2025-08-11T09:03:10Z)
• Energy Transformer [64.22957136952725]
  Our work combines aspects of three promising paradigms in machine learning, namely, attention mechanism, energy-based models, and associative memory. We propose a novel architecture, called the Energy Transformer (or ET for short), that uses a sequence of attention layers that are purposely designed to minimize a specifically engineered energy function.
  arXiv  Detail & Related papers  (2023-02-14T18:51:22Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.