PhysVid: Physics Aware Local Conditioning for Generative Video Models
- URL: http://arxiv.org/abs/2603.26285v2
- Date: Mon, 30 Mar 2026 01:27:28 GMT
- Title: PhysVid: Physics Aware Local Conditioning for Generative Video Models
- Abstract summary: PhysVid is a physics-aware local conditioning scheme that operates over temporally contiguous chunks of frames.<n>On VideoPhy, PhysVid improves physical commonsense scores by $approx 33%$ over baseline video generators.
- Score: 46.61029355545099
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Generative video models achieve high visual fidelity but often violate basic physical principles, limiting reliability in real-world settings. Prior attempts to inject physics rely on conditioning: frame-level signals are domain-specific and short-horizon, while global text prompts are coarse and noisy, missing fine-grained dynamics. We present PhysVid, a physics-aware local conditioning scheme that operates over temporally contiguous chunks of frames. Each chunk is annotated with physics-grounded descriptions of states, interactions, and constraints, which are fused with the global prompt via chunk-aware cross-attention during training. At inference, we introduce negative physics prompts (descriptions of locally relevant law violations) to steer generation away from implausible trajectories. On VideoPhy, PhysVid improves physical commonsense scores by $\approx 33\%$ over baseline video generators, and by up to $\approx 8\%$ on VideoPhy2. These results show that local, physics-aware guidance substantially increases physical plausibility in generative video and marks a step toward physics-grounded video models.
Related papers
- PhysFlow: Physics-Aware Optical Flow for Motion Controllable Video Generation [20.070221678923968]
PhysFlow is a framework for improving the physical plausibility of generated videos.<n>It consists of a physics-aware optical-flow video generator called PA-Flow and a flow-guided video generator called FlowRender.<n>Our proposed PhysFlow generates videos with superior physical plausibility while maintaining high visual fidelity.
arXiv Detail & Related papers (2026-09-08T03:57:21Z) - Physion-Eval: Evaluating Physical Realism in Generated Video via Human Reasoning [77.34919361116037]
Video generation models are increasingly used as world simulators for storytelling, simulation, and embodied AI.<n>Existing evaluations largely rely on automated metrics or coarse human judgments such as preferences or rubric-based checks.<n>We introduce Physion-Eval, a benchmark of expert human reasoning for diagnosing physical realism failures in videos generated by five state-of-the-art models.
arXiv Detail & Related papers (2026-03-20T03:25:41Z) - PhysVideo: Physically Plausible Video Generation with Cross-View Geometry Guidance [31.104339154260312]
We propose PhysVideo, a framework that generates physics-aware videos and then synthesizes full videos with background foregrounds.<n>In the first stage, Phys4View captures the influence of physical attributes on motion dynamics, and enhances spatial-temporal consistency.<n>In the second stage, Video uses the generated videos as guidance and learns the interactions between foreground dynamics and background context for controllable video synthesis.
arXiv Detail & Related papers (2026-03-19T09:03:06Z) - PhysAlign: Physics-Coherent Image-to-Video Generation through Feature and 3D Representation Alignment [23.066204478030627]
Video Models (VDMs) offer a promising approach for simulating dynamic scenes and environments.<n>Existing models often generate temporally incoherent content that violates basic physical intuition.<n>We propose PhysAlign, an efficient framework for physics-coherent image-to-videoI (2V) generation.
arXiv Detail & Related papers (2026-03-14T05:44:18Z) - Physical Simulator In-the-Loop Video Generation [96.87054314612142]
Physical Simulator In-the-loop Video Generation (PSIVG) is a novel framework that integrates a physical simulator into the video diffusion process.<n>PSIVG produces videos that better adhere to real-world physics while preserving visual quality and diversity.
arXiv Detail & Related papers (2026-03-06T15:48:25Z) - PhysMaster: Mastering Physical Representation for Video Generation via Reinforcement Learning [49.88366485306749]
Video generation models nowadays are capable of generating visually realistic videos, but often fail to adhere to physical laws.<n>We propose PhysMaster, which captures physical knowledge as a representation for guiding video generation models to enhance their physics-awareness.
arXiv Detail & Related papers (2025-10-15T17:59:59Z) - PhysCtrl: Generative Physics for Controllable and Physics-Grounded Video Generation [53.06495362038348]
Existing generation models excel at producing photo-realistic videos from text or images, but often lack physical plausibility and 3D controllability.<n>We introduce PhysCtrl, a novel framework for physics-grounded image-to-video generation with physical parameters and force control.<n> Experiments show that PhysCtrl generates realistic, physics-grounded motion trajectories which, when used to drive image-to-video models, yield high-fidelity, controllable videos.
arXiv Detail & Related papers (2025-09-24T17:58:04Z) - Morpheus: Benchmarking Physical Reasoning of Video Generative Models with Real Physical Experiments [55.56181322973467]
We introduce Morpheus, a benchmark for evaluating video generation models on physical reasoning.<n>It features 80 real-world videos capturing physical phenomena, guided by conservation laws.<n>Our findings reveal that even with advanced prompting and video conditioning, current models struggle to encode physical principles.
arXiv Detail & Related papers (2025-04-03T15:21:17Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.