PhysVideo: Physically Plausible Video Generation with Cross-View Geometry Guidance

• URL: http://arxiv.org/abs/2603.18639v1
• Date: Thu, 19 Mar 2026 09:03:06 GMT
• Title: PhysVideo: Physically Plausible Video Generation with Cross-View Geometry Guidance
• Abstract summary: We propose PhysVideo, a framework that generates physics-aware videos and then synthesizes full videos with background foregrounds.<n>In the first stage, Phys4View captures the influence of physical attributes on motion dynamics, and enhances spatial-temporal consistency.<n>In the second stage, Video uses the generated videos as guidance and learns the interactions between foreground dynamics and background context for controllable video synthesis.
• Score: 31.104339154260312
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Recent progress in video generation has led to substantial improvements in visual fidelity, yet ensuring physically consistent motion remains a fundamental challenge. Intuitively, this limitation can be attributed to the fact that real-world object motion unfolds in three-dimensional space, while video observations provide only partial, view-dependent projections of such dynamics. To address these issues, we propose PhysVideo, a two-stage framework that first generates physics-aware orthogonal foreground videos and then synthesizes full videos with background. In the first stage, Phys4View leverages physics-aware attention to capture the influence of physical attributes on motion dynamics, and enhances spatio-temporal consistency by incorporating geometry-enhanced cross-view attention and temporal attention. In the second stage, VideoSyn uses the generated foreground videos as guidance and learns the interactions between foreground dynamics and background context for controllable video synthesis. To support training, we construct PhysMV, a dataset containing 40K scenes, each consisting of four orthogonal viewpoints, resulting in a total of 160K video sequences. Extensive experiments demonstrate that PhysVideo significantly improves physical realism and spatial-temporal coherence over existing video generation methods. Home page: https://anonymous.4open.science/w/Phys4D/.

Related papers

• PhysFlow: Physics-Aware Optical Flow for Motion Controllable Video Generation [20.070221678923968]
  PhysFlow is a framework for improving the physical plausibility of generated videos.<n>It consists of a physics-aware optical-flow video generator called PA-Flow and a flow-guided video generator called FlowRender.<n>Our proposed PhysFlow generates videos with superior physical plausibility while maintaining high visual fidelity.
  arXiv  Detail & Related papers  (2026-09-08T03:57:21Z)
• TelePhysics: Physics-Grounded Multi-Object Scene Generation from a Single Image with Real-Time Interaction [51.01447538245441]
  We propose TelePhysics, a training-free framework that converts a single image into a physically consistent and controllable video.<n>By representing the full scene geometry in a unified spatial coordinate system, TelePhysics resolves object penetration and alignment ambiguity.<n> Experimental results demonstrate that TelePhysics substantially outperforms prior methods in physical fidelity, spatial coherence, and controllability.
  arXiv  Detail & Related papers  (2026-05-19T08:16:44Z)
• PhysVid: Physics Aware Local Conditioning for Generative Video Models [46.61029355545099]
  PhysVid is a physics-aware local conditioning scheme that operates over temporally contiguous chunks of frames.<n>On VideoPhy, PhysVid improves physical commonsense scores by $approx 33%$ over baseline video generators.
  arXiv  Detail & Related papers  (2026-03-27T10:51:57Z)
• PhysAlign: Physics-Coherent Image-to-Video Generation through Feature and 3D Representation Alignment [23.066204478030627]
  Video Models (VDMs) offer a promising approach for simulating dynamic scenes and environments.<n>Existing models often generate temporally incoherent content that violates basic physical intuition.<n>We propose PhysAlign, an efficient framework for physics-coherent image-to-videoI (2V) generation.
  arXiv  Detail & Related papers  (2026-03-14T05:44:18Z)
• Physical Simulator In-the-Loop Video Generation [96.87054314612142]
  Physical Simulator In-the-loop Video Generation (PSIVG) is a novel framework that integrates a physical simulator into the video diffusion process.<n>PSIVG produces videos that better adhere to real-world physics while preserving visual quality and diversity.
  arXiv  Detail & Related papers  (2026-03-06T15:48:25Z)
• PhysChoreo: Physics-Controllable Video Generation with Part-Aware Semantic Grounding [50.454084539837005]
  PhysChoreo is a novel framework that can generate videos with diverse controllability and physical realism from a single image.<n>Our method consists of two stages: first, it estimates the static initial physical properties of all objects in the image through part-aware physical property reconstruction.<n>Then, through temporally instructed and physically editable simulation, it synthesizes high-quality videos with rich dynamic behaviors and physical realism.
  arXiv  Detail & Related papers  (2025-11-25T17:59:04Z)
• PhysCtrl: Generative Physics for Controllable and Physics-Grounded Video Generation [53.06495362038348]
  Existing generation models excel at producing photo-realistic videos from text or images, but often lack physical plausibility and 3D controllability.<n>We introduce PhysCtrl, a novel framework for physics-grounded image-to-video generation with physical parameters and force control.<n> Experiments show that PhysCtrl generates realistic, physics-grounded motion trajectories which, when used to drive image-to-video models, yield high-fidelity, controllable videos.
  arXiv  Detail & Related papers  (2025-09-24T17:58:04Z)
• VLIPP: Towards Physically Plausible Video Generation with Vision and Language Informed Physical Prior [88.51778468222766]
  Video diffusion models (VDMs) have advanced significantly in recent years, enabling the generation of highly realistic videos.<n>VDMs often fail to produce physically plausible videos due to an inherent lack of understanding of physics.<n>We propose a novel two-stage image-to-video generation framework that explicitly incorporates physics with vision and language informed physical prior.
  arXiv  Detail & Related papers  (2025-03-30T09:03:09Z)
• PhysGame: Uncovering Physical Commonsense Violations in Gameplay Videos [66.09921831504238]
  We propose PhysGame as a pioneering benchmark to evaluate physical commonsense violations in gameplay videos.<n>Our findings reveal that the performance of current open-source video LLMs significantly lags behind that of proprietary counterparts.<n>Based on the suite of datasets, we propose PhysVLM as a physical knowledge-enhanced video LLM.
  arXiv  Detail & Related papers  (2024-12-02T18:47:25Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.