Principia: Relational Physics Tests for Video Models
- URL: http://arxiv.org/abs/2609.04200v1
- Date: Thu, 03 Sep 2026 17:59:50 GMT
- Title: Principia: Relational Physics Tests for Video Models
- Abstract summary: We introduce Principia, a benchmark that evaluates Newtonian physics through relational consistency between paired objects.<n>Principia spans eight phenomena - gravity, restitution, friction, projectile motion, momentum, pendulum, and mass-spring oscillation.<n>We also introduce a calibration-independent consistency score that quantifies physical violation directly in image space.
- Score: 10.272466104440381
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Evaluating physical reasoning in video models is difficult because absolute motion measurements depend on frame rate, object scale, and camera calibration, all of which are often ambiguous or unavailable in generated video. We propose a different approach. When two objects in the same scene obey the same physical law, their motions must satisfy predictable relationships, and these relationships hold independent of calibration. We introduce Principia, a benchmark that evaluates Newtonian physics through relational consistency between paired objects. Principia spans eight phenomena - gravity, restitution, friction, rotational inertia, projectile motion, momentum, pendulum, and mass-spring oscillation - across translational, rotational, collisional, and oscillatory dynamics, using real-world scenes recorded under controlled protocols. We also introduce a calibration-independent consistency score that quantifies physical violation directly in image space. Across thousands of generations from six state-of-the-art video generators, no model exceeds 0.42 on Principia despite all scoring around 0.8 on VBench. Vision-language models are evaluated on their ability to detect relational physics violations, with the best model achieving only 67% accuracy and most performing near chance level.
Related papers
- RigidBench: Evaluating Rigid-Body Physics in Video Generation Models [16.53417077740312]
We introduce a simulator-grounded benchmark that compares a generated continuation with a reference rollout from the same initial frame and motion description.<n>We evaluate eight models on the same 100 examples with ten measurements that keep these aspects separate.<n>Full fine-tuning reduces 3D trajectory error by about 20% with almost no change in SSIM.
arXiv Detail & Related papers (2026-08-16T06:05:20Z) - GAUGE: A Measurement-Grounded Benchmark for Physical Fidelity in Simulation Engines and Video World Models [66.77745044586173]
GAUGE is a real-world-grounded diagnostic benchmark for evaluating how numerical simulators and generative video world models reproduce or deviate from real-world physics.<n>We benchmark Isaac Sim, Genesis, and Newton on 14 task families using generalized trajectory errors, and evaluate 6 image-to-video models on 5 rigid-body tasks.<n>Our results reveal no uniformly faithful physics engine, with the largest discrepancies arising in impulsive contact, rapid textile motion, and volumetric deformation.
arXiv Detail & Related papers (2026-08-06T12:19:38Z) - A Physics-Grounded Benchmark for Multi-Agent Dynamics in World Models [96.64934195520802]
We introduce CrashTwin, a physics-grounded evaluation framework designed to stress-test the physical trustworthiness of world models.<n>CrashTwin couples a diverse dataset of multi-agent collision scenarios, comprising 25K controllable synthetic 12K in-the-wild real-world collision sequences.<n>We propose a diagnostic suite that systematically evaluates three dimensions:-temporal consistency, momentum and kinetic energy conservation, and world-dynamics integrity.
arXiv Detail & Related papers (2026-06-27T06:13:35Z) - PhyPush: One Push is All You Need for Sensorless Physical Property Estimation with Physics-Guided Transformers [2.032261439690125]
This paper presents PhyPush, a physics-guided Transformer framework that estimates an object's mass from a single push.<n>In simulation, it reduces error by over 10% compared with a baseline that has privileged access to full force information.<n>Results demonstrate that physics-guided learning can enable low-cost, sensor-efficient estimation of physical properties.
arXiv Detail & Related papers (2026-05-25T19:14:43Z) - PhyCo: Learning Controllable Physical Priors for Generative Motion [55.59209981836171]
We present PhyCo, a framework that introduces continuous, interpretable, and physically grounded control into video generation.<n>Our approach integrates three key components: (i) a large-scale dataset of over 100K photorealistic simulation videos where friction, restitution, deformation, and force are systematically varied across diverse scenarios; (ii) physics-supervised fine-tuning of a pretrained diffusion model using a ControlNet conditioned on pixel-aligned physical property maps; and (iii) VLM-guided reward optimization, where a fine-tuned vision-language model evaluates generated videos with targeted physics queries and provides differentiable feedback.
arXiv Detail & Related papers (2026-04-30T17:53:03Z) - PAD-Hand: Physics-Aware Diffusion for Hand Motion Recovery [8.428762763310232]
We propose a physics-aware conditional diffusion framework that refines noisy pose sequences into physically plausible hand motion.<n>Building on a MeshCNN-Transformer backbone, we formulate Euler-Lagrange dynamics for articulated hands.<n>Our method produces per-joint, per-time variances that measure physics consistency and offer interpretable variance maps.
arXiv Detail & Related papers (2026-03-27T04:39:21Z) - PhysicsMind: Sim and Real Mechanics Benchmarking for Physical Reasoning and Prediction in Foundational VLMs and World Models [40.16417939211015]
Modern foundational Multimodal Large Language Models (MLLMs) and video world models have advanced significantly in mathematical, common-sense, and visual reasoning.<n>Existing benchmarks attempting to measure this matter rely on synthetic, Visual Question Answer templates or focus on perceptual video quality that is tangential to measuring how well the video abides by physical laws.<n>We introduce PhysicsMind, a unified benchmark that evaluates law-consistent reasoning and generation over three canonical principles: Center of Mass, Lever Equilibrium, and Newton's First Law.
arXiv Detail & Related papers (2026-01-22T14:33:01Z) - PhysRVG: Physics-Aware Unified Reinforcement Learning for Video Generative Models [100.65199317765608]
Physical principles are fundamental to realistic visual simulation, but remain a significant oversight in transformer-based video generation.<n>We introduce a physics-aware reinforcement learning paradigm for video generation models that enforces physical collision rules directly in high-dimensional spaces.<n>We extend this paradigm to a unified framework, termed Mimicry-Discovery Cycle (MDcycle), which allows substantial fine-tuning.
arXiv Detail & Related papers (2026-01-16T08:40:10Z) - What Happens Next? Anticipating Future Motion by Generating Point Trajectories [76.16266402727643]
We consider the problem of forecasting motion from a single image, predicting how objects in the world are likely to move.<n>We formulate this task as conditional generation of dense trajectory grids with a model that closely follows the architecture of modern video generators.<n>This approach captures scene-wide dynamics and uncertainty, yielding more accurate and diverse predictions than prior regressors and generators.
arXiv Detail & Related papers (2025-09-25T21:03:56Z) - Physics-Grounded Motion Forecasting via Equation Discovery for Trajectory-Guided Image-to-Video Generation [54.42523027597904]
We introduce a novel framework that integrates symbolic regression and trajectory-guided image-to-video (I2V) models for physics-grounded video forecasting.<n>Our approach extracts motion trajectories from input videos, uses a retrieval-based pre-training mechanism to enhance symbolic regression, and discovers equations of motion to forecast physically accurate future trajectories.
arXiv Detail & Related papers (2025-07-09T13:28:42Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.