Measuring 3D Spatial Geometric Consistency in Dynamic Generated Videos

• URL: http://arxiv.org/abs/2603.19048v1
• Date: Thu, 19 Mar 2026 15:44:39 GMT
• Title: Measuring 3D Spatial Geometric Consistency in Dynamic Generated Videos
• Abstract summary: We introduce SGC, a metric for evaluating 3D textbfSpatial textbfGeometric textbfConsistency in videos.<n>SGC robustly quantifies geometric inconsistencies, effectively identifying critical failures missed by existing metrics.
• Score: 67.7364297817535
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Recent generative models can produce high-fidelity videos, yet they often exhibit 3D spatial geometric inconsistencies. Existing evaluation methods fail to accurately characterize these inconsistencies: fidelity-centric metrics like FVD are insensitive to geometric distortions, while consistency-focused benchmarks often penalize valid foreground dynamics. To address this gap, we introduce SGC, a metric for evaluating 3D \textbf{S}patial \textbf{G}eometric \textbf{C}onsistency in dynamically generated videos. We quantify geometric consistency by measuring the divergence among multiple camera poses estimated from distinct local regions. Our approach first separates static from dynamic regions, then partitions the static background into spatially coherent sub-regions. We predict depth for each pixel, estimate a local camera pose for each subregion, and compute the divergence among these poses to quantify geometric consistency. Experiments on real and generative videos demonstrate that SGC robustly quantifies geometric inconsistencies, effectively identifying critical failures missed by existing metrics.

Related papers

• Reliability-Aware 3D Geometric Injection for Universal Person Re-identification [47.874819213762926]
  We propose a Universal Monocular 3D-Enhanced ReID framework driven by a Consistency-Aware Reliability Gate and Dual-Stream Residual Fusion.<n>Our method improves challenging, structure-sensitive scenarios while preserving competitive performance on clean domains.
  arXiv  Detail & Related papers  (2026-07-21T08:54:25Z)
• GeoFlow: Enforcing Implicit Geometric Consistency in Video Generation [46.507099021313074]
  We introduce a geometry-consistency reward that measures whether motion in a generated video is compatible with a coherent scene.<n>We operationalize this using optical flow, depth--pose predictions, and feature-based correspondence to separate rigid and dynamic regions.<n>Experiments show substantial reductions in temporal geometric artifacts over strong baselines while preserving perceptual quality.
  arXiv  Detail & Related papers  (2026-05-18T13:17:08Z)
• Quantitative Video World Model Evaluation for Geometric-Consistency [18.53748808467407]
  Generative video models are increasingly studied as implicit world models.<n> evaluating whether they produce physically plausible 3D structure and motion remains challenging.<n>We introduce PDI-Bench, a framework for auditing geometric coherence in generated videos.
  arXiv  Detail & Related papers  (2026-05-14T17:59:04Z)
• GemDepth: Geometry-Embedded Features for 3D-Consistent Video Depth [12.866152238833104]
  Video depth estimation extends monocular prediction into the temporal domain to ensure coherence.<n>Current approaches, which primarily rely on temporal smoothing via Transformers, struggle to maintain strict 3D geometric consistency.<n>We propose GemDepth, a framework built on the insight that an explicit awareness of camera motion and global 3D structure is a prerequisite for 3D consistency.
  arXiv  Detail & Related papers  (2026-05-11T13:11:54Z)
• Geometry OR Tracker: Universal Geometric Operating Room Tracking [61.399734016038614]
  In operating rooms (OR), world-scale multi-view 3D tracking supports downstream applications such as surgeon behavior recognition.<n>Camera calibration and RGB-D registration are always unreliable, leading to cross-view geometric inconsistency.<n>We introduce Geometry OR Tracker, a two-stage pipeline that rectifies imprecise calibration into a scaleconsistent and geometrically consistent camera setup.
  arXiv  Detail & Related papers  (2026-02-28T09:21:21Z)
• Geometry-Aware Rotary Position Embedding for Consistent Video World Model [48.914346802616414]
  ViewRope is a geometry-aware encoding that injects camera-ray directions directly into video transformer self-attention layers.<n>Geometry-Aware Frame-Sparse Attention exploits these geometric cues to selectively attend to relevant historical frames.<n>Our results demonstrate that ViewRope substantially improves long-term consistency while reducing computational costs.
  arXiv  Detail & Related papers  (2026-02-08T08:01:16Z)
• GeCo: A Differentiable Geometric Consistency Metric for Video Generation [61.28264035357065]
  We introduce GeCo, a geometry-grounded metric for jointly detecting geometric deformation and occlusion-inconsistency artifacts in static scenes.<n>By fusing residual motion and depth priors, GeCo produces interpretable, dense consistency maps that reveal these artifacts.<n>We use GeCo to systematically benchmark recent video generation models, uncovering common failure modes, and further employ it as a training-free loss guidance to reduce deformation artifacts during video generation.
  arXiv  Detail & Related papers  (2025-12-25T03:28:28Z)
• GeoVideo: Introducing Geometric Regularization into Video Generation Model [46.38507581500745]
  We introduce geometric regularization losses into video generation by augmenting latent diffusion models with per-frame depth prediction.<n>Our method bridges the gap between appearance generation and 3D structure modeling, leading to improved structural coherence-temporal shape, consistency, and physical plausibility.
  arXiv  Detail & Related papers  (2025-12-03T05:11:57Z)
• Epipolar Geometry Improves Video Generation Models [73.44978239787501]
  3D-consistent video generation could significantly impact numerous downstream applications in generation and reconstruction tasks.<n>We explore how epipolar geometry constraints improve modern video diffusion models.<n>By bridging data-driven deep learning with classical geometric computer vision, we present a practical method for generating spatially consistent videos.
  arXiv  Detail & Related papers  (2025-10-24T16:21:37Z)
• GeometryCrafter: Consistent Geometry Estimation for Open-world Videos with Diffusion Priors [47.21120442961684]
  We propose GeometryCrafter, a novel framework that recovers high-fidelity point map sequences with temporal coherence from open-world videos.<n>We show that GeometryCrafter achieves state-of-the-art 3D accuracy, temporal consistency, and generalization capability.
  arXiv  Detail & Related papers  (2025-04-01T17:58:03Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.