VideoWeave: Unlocking Geometric Consistency in Video Generation via Joint Geometry-Video Modeling

• URL: http://arxiv.org/abs/2606.14162v1
• Date: Fri, 12 Jun 2026 06:41:13 GMT
• Title: VideoWeave: Unlocking Geometric Consistency in Video Generation via Joint Geometry-Video Modeling
• Abstract summary: Video diffusion models often fail to preserve 3D structure over time.<n>Existing methods usually enforce geometric consistency by using explicit geometry reconstructions.<n>We propose VideoWeave, a latent-space post-training framework that uses implicit geometry-model features to constrain the generative distribution.
• Score: 49.98112719317813
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Large-scale video diffusion models often fail to preserve 3D structure over time, causing geometric drift and implausible motion under viewpoint changes. Existing methods usually enforce geometric consistency by using explicit geometry reconstructions, such as depth maps, point clouds, or reconstructed 3D structures, to define conditions, supervision, or reward signals, making the generator sensitive to errors from upstream geometry pipelines. We propose VideoWeave, a latent-space post-training framework that uses implicit geometry-model features to constrain the generative distribution, providing a more flexible and non-rigid form of guidance that mitigates the impact of reconstruction errors from geometry models. Specifically, VideoWeave adapts these features into geometry latents and jointly models them with video latents in a shared denoising space, allowing geometry to shape the generative distribution during training. To support this process, we build GeoVid-80K, an 80K-video dataset with paired appearance and geometry representations. Experiments on text-to-video and image-to-video generation show that VideoWeave improves geometric coherence while preserving strong visual quality. VideoWeave project page at https://videoweave.github.io/

Related papers

• GeoFlow: Enforcing Implicit Geometric Consistency in Video Generation [46.507099021313074]
  We introduce a geometry-consistency reward that measures whether motion in a generated video is compatible with a coherent scene.<n>We operationalize this using optical flow, depth--pose predictions, and feature-based correspondence to separate rigid and dynamic regions.<n>Experiments show substantial reductions in temporal geometric artifacts over strong baselines while preserving perceptual quality.
  arXiv  Detail & Related papers  (2026-05-18T13:17:08Z)
• Quantitative Video World Model Evaluation for Geometric-Consistency [18.53748808467407]
  Generative video models are increasingly studied as implicit world models.<n> evaluating whether they produce physically plausible 3D structure and motion remains challenging.<n>We introduce PDI-Bench, a framework for auditing geometric coherence in generated videos.
  arXiv  Detail & Related papers  (2026-05-14T17:59:04Z)
• GeoNVS: Geometry Grounded Video Diffusion for Novel View Synthesis [73.97869945427645]
  GeoNVS is a novel-view synthesizer that enhances both geometric fidelity and camera controllability through explicit 3D geometric guidance.<n>GS-Adapter lifts input-view diffusion features into 3D Gaussian representations, and adaptively fuses them with diffusion features to correct geometrically inconsistent representations.<n>Experiments across 9 scenes and 18 settings demonstrate state-of-the-art performance, achieving 11.3% and 14.9% improvements over SEVA and CameraCtrl.
  arXiv  Detail & Related papers  (2026-03-16T08:23:00Z)
• Scalable Adaptation of 3D Geometric Foundation Models via Weak Supervision from Internet Video [76.32954467706581]
  We propose SAGE, a framework for Scalable Adaptation of GEometric foundation models from raw video streams.<n>We use a hierarchical mining pipeline to transform videos into training trajectories and hybrid supervision.<n>Experiments show that SAGE significantly enhances zero-shot generalization, reducing Chamfer Distance by 20-42% on unseen benchmarks.
  arXiv  Detail & Related papers  (2026-02-08T09:53:21Z)
• GeoVideo: Introducing Geometric Regularization into Video Generation Model [46.38507581500745]
  We introduce geometric regularization losses into video generation by augmenting latent diffusion models with per-frame depth prediction.<n>Our method bridges the gap between appearance generation and 3D structure modeling, leading to improved structural coherence-temporal shape, consistency, and physical plausibility.
  arXiv  Detail & Related papers  (2025-12-03T05:11:57Z)
• GeoWorld: Unlocking the Potential of Geometry Models to Facilitate High-Fidelity 3D Scene Generation [68.02988074681427]
  Previous works leveraging video models for image-to-3D scene generation tend to suffer from geometric distortions and blurry content.<n>In this paper, we renovate the pipeline of image-to-3D scene generation by unlocking the potential of geometry models.<n>Our GeoWorld can generate high-fidelity 3D scenes from a single image and a given camera trajectory, outperforming prior methods both qualitatively and quantitatively.
  arXiv  Detail & Related papers  (2025-11-28T13:55:45Z)
• Epipolar Geometry Improves Video Generation Models [73.44978239787501]
  3D-consistent video generation could significantly impact numerous downstream applications in generation and reconstruction tasks.<n>We explore how epipolar geometry constraints improve modern video diffusion models.<n>By bridging data-driven deep learning with classical geometric computer vision, we present a practical method for generating spatially consistent videos.
  arXiv  Detail & Related papers  (2025-10-24T16:21:37Z)
• Geometry Forcing: Marrying Video Diffusion and 3D Representation for Consistent World Modeling [29.723534231743038]
  We propose Geometry Forcing to bridge the gap between video diffusion models and the underlying 3D nature of the physical world.<n>Our key insight is to guide the model's intermediate representations toward geometry-aware structure by aligning them with features from a pretrained geometric foundation model.<n>We evaluate Geometry Forcing on both camera view-conditioned and action-conditioned video generation tasks.
  arXiv  Detail & Related papers  (2025-07-10T17:55:08Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.