VideoGPA: Distilling Geometry Priors for 3D-Consistent Video Generation

• URL: http://arxiv.org/abs/2601.23286v1
• Date: Fri, 30 Jan 2026 18:59:57 GMT
• Title: VideoGPA: Distilling Geometry Priors for 3D-Consistent Video Generation
• Abstract summary: VideoGPA is a data-efficient self-supervised framework to automatically derive dense preference signals.<n>It steers the generative distribution toward inherent 3D consistency without requiring human annotations.<n>It significantly enhances temporal stability, physical plausibility, and motion coherence using minimal preference pairs.
• Score: 34.46015478321541
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: While recent video diffusion models (VDMs) produce visually impressive results, they fundamentally struggle to maintain 3D structural consistency, often resulting in object deformation or spatial drift. We hypothesize that these failures arise because standard denoising objectives lack explicit incentives for geometric coherence. To address this, we introduce VideoGPA (Video Geometric Preference Alignment), a data-efficient self-supervised framework that leverages a geometry foundation model to automatically derive dense preference signals that guide VDMs via Direct Preference Optimization (DPO). This approach effectively steers the generative distribution toward inherent 3D consistency without requiring human annotations. VideoGPA significantly enhances temporal stability, physical plausibility, and motion coherence using minimal preference pairs, consistently outperforming state-of-the-art baselines in extensive experiments.

Related papers

• 3D Consistency Optimization for Self-Supervised Monocular Video Depth Estimation [21.287558280133076]
  We introduce a new paradigm that recasts sequential video depth estimation as an unconstrained multi-view 3D reconstruction problem.<n>Our approach is driven by three constraints: image-level photometric rendering, explicit world-coordinate geometric alignment, and multi-scale temporal gradient consistency.<n>Results show that the proposed approach achieves state-of-the-art spatial accuracy, outperforming the frame-based, video-based depth estimators and the multi-view 3D reconstruction baselines.
  arXiv  Detail & Related papers  (2026-06-14T08:56:45Z)
• ViPS: Video-informed Pose Spaces for Auto-Rigged Meshes [55.32681167870698]
  Video-informed Pose Spaces (ViPS) is a feed-forward framework that discovers the latent distribution of valid articulations for auto-rigged meshes.<n>ViPS transfers generative video priors into a universal distribution over a given rig parameterization.<n>Our evaluations show that ViPS matches the performance of state-of-the-art methods trained on synthetic artist-created 4D data in both plausibility and diversity.
  arXiv  Detail & Related papers  (2026-04-19T21:21:11Z)
• Towards Realistic and Consistent Orbital Video Generation via 3D Foundation Priors [61.34273238077091]
  We present a novel method for generating orbital videos from a single image of an object.<n>Our method achieves superior visual quality, shape realism and multi-view consistency compared to state-of-the-art methods.
  arXiv  Detail & Related papers  (2026-04-14T05:35:46Z)
• VGGRPO: Towards World-Consistent Video Generation with 4D Latent Reward [14.297118875382871]
  VGGRPO is a latent geometry-guided framework for geometry-aware video post-training.<n>It stitches video diffusion latents to geometry foundation models, enabling direct decoding of scene geometry from the latent space.<n>It improves camera stability, geometry consistency, and overall quality while eliminating costly VAE decoding.
  arXiv  Detail & Related papers  (2026-03-27T16:57:51Z)
• Scalable Adaptation of 3D Geometric Foundation Models via Weak Supervision from Internet Video [76.32954467706581]
  We propose SAGE, a framework for Scalable Adaptation of GEometric foundation models from raw video streams.<n>We use a hierarchical mining pipeline to transform videos into training trajectories and hybrid supervision.<n>Experiments show that SAGE significantly enhances zero-shot generalization, reducing Chamfer Distance by 20-42% on unseen benchmarks.
  arXiv  Detail & Related papers  (2026-02-08T09:53:21Z)
• Selfi: Self Improving Reconstruction Engine via 3D Geometric Feature Alignment [15.822150318879052]
  We introduce Selfi, a self-improving 3D reconstruction pipeline via feature alignment.<n>We train a lightweight feature adapter using a reprojection-based consistency loss.<n>This enables state-of-the-art performance in both NVS and camera pose estimation.
  arXiv  Detail & Related papers  (2025-12-09T18:59:52Z)
• GeoVideo: Introducing Geometric Regularization into Video Generation Model [46.38507581500745]
  We introduce geometric regularization losses into video generation by augmenting latent diffusion models with per-frame depth prediction.<n>Our method bridges the gap between appearance generation and 3D structure modeling, leading to improved structural coherence-temporal shape, consistency, and physical plausibility.
  arXiv  Detail & Related papers  (2025-12-03T05:11:57Z)
• Epipolar Geometry Improves Video Generation Models [73.44978239787501]
  3D-consistent video generation could significantly impact numerous downstream applications in generation and reconstruction tasks.<n>We explore how epipolar geometry constraints improve modern video diffusion models.<n>By bridging data-driven deep learning with classical geometric computer vision, we present a practical method for generating spatially consistent videos.
  arXiv  Detail & Related papers  (2025-10-24T16:21:37Z)
• ShapeGen4D: Towards High Quality 4D Shape Generation from Videos [85.45517487721257]
  We introduce a native video-to-4D shape generation framework that synthesizes a single dynamic 3D representation end-to-end from the video.<n>Our method accurately captures non-rigid motion, volume changes, and even topological transitions without per-frame optimization.
  arXiv  Detail & Related papers  (2025-10-07T17:58:11Z)
• RLGF: Reinforcement Learning with Geometric Feedback for Autonomous Driving Video Generation [75.61028930882144]
  We identify and quantify this critical issue, demonstrating a significant performance gap in 3D object detection when using synthetic versus real data.<n>We introduce Reinforcement Learning with Geometric Feedback (RLGF), RLGF uniquely refines video diffusion models by incorporating rewards from specialized latent-space AD perception models.<n> RLGF substantially reduces geometric errors (e.g., VP error by 21%, Depth error by 57%) and dramatically improves 3D object detection mAP by 12.7%, narrowing the gap to real-data performance.
  arXiv  Detail & Related papers  (2025-09-20T02:23:36Z)
• UniGeo: Taming Video Diffusion for Unified Consistent Geometry Estimation [63.90470530428842]
  In this work, we demonstrate that, through appropriate design and fine-tuning, the intrinsic consistency of video generation models can be effectively harnessed for consistent geometric estimation.<n>Our results achieve superior performance in predicting global geometric attributes in videos and can be directly applied to reconstruction tasks.
  arXiv  Detail & Related papers  (2025-05-30T12:31:59Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.