UniWorld-View: Large-Baseline View Synthesis via Video Diffusion Models

• URL: http://arxiv.org/abs/2608.04701v1
• Date: Wed, 05 Aug 2026 11:10:52 GMT
• Title: UniWorld-View: Large-Baseline View Synthesis via Video Diffusion Models
• Abstract summary: We introduce UniWorld-View, a framework for controllable large-baseline novel view synthesis from monocular inputs.<n>UniWorld-View integrates explicit 3D guidance with generative diffusion modeling to enable precise camera control and geometrically consistent view generation.
• Score: 46.428624307379266
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The abundance of casually captured monocular videos and images on social media provides a valuable source for immersive content creation, where generating novel views from such sparse observations can greatly enhance user experiences. However, producing photorealistic and geometrically consistent views with precise camera control remains challenging when input coverage is extremely limited. Reconstruction-based approaches such as NeRF and 3D Gaussian Splatting (3DGS) deteriorate severely under sparse inputs and fail to explicitly handle occlusions. Generative methods ease data requirements but still struggle with large-baseline view synthesis due to inaccurate or implicit geometric guidance. To overcome these limitations, we introduce UniWorld-View, a unified framework for controllable large-baseline novel view synthesis from monocular inputs. UniWorld-View integrates explicit 3D guidance with generative diffusion modeling to enable precise camera control and geometrically consistent view generation. The geometric guidance is obtained through an occlusion-aware point cloud rendering strategy that resolves visibility ambiguities and provides accurate priors for diffusion-based synthesis. By coupling this rendering strategy with powerful video diffusion backbones, UniWorld-View achieves high-fidelity novel view generation even under extreme camera motions and wide-baseline changes, and can further provide multi-view videos for downstream dynamic 3DGS reconstruction. Experiments on the WorldScore benchmark and zero-shot NVS benchmarks demonstrate the effectiveness of UniWorld-View in controllability, geometric consistency, and visual fidelity.

Related papers

• VidSplat: Gaussian Splatting Reconstruction with Geometry-Guided Video Diffusion Priors [79.88300861391114]
  VidSplat is a training-free generative reconstruction framework.<n>We tackle two key challenges that enable the effective integration of generation and reconstruction.<n>Experiments on widely used benchmarks demonstrate our superior performance in sparse-view scene reconstruction.
  arXiv  Detail & Related papers  (2026-05-12T02:20:31Z)
• OrbitNVS: Harnessing Video Diffusion Priors for Novel View Synthesis [16.645032433380603]
  Novel View Synthesis (NVS) aims to generate unseen views of a 3D object given a limited number of known views.<n>We propose OrbitNVS, which reformulates NVS as an orbit video generation task.<n>We show that OrbitNVS significantly outperforms previous methods on the GSO and OmniObject3D benchmarks.
  arXiv  Detail & Related papers  (2026-03-20T03:40:36Z)
• GeoNVS: Geometry Grounded Video Diffusion for Novel View Synthesis [73.97869945427645]
  GeoNVS is a novel-view synthesizer that enhances both geometric fidelity and camera controllability through explicit 3D geometric guidance.<n>GS-Adapter lifts input-view diffusion features into 3D Gaussian representations, and adaptively fuses them with diffusion features to correct geometrically inconsistent representations.<n>Experiments across 9 scenes and 18 settings demonstrate state-of-the-art performance, achieving 11.3% and 14.9% improvements over SEVA and CameraCtrl.
  arXiv  Detail & Related papers  (2026-03-16T08:23:00Z)
• WorldStereo: Bridging Camera-Guided Video Generation and Scene Reconstruction via 3D Geometric Memories [36.79437857022868]
  WorldStereo is a novel framework that bridges camera-guided video generation and 3D reconstruction.<n>We show that WorldStereo acts as a powerful world model, tackling diverse scene generation tasks with high-fidelity 3D results.
  arXiv  Detail & Related papers  (2026-03-02T16:36:56Z)
• Scalable Adaptation of 3D Geometric Foundation Models via Weak Supervision from Internet Video [76.32954467706581]
  We propose SAGE, a framework for Scalable Adaptation of GEometric foundation models from raw video streams.<n>We use a hierarchical mining pipeline to transform videos into training trajectories and hybrid supervision.<n>Experiments show that SAGE significantly enhances zero-shot generalization, reducing Chamfer Distance by 20-42% on unseen benchmarks.
  arXiv  Detail & Related papers  (2026-02-08T09:53:21Z)
• SpatialCrafter: Unleashing the Imagination of Video Diffusion Models for Scene Reconstruction from Limited Observations [44.53106180688135]
  This work takes on the challenge of reconstructing 3D scenes from sparse or single-view inputs.<n>We introduce SpatialCrafter, a framework that leverages the rich knowledge in video diffusion models to generate plausible additional observations.<n>Through a trainable camera encoder and an epipolar attention mechanism for explicit geometric constraints, we achieve precise camera control and 3D consistency.
  arXiv  Detail & Related papers  (2025-05-17T13:05:13Z)
• ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesis [63.169364481672915]
  We propose textbfViewCrafter, a novel method for synthesizing high-fidelity novel views of generic scenes from single or sparse images. Our method takes advantage of the powerful generation capabilities of video diffusion model and the coarse 3D clues offered by point-based representation to generate high-quality video frames.
  arXiv  Detail & Related papers  (2024-09-03T16:53:19Z)
• FreeSplat: Generalizable 3D Gaussian Splatting Towards Free-View Synthesis of Indoor Scenes [50.534213038479926]
  FreeSplat is capable of reconstructing geometrically consistent 3D scenes from long sequence input towards free-view synthesis. We propose a simple but effective free-view training strategy that ensures robust view synthesis across broader view range regardless of the number of views.
  arXiv  Detail & Related papers  (2024-05-28T08:40:14Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.