Vista4D: Video Reshooting with 4D Point Clouds

• URL: http://arxiv.org/abs/2604.21915v1
• Date: Thu, 23 Apr 2026 17:57:28 GMT
• Title: Vista4D: Video Reshooting with 4D Point Clouds
• Abstract summary: Vista4D is a video reshooting framework that grounds the input video and target cameras in a 4D point cloud.<n>We show improved 4D consistency, camera control, and visual quality compared to state-of-the-art baselines.<n>Our method generalizes to real-world applications such as dynamic scene expansion and 4D scene recomposition.
• Score: 60.22650781486302
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: We present Vista4D, a robust and flexible video reshooting framework that grounds the input video and target cameras in a 4D point cloud. Specifically, given an input video, our method re-synthesizes the scene with the same dynamics from a different camera trajectory and viewpoint. Existing video reshooting methods often struggle with depth estimation artifacts of real-world dynamic videos, while also failing to preserve content appearance and failing to maintain precise camera control for challenging new trajectories. We build a 4D-grounded point cloud representation with static pixel segmentation and 4D reconstruction to explicitly preserve seen content and provide rich camera signals, and we train with reconstructed multiview dynamic data for robustness against point cloud artifacts during real-world inference. Our results demonstrate improved 4D consistency, camera control, and visual quality compared to state-of-the-art baselines under a variety of videos and camera paths. Moreover, our method generalizes to real-world applications such as dynamic scene expansion and 4D scene recomposition. See our project page for results, code, and models: https://eyeline-labs.github.io/Vista4D

Related papers

• Manifold4D: Denoising on Point Cloud Rendered Manifolds for Video Re-shooting [16.163736801043942]
  Video re-shooting re-renders a monocular video of a dynamic scene along a user-specified camera trajectory.<n>The dominant recipe supplies the target geometry explicitly.<n>We propose MANIFOLD4D, which injects the render directly into the initial noise of flow matching.
  arXiv  Detail & Related papers  (2026-08-28T10:39:52Z)
• Full-4D: Generating Full-Scope 4D Scenes from a Single-View Video [63.61099683012546]
  We introduce RealMV-4D, a dataset of synchronized multi-view videos.<n>We then train a multi-view video diffusion model driven by a novel fused time(T)-view(V) attention mechanism.<n>Experiments demonstrate that our method outperforms existing approaches in both visual fidelity and consistency.
  arXiv  Detail & Related papers  (2026-05-25T06:59:26Z)
• 4C4D: 4 Camera 4D Gaussian Splatting [56.926598190499156]
  This paper tackles the challenge of recovering 4D dynamic scenes from videos captured by as few as four portable cameras.<n>We propose textbf4C4D, a novel framework that enables high-fidelity 4D Gaussian Splatting from video captures of extremely sparse cameras.
  arXiv  Detail & Related papers  (2026-04-05T11:09:23Z)
• SEE4D: Pose-Free 4D Generation via Auto-Regressive Video Inpainting [83.5106058182799]
  We introduce SEE4D, a pose-free, trajectory-to-camera framework for 4D world modeling from casual videos.<n>A view-conditional video in model is trained to learn a robust geometry prior to denoising realistically synthesized images.<n>We validate See4D on cross-view video generation and sparse reconstruction benchmarks.
  arXiv  Detail & Related papers  (2025-10-30T17:59:39Z)
• C4D: 4D Made from 3D through Dual Correspondences [77.04731692213663]
  We introduce C4D, a framework that leverages temporal correspondences to extend existing 3D reconstruction formulation to 4D.<n>C4D captures two types of correspondences: short-term optical flow and long-term point tracking.<n>We train a dynamic-aware point tracker that provides additional mobility information.
  arXiv  Detail & Related papers  (2025-10-16T17:59:06Z)
• GFlow: Recovering 4D World from Monocular Video [58.63051670458107]
  We introduce GFlow, a framework that lifts a video to a 4D scene as a flow of 3D Gaussians through space and time.<n>GFlow segment the video into still and moving parts, then alternates between optimizing camera poses and the dynamics of the 3D Gaussian points.<n>GFlow estimates the camera poses for each frame, enabling novel view synthesis by changing camera pose.
  arXiv  Detail & Related papers  (2024-05-28T17:59:22Z)
• DreamScene4D: Dynamic Multi-Object Scene Generation from Monocular Videos [21.93514516437402]
  We present DreamScene4D, the first approach to generate 3D dynamic scenes of multiple objects from monocular videos via novel view synthesis. Our key insight is a "decompose-recompose" approach that factorizes the video scene into the background and object tracks. We show extensive results on challenging DAVIS, Kubric, and self-captured videos with quantitative comparisons and a user preference study.
  arXiv  Detail & Related papers  (2024-05-03T17:55:34Z)
• Make-It-4D: Synthesizing a Consistent Long-Term Dynamic Scene Video from a Single Image [59.18564636990079]
  We study the problem of synthesizing a long-term dynamic video from only a single image. Existing methods either hallucinate inconsistent perpetual views or struggle with long camera trajectories. We present Make-It-4D, a novel method that can generate a consistent long-term dynamic video from a single image.
  arXiv  Detail & Related papers  (2023-08-20T12:53:50Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.