TARS: Timestep-Aware Data Scaling for 3D-Free Video Re-Shooting

• URL: http://arxiv.org/abs/2607.28261v2
• Date: Sun, 02 Aug 2026 14:44:50 GMT
• Title: TARS: Timestep-Aware Data Scaling for 3D-Free Video Re-Shooting
• Abstract summary: Video re-shooting aims to regenerate videos with controllable camera motion and viewpoint.<n> TARS provides more accurate and temporally consistent camera control than prior methods.
• Score: 17.23436401314677
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Video re-shooting aims to regenerate videos with controllable camera motion and viewpoint. Existing methods rely on explicit 3D priors, which are limited by reconstruction quality and often perform poorly when synthesizing previously unseen regions, or on paired videos with different camera trajectories, whose scarcity hinders generalization. We revisit video re-shooting through text-driven semantic viewpoint specification, enabling control over shot scale, viewing angle, and first-/third-person perspective. To this end, we propose TARS, a 3D-free video re-shooting paradigm. Timestep-wise sensitivity analysis reveals that camera motion is primarily established during high-noise stages, where coarse spatiotemporal structures are formed. Based on this insight, we introduce self-supervised training to learn camera dynamics and fundamental visual representations without paired re-shooting data or 3D reconstruction. Through data scaling and joint textual-camera conditioning, TARS supports robust camera and viewpoint control, plausibly synthesizing regions beyond the source view under large camera motions while enabling reverse-angle re-shooting and perspective switching. Extensive experiments show that TARS provides more accurate and temporally consistent camera control than prior methods. Project Page: https://ymlinfeng.github.io/TARS.github.io/

Related papers

• GeoStream: Toward Precise Camera Controlled Streaming Video Generation [85.01823220801256]
  Existing approaches learn camera motion implicitly, leading to inaccurate control under out-of-distribution trajectories.<n>Explicit geometric conditioning improves controllability, but existing methods are non-autoregressive.<n>We propose GeoStream, a framework that enables precise metric-scale camera control in autoregressive streaming video generation.
  arXiv  Detail & Related papers  (2026-06-13T07:18:04Z)
• Geo-Align: Video Generation Alignment via Metric Geometry Reward [53.65904111864641]
  Geo-Align is the first Reinforcement Learning framework specifically designed for camera-controlled video re-rendering.<n>Built upon a pretrained model, we optimize the model through a scale-aware perceptual reward mechanism.<n>Experiments demonstrate that Geo-Align consistently outperforms existing supervised learning baselines in both precise camera controllability and visual fidelity.
  arXiv  Detail & Related papers  (2026-05-22T17:59:43Z)
• Warp-as-History: Generalizable Camera-Controlled Video Generation from One Training Video [19.675672131137382]
  We propose a simple interface that turns camera-induced warps into camera-warped pseudo-history.<n>We align its positional encoding with the target frames being denoised and remove warped-history tokens without valid source observations.<n>Our method improves camera adherence, visual quality, and motion dynamics without test-time optimization or target-video adaptation.
  arXiv  Detail & Related papers  (2026-05-14T17:58:26Z)
• CamPilot: Improving Camera Control in Video Diffusion Model with Efficient Camera Reward Feedback [43.174121093566264]
  We build upon Reward Feedback Learning and aim to further improve camera controllability.<n>Current reward models lack the capacity to assess video-camera alignment.<n>We introduce an efficient camera-aware 3D decoder that decodes video latent into 3D representations for reward quantization.
  arXiv  Detail & Related papers  (2026-01-22T18:59:56Z)
• Beyond Inpainting: Unleash 3D Understanding for Precise Camera-Controlled Video Generation [21.084121261693365]
  We propose DepthDirector, a video re-rendering framework with precise camera controllability.<n>By leveraging the depth video from explicit 3D representation as camera-control guidance, our method can faithfully reproduce the dynamic scene of an input video under novel camera trajectories.
  arXiv  Detail & Related papers  (2026-01-15T09:26:45Z)
• GaVS: 3D-Grounded Video Stabilization via Temporally-Consistent Local Reconstruction and Rendering [54.489285024494855]
  Video stabilization is pivotal for video processing, as it removes unwanted shakiness while preserving the original user motion intent.<n>Existing approaches, depending on the domain they operate, suffer from several issues that degrade the user experience.<n>We introduce textbfGaVS, a novel 3D-grounded approach that reformulates video stabilization as a temporally-consistent local reconstruction and rendering' paradigm.
  arXiv  Detail & Related papers  (2025-06-30T15:24:27Z)
• Large-scale visual SLAM for in-the-wild videos [28.58692815339531]
  We introduce a robust pipeline designed to improve 3D reconstruction from casual videos.<n>We build upon recent deep visual odometry methods but increase robustness in several ways.<n>We demonstrate large-scale contiguous 3D models from several online videos in various environments.
  arXiv  Detail & Related papers  (2025-04-29T07:37:51Z)
• GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Control [88.90505842498823]
  We present GEN3C, a generative video model with precise Camera Control and temporal 3D Consistency.<n>Our results demonstrate more precise camera control than prior work, as well as state-of-the-art results in sparse-view novel view synthesis.
  arXiv  Detail & Related papers  (2025-03-05T18:59:50Z)
• AC3D: Analyzing and Improving 3D Camera Control in Video Diffusion Transformers [66.29824750770389]
  We analyze camera motion from a first principles perspective, uncovering insights that enable precise 3D camera manipulation.<n>We compound these findings to design the Advanced 3D Camera Control (AC3D) architecture.
  arXiv  Detail & Related papers  (2024-11-27T18:49:13Z)
• VD3D: Taming Large Video Diffusion Transformers for 3D Camera Control [74.5434726968562]
  We show how to tame transformers video for 3D camera control using a ControlNet-like conditioning mechanism.<n>Our work is the first to enable camera control for transformer-based video diffusion models.
  arXiv  Detail & Related papers  (2024-07-17T17:59:05Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.