4D Reconstruction from Sparse Dynamic Cameras

• URL: http://arxiv.org/abs/2606.04593v1
• Date: Wed, 03 Jun 2026 08:31:43 GMT
• Title: 4D Reconstruction from Sparse Dynamic Cameras
• Abstract summary: We focus on an alternative practical way, i.e. sparse dynamic camera setup, where a handful of cameras capture the same subjects.<n>This setup introduces multi-view constraints and remains practical for real-world video production such as sports, concerts, and TV shows.<n>We introduce LetCamsGo, a new real-world video dataset with 5 sequences across 4 diverse environments recorded by three independently moving cameras and one fixed camera.
• Score: 32.72043828725801
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Although dynamic 3D (i.e., 4D) reconstruction from a monocular dynamic camera has recently advanced, it remains fundamentally limited by depth ambiguity. In this paper, we focus on an alternative practical way, i.e., sparse dynamic camera setup, where a handful of independently moving cameras capture the same subjects. While keeping capture costs low, this setup introduces multi-view constraints and remains practical for real-world video production such as sports, concerts, and TV shows. Despite its potential, our experiments show that naive extensions of existing monocular or dense-fixed camera-based methods are insufficient since they fail to resolve the complex spatiotemporal inconsistencies across views and time. To fill this gap, we propose a simple yet effective 3D track initialization method designed to ensure spatiotemporal consistency by integrating inter-camera feature matching with intra-camera point tracking. Additionally, we incorporate a noise-robust depth-ordering regularization loss and a spatiotemporally diverse batch sampling strategy to enhance optimization stability and cross-view generalization. Furthermore, to address the lack of standardized benchmarks for this task, we introduce LetCamsGo, a new real-world video dataset with 5 sequences across 4 diverse environments, recorded by three independently moving cameras and one fixed camera. Comprehensive benchmarking on LetCamsGo demonstrated that our proposed framework improves 4D reconstruction quality in dynamic regions compared with baselines, paving the way for a low-cost 4D reconstruction paradigm in the wild.

Related papers

• SparseCam4D: Spatio-Temporally Consistent 4D Reconstruction from Sparse Cameras [13.258108161849727]
  High-quality dynamic scenes typically require dense arrays or even hundreds of synchronized cameras.<n>We propose a sparse-camera dynamic reconstruction framework that exploits abundant yet inconsistent generative observations.<n>We develop a complete pipeline that enables 4D reconstruction from sparse and uncalibrated camera inputs.
  arXiv  Detail & Related papers  (2026-03-27T14:44:52Z)
• Dense Dynamic Scene Reconstruction and Camera Pose Estimation from Multi-View Videos [14.791378262503967]
  We address the challenging problem of dense dynamic scene reconstruction and camera pose estimation from multiple cameras.<n>We propose a two-stage optimization framework that decouples the task robust camera tracking and dense depth.<n>Our method significantly outperforms state-of-the-art feed-forward models on both synthetic and real-world benchmarks.
  arXiv  Detail & Related papers  (2026-03-12T15:31:32Z)
• Dynamic Gaussian Scene Reconstruction from Unsynchronized Videos [31.54046494140498]
  Multi-view video reconstruction plays a vital role in computer vision, enabling applications in film production, virtual reality, and motion analysis.<n>We propose a novel temporal alignment strategy for high-quality 4DGS reconstruction from unsynchronized multi-view videos.
  arXiv  Detail & Related papers  (2025-11-14T11:20:43Z)
• C4D: 4D Made from 3D through Dual Correspondences [77.04731692213663]
  We introduce C4D, a framework that leverages temporal correspondences to extend existing 3D reconstruction formulation to 4D.<n>C4D captures two types of correspondences: short-term optical flow and long-term point tracking.<n>We train a dynamic-aware point tracker that provides additional mobility information.
  arXiv  Detail & Related papers  (2025-10-16T17:59:06Z)
• GaVS: 3D-Grounded Video Stabilization via Temporally-Consistent Local Reconstruction and Rendering [54.489285024494855]
  Video stabilization is pivotal for video processing, as it removes unwanted shakiness while preserving the original user motion intent.<n>Existing approaches, depending on the domain they operate, suffer from several issues that degrade the user experience.<n>We introduce textbfGaVS, a novel 3D-grounded approach that reformulates video stabilization as a temporally-consistent local reconstruction and rendering' paradigm.
  arXiv  Detail & Related papers  (2025-06-30T15:24:27Z)
• Easi3R: Estimating Disentangled Motion from DUSt3R Without Training [69.51086319339662]
  We introduce Easi3R, a simple yet efficient training-free method for 4D reconstruction.<n>Our approach applies attention adaptation during inference, eliminating the need for from-scratch pre-training or network fine-tuning.<n>Our experiments on real-world dynamic videos demonstrate that our lightweight attention adaptation significantly outperforms previous state-of-the-art methods.
  arXiv  Detail & Related papers  (2025-03-31T17:59:58Z)
• Dyn-HaMR: Recovering 4D Interacting Hand Motion from a Dynamic Camera [49.82535393220003]
  Dyn-HaMR is the first approach to reconstruct 4D global hand motion from monocular videos recorded by dynamic cameras in the wild.<n>We show that our approach significantly outperforms state-of-the-art methods in terms of 4D global mesh recovery.<n>This establishes a new benchmark for hand motion reconstruction from monocular video with moving cameras.
  arXiv  Detail & Related papers  (2024-12-17T12:43:10Z)
• Driv3R: Learning Dense 4D Reconstruction for Autonomous Driving [116.10577967146762]
  We propose Driv3R, a framework that directly regresses per-frame point maps from multi-view image sequences.<n>We employ a 4D flow predictor to identify moving objects within the scene to direct our network focus more on reconstructing these dynamic regions.<n>Driv3R outperforms previous frameworks in 4D dynamic scene reconstruction, achieving 15x faster inference speed.
  arXiv  Detail & Related papers  (2024-12-09T18:58:03Z)
• DRSM: efficient neural 4d decomposition for dynamic reconstruction in stationary monocular cameras [21.07910546072467]
  We present a novel framework to tackle 4D decomposition problem for dynamic scenes in monocular cameras. Our framework utilizes decomposed static and dynamic feature planes to represent 4D scenes and emphasizes the learning of dynamic regions through dense ray casting.
  arXiv  Detail & Related papers  (2024-02-01T16:38:51Z)
• R3D3: Dense 3D Reconstruction of Dynamic Scenes from Multiple Cameras [106.52409577316389]
  R3D3 is a multi-camera system for dense 3D reconstruction and ego-motion estimation. Our approach exploits spatial-temporal information from multiple cameras, and monocular depth refinement. We show that this design enables a dense, consistent 3D reconstruction of challenging, dynamic outdoor environments.
  arXiv  Detail & Related papers  (2023-08-28T17:13:49Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.