Stitch4D: Sparse Multi-Location 4D Urban Reconstruction via Spatio-Temporal Interpolation

• URL: http://arxiv.org/abs/2604.07923v1
• Date: Thu, 09 Apr 2026 07:45:51 GMT
• Title: Stitch4D: Sparse Multi-Location 4D Urban Reconstruction via Spatio-Temporal Interpolation
• Abstract summary: We propose a unified 4D reconstruction framework that explicitly compensates for missing spatial coverage in sparse observations.<n>By restoring intermediate coverage before optimization, Stitch4D prevents geometric collapse and reconstructs coherent geometry and smooth scene dynamics.<n> Experimental results on U-S4D show that Stitch4D surpasses representative 4D reconstruction baselines and achieves superior visual quality.
• Score: 5.878115656035432
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Dynamic urban environments are often captured by cameras placed at spatially separated locations with little or no view overlap. However, most existing 4D reconstruction methods assume densely overlapping views. When applied to such sparse observations, these methods fail to reconstruct intermediate regions and often introduce temporal artifacts. To address this practical yet underexplored sparse multi-location setting, we propose Stitch4D, a unified 4D reconstruction framework that explicitly compensates for missing spatial coverage in sparse observations. Stitch4D (i) synthesizes intermediate bridge views to densify spatial constraints and improve spatial coverage, and (ii) jointly optimizes real and synthesized observations within a unified coordinate frame under explicit inter-location consistency constraints. By restoring intermediate coverage before optimization, Stitch4D prevents geometric collapse and reconstructs coherent geometry and smooth scene dynamics even in sparsely observed environments. To evaluate this setting, we introduce Urban Sparse 4D (U-S4D), a CARLA-based benchmark designed to assess spatiotemporal alignment under sparse multi-location configurations. Experimental results on U-S4D show that Stitch4D surpasses representative 4D reconstruction baselines and achieves superior visual quality. These results indicate that recovering intermediate spatial coverage is essential for stable 4D reconstruction in sparse urban environments.

Related papers

• UniFusion: Sparse-View 4D Reconstruction via Unified Spatio-temporal Depth Alignment [14.151508266012463]
  A key challenge arises from limited cross-view overlap and temporal variation, making monocular depth predictions inconsistent across views time.<n>Existing methods align spatial and temporal dimensions in separate stages, requiring segmentation masks.<n>We propose a unified spatial-temporal depth alignment framework that resolves cross-view and cross-time inconsistencies without distinguishing/background.
  arXiv  Detail & Related papers  (2026-09-05T05:19:00Z)
• Crowd4D: Scene-Aware Monocular 4D Crowd Reconstruction [51.95664695509705]
  Crowd4D is a scene-aware 4D crowd reconstruction framework for large-scale video scenes.<n>It incorporates scene geometry and ensures consistency across image and scene spaces via a multi-stage optimization strategy.<n>Crowd4D consistently outperforms existing methods and enables robust monocular 4D crowd reconstruction in complex, large-scale real-world scenes.
  arXiv  Detail & Related papers  (2026-07-21T19:03:10Z)
• Not All Points Are Equal: Uncertainty-Aware 4D LiDAR Scene Synthesis [63.07333625429548]
  We present U4D, a new framework that explicitly leverages spatial uncertainty to guide LiDAR scene generation.<n>Experiments on nuScenes and Semantic KITTI demonstrate state-of-the-art scene fidelity, temporal consistency, and downstream performance.
  arXiv  Detail & Related papers  (2026-06-01T17:24:14Z)
• Ground4D: Spatially-Grounded Feedforward 4D Reconstruction for Unstructured Off-Road Scenes [15.758026389335669]
  Ground4D is a spatially-grounded 4D feedforward framework for pose-free off-road reconstruction.<n>In experiments on ORAD-3D and RELLIS-3D, Ground4D consistently outperforms existing feedforward methods in reconstruction quality.
  arXiv  Detail & Related papers  (2026-05-06T02:58:47Z)
• Face Anything: 4D Face Reconstruction from Any Image Sequence [49.395407357499074]
  We present a unified method for high-fidelity 4D facial reconstruction based on canonical facial point prediction.<n>By jointly predicting depth and canonical coordinates, our method enables accurate depth estimation, temporally stable reconstruction, dense 3D geometry, and robust facial point tracking.
  arXiv  Detail & Related papers  (2026-04-21T17:22:39Z)
• Orthogonal Spatial-temporal Distributional Transfer for 4D Generation [58.30004328671699]
  We propose a framework that transfers rich spatial priors from existing 3D diffusion models and temporal priors from video diffusion models to enhance 4D synthesis.<n>We develop a spatial-temporal-disentangled 4D (STD-4D) Diffusion model, which synthesizes 4D-aware videos through disentangled spatial and temporal latents.<n> Experiments demonstrate that our method significantly outperforms existing approaches, achieving superior spatial-temporal consistency and higher-quality 4D synthesis.
  arXiv  Detail & Related papers  (2026-03-05T11:52:21Z)
• 4RC: 4D Reconstruction via Conditional Querying Anytime and Anywhere [77.83037497484366]
  We present 4RC, a unified feed-forward framework for 4D reconstruction from monocular videos.<n>4RC learns a holistic 4D representation that jointly captures dense scene geometry and motion dynamics.
  arXiv  Detail & Related papers  (2026-02-10T18:57:04Z)
• Geometry-Consistent 4D Gaussian Splatting for Sparse-Input Dynamic View Synthesis [17.560425604804305]
  GC-4DGS is a novel framework that infuses geometric consistency into 4D Gaussian Splatting (4DGS)<n>This paper presents GC-4DGS, a novel framework that infuses geometric consistency into 4D Gaussian Splatting (4DGS)
  arXiv  Detail & Related papers  (2025-11-28T10:11:48Z)
• P-4DGS: Predictive 4D Gaussian Splatting with 90$\times$ Compression [26.130131551764077]
  3D Gaussian Splatting (3DGS) has garnered significant attention due to its superior scene representation fidelity and real-time rendering performance.<n>Despite achieving promising results, most existing algorithms overlook the substantial temporal and spatial redundancies inherent in dynamic scenes.<n>We propose P-4DGS, a novel dynamic 3DGS representation for compact 4D scene modeling.
  arXiv  Detail & Related papers  (2025-10-11T05:19:41Z)
• Free4D: Tuning-free 4D Scene Generation with Spatial-Temporal Consistency [49.875459658889355]
  Free4D is a tuning-free framework for 4D scene generation from a single image.<n>Our key insight is to distill pre-trained foundation models for consistent 4D scene representation.<n>The resulting 4D representation enables real-time, controllable rendering.
  arXiv  Detail & Related papers  (2025-03-26T17:59:44Z)
• DiST-4D: Disentangled Spatiotemporal Diffusion with Metric Depth for 4D Driving Scene Generation [50.01520547454224]
  Current generative models struggle to synthesize 4D driving scenes that simultaneously support temporal extrapolation and spatial novel view synthesis (NVS)<n>We propose DiST-4D, which disentangles the problem into two diffusion processes: DiST-T, which predicts future metric depth and multi-view RGB sequences directly from past observations, and DiST-S, which enables spatial NVS by training only on existing viewpoints while enforcing cycle consistency.<n>Experiments demonstrate that DiST-4D achieves state-of-the-art performance in both temporal prediction and NVS tasks, while also delivering competitive performance in planning-related evaluations.
  arXiv  Detail & Related papers  (2025-03-19T13:49:48Z)
• Driv3R: Learning Dense 4D Reconstruction for Autonomous Driving [116.10577967146762]
  We propose Driv3R, a framework that directly regresses per-frame point maps from multi-view image sequences.<n>We employ a 4D flow predictor to identify moving objects within the scene to direct our network focus more on reconstructing these dynamic regions.<n>Driv3R outperforms previous frameworks in 4D dynamic scene reconstruction, achieving 15x faster inference speed.
  arXiv  Detail & Related papers  (2024-12-09T18:58:03Z)
• 4DRecons: 4D Neural Implicit Deformable Objects Reconstruction from a single RGB-D Camera with Geometrical and Topological Regularizations [35.161541396566705]
  4DRecons encodes the output as a 4D neural implicit surface. We show that 4DRecons can handle large deformations and complex inter-part interactions.
  arXiv  Detail & Related papers  (2024-06-14T16:38:00Z)
• LoRD: Local 4D Implicit Representation for High-Fidelity Dynamic Human Modeling [69.56581851211841]
  We propose a novel Local 4D implicit Representation for Dynamic clothed human, named LoRD. Our key insight is to encourage the network to learn the latent codes of local part-level representation. LoRD has strong capability for representing 4D human, and outperforms state-of-the-art methods on practical applications.
  arXiv  Detail & Related papers  (2022-08-18T03:49:44Z)
• Learning Parallel Dense Correspondence from Spatio-Temporal Descriptors for Efficient and Robust 4D Reconstruction [43.60322886598972]
  This paper focuses on the task of 4D shape reconstruction from a sequence of point clouds. We present a novel pipeline to learn a temporal evolution of the 3D human shape through capturing continuous transformation functions among cross-frame occupancy fields.
  arXiv  Detail & Related papers  (2021-03-30T13:36:03Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.