VidMap: Exploiting Temporal Structure for Video-Based Structure-from-Motion

• URL: http://arxiv.org/abs/2607.27194v1
• Date: Wed, 29 Jul 2026 17:58:04 GMT
• Title: VidMap: Exploiting Temporal Structure for Video-Based Structure-from-Motion
• Abstract summary: We introduce a system that combines the strong sequential constraints of SLAM with the flexibility and global optimization of offline SfM.<n>Our approach is significantly more robust and accurate than both state-of-the-art SLAM and SfM, classical or learned, with given or unknown camera calibration.
• Score: 53.78826038875198
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Accurately recovering the camera's calibration and metric poses for any unconstrained video would unlock large-scale training data for navigation and scene understanding. The dominant approaches to this problem are severely limited: Simultaneous Localization and Mapping (SLAM) is sensitive to initialization and transient failures due to its causal, incremental nature; it is often over-optimized for real-time operation and generally requires known camera calibration; while Structure-from-Motion (SfM) typically forgoes any image ordering, enabling optimal initialization and global optimization, but lacks robustness to visual symmetries and extreme motions. To bridge this gap, we introduce a system that combines the strong sequential constraints of SLAM with the flexibility and global optimization of offline SfM, enabling the metric reconstruction of arbitrary, long, uncalibrated videos. This system leverages recent advances in wide-baseline dense image matching, treats temporal ordering as a first-class citizen for reliable loop closure, and augments global optimization with metric monocular depth priors. As a result, thorough evaluations on diverse, challenging datasets that exhibit extreme motion and visual symmetries reveal that our approach is significantly more robust and accurate than both state-of-the-art SLAM and SfM, classical or learned, with given or unknown camera calibration. The code is publicly available at https://github.com/cvg/vidmap.

Related papers

• DGSfM: Depth-Guided Scale-Aware Global Structure-from-Motion [40.127097529332815]
  We propose DGSfM, a depth-aware global SfM pipeline that uses monocular depth maps as a scalable prior.<n>For each image pair, we use a depth-aware relative pose solver to convert scale-ambiguous epipolar constraints into scale-aware relative pose constraints.<n>Experiments on ETH3D and IMC2021 show that DGSfM consistently improves over strong global SfM baselines across sparse and dense matching front-ends.
  arXiv  Detail & Related papers  (2026-07-10T15:18:37Z)
• InstantSfM: Fully Sparse and Parallel Structure-from-Motion [18.540622250926624]
  Structure-from-Motion (SfM) is a method that recovers camera poses and scene geometry from uncalibrated images.<n> GLOMAP, naive CPU-specialized implementations of bundle adjustment (BA) or global positioning (GP) introduce significant computational overhead when handling large-scale scenarios.<n>In this paper, we unleash the full potential of GPU parallel computation to accelerate each critical stage of the standard SfM pipeline.
  arXiv  Detail & Related papers  (2025-10-15T08:58:05Z)
• Visual Odometry with Transformers [68.453547770334]
  We introduce Visual odometry Transformer (VoT), which processes sequences of monocular frames by extracting features.<n>Unlike prior methods, VoT directly predicts camera motion without estimating dense geometry and relies solely on camera poses for supervision.<n>VoT scales effectively with larger datasets, benefits substantially from stronger pre-trained backbones, generalizes across diverse camera motions and calibration settings, and outperforms traditional methods while running more than 3 times faster.
  arXiv  Detail & Related papers  (2025-10-02T17:00:14Z)
• PROFusion: Robust and Accurate Dense Reconstruction via Camera Pose Regression and Optimization [21.23419310544054]
  Real-time dense scene reconstruction is crucial for robotics.<n>Current RGB-D SLAM systems fail when cameras experience large viewpoint changes, fast motions, or sudden shaking.
  arXiv  Detail & Related papers  (2025-09-29T03:20:49Z)
• A Constrained Optimization Approach for Gaussian Splatting from Coarsely-posed Images and Noisy Lidar Point Clouds [37.043012716944496]
  We introduce a constrained optimization method for simultaneous camera pose estimation and 3D reconstruction.<n> Experiments demonstrate that the proposed method significantly outperforms the existing (multi-modal) 3DGS baseline.
  arXiv  Detail & Related papers  (2025-04-12T08:34:43Z)
• Query Quantized Neural SLAM [25.72309707436261]
  We propose query quantized neural SLAM to reduce variations of input for easier and faster overfitting a frame.<n>We report visual and numerical comparisons on widely used benchmarks to show our superiority over the latest methods in both reconstruction and camera tracking.
  arXiv  Detail & Related papers  (2024-12-21T04:08:18Z)
• Buffer Anytime: Zero-Shot Video Depth and Normal from Image Priors [54.8852848659663]
  Buffer Anytime is a framework for estimation of depth and normal maps (which we call geometric buffers) from video. We demonstrate high-quality video buffer estimation by leveraging single-image priors with temporal consistency constraints.
  arXiv  Detail & Related papers  (2024-11-26T09:28:32Z)
• Robust Incremental Structure-from-Motion with Hybrid Features [73.55745864762703]
  We introduce an incremental Structure-from-Motion (SfM) system that leverages lines and their structured geometric relations. Our system is consistently more robust and accurate compared to the widely used point-based state of the art in SfM.
  arXiv  Detail & Related papers  (2024-09-29T22:20:32Z)
• InstantSplat: Sparse-view Gaussian Splatting in Seconds [91.77050739918037]
  We introduce InstantSplat, a novel approach for addressing sparse-view 3D scene reconstruction at lightning-fast speed.<n>InstantSplat employs a self-supervised framework that optimize 3D scene representation and camera poses.<n>It achieves an acceleration of over 30x in reconstruction and improves visual quality (SSIM) from 0.3755 to 0.7624 compared to traditional SfM with 3D-GS.
  arXiv  Detail & Related papers  (2024-03-29T17:29:58Z)
• Pushing the Envelope of Rotation Averaging for Visual SLAM [69.7375052440794]
  We propose a novel optimization backbone for visual SLAM systems. We leverage averaging to improve the accuracy, efficiency and robustness of conventional monocular SLAM systems. Our approach can exhibit up to 10x faster with comparable accuracy against the state-art on public benchmarks.
  arXiv  Detail & Related papers  (2020-11-02T18:02:26Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.