Global Structure-from-Motion Meets Feedforward Reconstruction
- URL: http://arxiv.org/abs/2605.26103v2
- Date: Tue, 26 May 2026 06:05:29 GMT
- Title: Global Structure-from-Motion Meets Feedforward Reconstruction
- Abstract summary: Structure-from-Motion is a central challenge in computer vision.<n>Recent advances in feedforward 3D reconstruction have made significant strides in overcoming persistent failure cases of classical SfM methods.<n>We propose a new Structure-from-Motion pipeline by combining the respective strengths of classical and feedforward methods.
- Score: 50.69771349993019
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Structure-from-Motion -- the process of simultaneously estimating camera poses and 3D scene structure from a collection of images -- remains a central challenge in computer vision, with many open problems yet to be solved. Recent advances in feedforward 3D reconstruction have made significant strides in overcoming persistent failure cases of classical SfM methods, particularly in scenarios characterized by low texture, limited overlap, and symmetries. However, while feedforward approaches excel in these challenging conditions, they often face limitations regarding scalability, accuracy, or robustness, and typically fall short of classical methods in standard reconstruction settings. In this work, we systematically analyze these limitations and propose a new Structure-from-Motion pipeline by combining the respective strengths of classical and feedforward methods. Extensive experiments across multiple datasets show the benefits of our approach, achieving state-of-the-art results across a wide range of scenarios. We share our system as an open-source implementation at https://github.com/colmap/gluemap.
Related papers
- Long-Term Multi-Session 3D Reconstruction Under Substantial Appearance Change [52.46888249268445]
Long-term environmental monitoring requires the ability to reconstruct and align 3D models across repeated site visits separated by months or years.<n>Existing approaches rely on post-hoc alignment of independently reconstructed sessions.<n>We propose enforcing cross-session correspondences directly within a joint SfM reconstruction.
arXiv Detail & Related papers (2026-02-24T06:12:51Z) - 3D Reconstruction via Incremental Structure From Motion [1.4999444543328293]
We present a detailed implementation of the incremental SfM pipeline, focusing on the consistency of geometric estimation and the effect of iterative refinement through bundle adjustment.<n>Results support the practical utility of incremental SfM as a reliable method for sparse 3D reconstruction in visually structured environments.
arXiv Detail & Related papers (2025-08-01T18:45:05Z) - Review of Feed-forward 3D Reconstruction: From DUSt3R to VGGT [10.984522161856955]
3D reconstruction is a cornerstone technology for numerous applications, including augmented/virtual reality, autonomous driving, and robotics.<n>Deep learning has catalyzed a paradigm shift in 3D reconstruction.<n>New models employ a unified deep network to jointly infer camera poses and dense geometry directly from an Unconstrained set of images in a single forward pass.
arXiv Detail & Related papers (2025-07-11T09:41:54Z) - Occlusion-Aware Temporally Consistent Amodal Completion for 3D Human-Object Interaction Reconstruction [29.807994561746437]
We introduce a novel framework for reconstructing dynamic human-object interactions from monocular video.<n>Our method integrates temporal context, enforcing coherence across video sequences to incrementally refine and stabilize reconstructions.<n>We validate our approach using 3D Gaussian Splatting on challenging monocular videos.
arXiv Detail & Related papers (2025-07-10T19:56:10Z) - Intern-GS: Vision Model Guided Sparse-View 3D Gaussian Splatting [95.61137026932062]
Intern-GS is a novel approach to enhance the process of sparse-view Gaussian splatting.<n>We show that Intern-GS achieves state-of-the-art rendering quality across diverse datasets.
arXiv Detail & Related papers (2025-05-27T05:17:49Z) - MP-SfM: Monocular Surface Priors for Robust Structure-from-Motion [57.261421172249044]
We present a novel approach to structure-from-Motion (SfM)<n>We show that our approach significantly outperforms existing ones under extreme viewpoint changes.<n>We also show that monocular priors can help reject faulty associations due to symmetries.
arXiv Detail & Related papers (2025-04-28T17:59:52Z) - Robust Incremental Structure-from-Motion with Hybrid Features [73.55745864762703]
We introduce an incremental Structure-from-Motion (SfM) system that leverages lines and their structured geometric relations.
Our system is consistently more robust and accurate compared to the widely used point-based state of the art in SfM.
arXiv Detail & Related papers (2024-09-29T22:20:32Z) - MASt3R-SfM: a Fully-Integrated Solution for Unconstrained Structure-from-Motion [12.602510002753815]
We build upon a recently released foundation model for 3D vision that can robustly produce local 3D reconstructions and accurate matches.
We introduce a low-memory approach to accurately align these local reconstructions in a global coordinate system.
Our novel SfM pipeline is simple, scalable, fast and truly unconstrained, i.e. it can handle any collection of images, ordered or not.
arXiv Detail & Related papers (2024-09-27T21:29:58Z) - Distance Weighted Trans Network for Image Completion [52.318730994423106]
We propose a new architecture that relies on Distance-based Weighted Transformer (DWT) to better understand the relationships between an image's components.
CNNs are used to augment the local texture information of coarse priors.
DWT blocks are used to recover certain coarse textures and coherent visual structures.
arXiv Detail & Related papers (2023-10-11T12:46:11Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.