Detector-Free Structure from Motion

• URL: http://arxiv.org/abs/2306.15669v1
• Date: Tue, 27 Jun 2023 17:59:39 GMT
• Title: Detector-Free Structure from Motion
• Abstract summary: We propose a new structure-from-motion framework to recover accurate camera poses and point clouds from unordered images. Our framework first reconstructs a coarse SfM model from quantized detector-free matches. Experiments demonstrate that the proposed framework outperforms existing detector-based SfM systems.
• Score: 63.5577809314603
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: We propose a new structure-from-motion framework to recover accurate camera poses and point clouds from unordered images. Traditional SfM systems typically rely on the successful detection of repeatable keypoints across multiple views as the first step, which is difficult for texture-poor scenes, and poor keypoint detection may break down the whole SfM system. We propose a new detector-free SfM framework to draw benefits from the recent success of detector-free matchers to avoid the early determination of keypoints, while solving the multi-view inconsistency issue of detector-free matchers. Specifically, our framework first reconstructs a coarse SfM model from quantized detector-free matches. Then, it refines the model by a novel iterative refinement pipeline, which iterates between an attention-based multi-view matching module to refine feature tracks and a geometry refinement module to improve the reconstruction accuracy. Experiments demonstrate that the proposed framework outperforms existing detector-based SfM systems on common benchmark datasets. We also collect a texture-poor SfM dataset to demonstrate the capability of our framework to reconstruct texture-poor scenes. Based on this framework, we take $\textit{first place}$ in Image Matching Challenge 2023.

Related papers

• LaP-Forensics: Latent-Pixel Consistency Guided Multimodal Reasoning for Deepfake Detection [11.780720481629837]
  We present LaP-Forensics, a framework that augments RGB semantics with reconstruction-based forensic evidence.<n> Independent projectors encode the RGB image and residual map before a structured Where-What-Why model predicts a textual analysis and an artifact mask.<n>Experiments show cross-generator detection on UniversalFakeDetect and competitive artifact localization on the official SynthScars benchmark.
  arXiv  Detail & Related papers  (2026-07-28T16:45:52Z)
• Exploring Spatiotemporal Feature Propagation for Video-Level Compressive Spectral Reconstruction: Dataset, Model and Benchmark [22.5556672954071]
  Spectral Compressive Imaging (SCI) has achieved remarkable success, unlocking significant potential for dynamic spectral vision.<n>Existing reconstruction methods, primarily image-based, suffer from two limitations.<n>The frame-by-frame reconstruction paradigm fails to ensure temporal consistency, which is crucial in the video perception.
  arXiv  Detail & Related papers  (2026-02-28T12:11:13Z)
• From Pairs to Sequences: Track-Aware Policy Gradients for Keypoint Detection [23.384541298514574]
  Keypoint-based matching is a fundamental component of modern 3D vision systems, such as Structure-from-Motion (SfM) and SLAM.<n>We introduce TraqPoint, a novel, end-to-end Reinforcement Learning framework designed to optimize keypoints directly on image sequences.<n>Our core innovation is a track-aware reward mechanism that jointly encourages the consistency and distinctiveness of keypoints across multiple views.
  arXiv  Detail & Related papers  (2026-02-24T07:24:25Z)
• Rethinking Infrared Small Target Detection: A Foundation-Driven Efficient Paradigm [17.63632082331749]
  Large-scale visual foundation models (VFMs) exhibit strong generalization across diverse visual domains, but their potential for single-frame infrared small target (SIRST) detection remains largely unexplored.<n>We propose a Foundation-Driven Efficient Paradigm (FDEP) which can seamlessly adapt to existing encoder-decoder-based methods and significantly improve accuracy without additional inference overhead.
  arXiv  Detail & Related papers  (2025-12-05T08:12:35Z)
• 3D Reconstruction via Incremental Structure From Motion [1.4999444543328293]
  We present a detailed implementation of the incremental SfM pipeline, focusing on the consistency of geometric estimation and the effect of iterative refinement through bundle adjustment.<n>Results support the practical utility of incremental SfM as a reliable method for sparse 3D reconstruction in visually structured environments.
  arXiv  Detail & Related papers  (2025-08-01T18:45:05Z)
• SiLVR: Scalable Lidar-Visual Radiance Field Reconstruction with Uncertainty Quantification [0.0]
  We present a neural radiance field (NeRF) based large-scale reconstruction system that fuses lidar and vision data. Our system adopts the state-of-the-art NeRF representation to additionally incorporate lidar. We demonstrate the reconstruction system using a multi-camera, lidar sensor suite in experiments involving both robot-mounted and handheld scanning.
  arXiv  Detail & Related papers  (2025-02-04T19:00:49Z)
• DiAD: A Diffusion-based Framework for Multi-class Anomaly Detection [55.48770333927732]
  We propose a Difusion-based Anomaly Detection (DiAD) framework for multi-class anomaly detection. It consists of a pixel-space autoencoder, a latent-space Semantic-Guided (SG) network with a connection to the stable diffusion's denoising network, and a feature-space pre-trained feature extractor. Experiments on MVTec-AD and VisA datasets demonstrate the effectiveness of our approach.
  arXiv  Detail & Related papers  (2023-12-11T18:38:28Z)
• Monte Carlo Linear Clustering with Single-Point Supervision is Enough for Infrared Small Target Detection [48.707233614642796]
  Single-frame infrared small target (SIRST) detection aims at separating small targets from clutter backgrounds on infrared images. Deep learning based methods have achieved promising performance on SIRST detection, but at the cost of a large amount of training data. We propose the first method to achieve SIRST detection with single-point supervision.
  arXiv  Detail & Related papers  (2023-04-10T08:04:05Z)
• PixMIM: Rethinking Pixel Reconstruction in Masked Image Modeling [83.67628239775878]
  Masked Image Modeling (MIM) has achieved promising progress with the advent of Masked Autoencoders (MAE) and BEiT. This paper undertakes a fundamental analysis of MIM from the perspective of pixel reconstruction. We propose a remarkably simple and effective method, ourmethod, that entails two strategies.
  arXiv  Detail & Related papers  (2023-03-04T13:38:51Z)
• Making Reconstruction-based Method Great Again for Video Anomaly Detection [64.19326819088563]
  Anomaly detection in videos is a significant yet challenging problem. Existing reconstruction-based methods rely on old-fashioned convolutional autoencoders. We propose a new autoencoder model for enhanced consecutive frame reconstruction.
  arXiv  Detail & Related papers  (2023-01-28T01:57:57Z)
• Single-pass Object-adaptive Data Undersampling and Reconstruction for MRI [6.599344783327054]
  We propose a data-driven sampler using a convolutional neural network, MNet, to provide object-specific sampling patterns adaptive to each scanned object. The network observes very limited low-frequency k-space data for each object and rapidly predicts the desired undersampling pattern. Experimental results on the fastMRI knee dataset demonstrate the ability of the proposed learned undersampling network to generate object-specific masks at fourfold and eightfold acceleration.
  arXiv  Detail & Related papers  (2021-11-17T16:06:06Z)
• Deep Keypoint-Based Camera Pose Estimation with Geometric Constraints [80.60538408386016]
  Estimating relative camera poses from consecutive frames is a fundamental problem in visual odometry. We propose an end-to-end trainable framework consisting of learnable modules for detection, feature extraction, matching and outlier rejection.
  arXiv  Detail & Related papers  (2020-07-29T21:41:31Z)
• One-Shot Object Detection without Fine-Tuning [62.39210447209698]
  We introduce a two-stage model consisting of a first stage Matching-FCOS network and a second stage Structure-Aware Relation Module. We also propose novel training strategies that effectively improve detection performance. Our method exceeds the state-of-the-art one-shot performance consistently on multiple datasets.
  arXiv  Detail & Related papers  (2020-05-08T01:59:23Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.