Visual Loop Closure Detection Through Deep Graph Consensus
- URL: http://arxiv.org/abs/2505.21754v1
- Date: Tue, 27 May 2025 20:42:47 GMT
- Title: Visual Loop Closure Detection Through Deep Graph Consensus
- Authors: Martin Büchner, Liza Dahiya, Simon Dorer, Vipul Ramtekkar, Kenji Nishimiya, Daniele Cattaneo, Abhinav Valada,
- Abstract summary: We introduce LoopGNN, a graph neural network architecture that estimates loop closure consensus by leveraging geometrics of visually similars retrieved through place recognition.<n>Our method yields high-precision estimates while maintaining high recall.
- Score: 7.744347341643204
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Visual loop closure detection traditionally relies on place recognition methods to retrieve candidate loops that are validated using computationally expensive RANSAC-based geometric verification. As false positive loop closures significantly degrade downstream pose graph estimates, verifying a large number of candidates in online simultaneous localization and mapping scenarios is constrained by limited time and compute resources. While most deep loop closure detection approaches only operate on pairs of keyframes, we relax this constraint by considering neighborhoods of multiple keyframes when detecting loops. In this work, we introduce LoopGNN, a graph neural network architecture that estimates loop closure consensus by leveraging cliques of visually similar keyframes retrieved through place recognition. By propagating deep feature encodings among nodes of the clique, our method yields high-precision estimates while maintaining high recall. Extensive experimental evaluations on the TartanDrive 2.0 and NCLT datasets demonstrate that LoopGNN outperforms traditional baselines. Additionally, an ablation study across various keypoint extractors demonstrates that our method is robust, regardless of the type of deep feature encodings used, and exhibits higher computational efficiency compared to classical geometric verification baselines. We release our code, supplementary material, and keyframe data at https://loopgnn.cs.uni-freiburg.de.
Related papers
- LoopNet: A Multitasking Few-Shot Learning Approach for Loop Closure in Large Scale SLAM [0.0]
We tackle the two main problems of real-time SLAM systems: 1) loop closure detection accuracy and 2) real-time constraints on the embedded hardware.<n>Our LoopNet method is based on a multitasking variant of the classical ResNet architecture, adapted for online retraining on a dynamic visual dataset and optimized for embedded devices.
arXiv Detail & Related papers (2025-07-20T20:11:37Z) - REGRACE: A Robust and Efficient Graph-based Re-localization Algorithm using Consistency Evaluation [23.41000678070751]
Loop closures are essential for correcting odometry drift and creating consistent maps.<n>Current methods using dense point clouds for accurate place recognition do not scale well due to computationally expensive scan-to-scan comparisons.<n>We introduce REGRACE, a novel approach that addresses these challenges of scalability and perspective difference in re-localization.
arXiv Detail & Related papers (2025-03-05T15:32:38Z) - LiDAR Loop Closure Detection using Semantic Graphs with Graph Attention Networks [12.33137981696787]
We propose a novel loop closure detection algorithm that uses graph attention neural networks to encode semantic graphs.<n>We then use semantic registration to estimate the 6 DoF relative pose constraint.<n>For the benefit of the community, we open-source the complete implementation of our proposed algorithm.
arXiv Detail & Related papers (2025-01-31T18:36:04Z) - GV-Bench: Benchmarking Local Feature Matching for Geometric Verification of Long-term Loop Closure Detection [32.54601978758081]
Loop closures correct drifts in trajectory estimation to build a globally consistent map.
A false loop closure can be fatal, so verification is required as an additional step to ensure robustness.
This paper proposes a unified benchmark targeting geometric verification of loop closure detection under long-term conditional variations.
arXiv Detail & Related papers (2024-07-16T14:05:19Z) - Deep Homography Estimation for Visual Place Recognition [49.235432979736395]
We propose a transformer-based deep homography estimation (DHE) network.
It takes the dense feature map extracted by a backbone network as input and fits homography for fast and learnable geometric verification.
Experiments on benchmark datasets show that our method can outperform several state-of-the-art methods.
arXiv Detail & Related papers (2024-02-25T13:22:17Z) - Learning Feature Matching via Matchable Keypoint-Assisted Graph Neural
Network [52.29330138835208]
Accurately matching local features between a pair of images is a challenging computer vision task.
Previous studies typically use attention based graph neural networks (GNNs) with fully-connected graphs over keypoints within/across images.
We propose MaKeGNN, a sparse attention-based GNN architecture which bypasses non-repeatable keypoints and leverages matchable ones to guide message passing.
arXiv Detail & Related papers (2023-07-04T02:50:44Z) - Benchmarking Node Outlier Detection on Graphs [90.29966986023403]
Graph outlier detection is an emerging but crucial machine learning task with numerous applications.
We present the first comprehensive unsupervised node outlier detection benchmark for graphs called UNOD.
arXiv Detail & Related papers (2022-06-21T01:46:38Z) - Accurate Grid Keypoint Learning for Efficient Video Prediction [87.71109421608232]
Keypoint-based video prediction methods can consume substantial computing resources in training and deployment.
In this paper, we design a new grid keypoint learning framework, aiming at a robust and explainable intermediate keypoint representation for long-term efficient video prediction.
Our method outperforms the state-ofthe-art video prediction methods while saves 98% more than computing resources.
arXiv Detail & Related papers (2021-07-28T05:04:30Z) - Dense Label Encoding for Boundary Discontinuity Free Rotation Detection [69.75559390700887]
This paper explores a relatively less-studied methodology based on classification.
We propose new techniques to push its frontier in two aspects.
Experiments and visual analysis on large-scale public datasets for aerial images show the effectiveness of our approach.
arXiv Detail & Related papers (2020-11-19T05:42:02Z) - Fast and Incremental Loop Closure Detection with Deep Features and
Proximity Graphs [13.328790865796224]
This article proposes an appearance-based loop closure detection pipeline named FILD++"
The system is fed by consecutive images and, via passing them twice through a single convolutional neural network, global and local deep features are extracted.
An image-to-image pairing follows, which exploits local features to evaluate the spatial information.
arXiv Detail & Related papers (2020-09-29T02:42:47Z) - Learning to Hash with Graph Neural Networks for Recommender Systems [103.82479899868191]
Graph representation learning has attracted much attention in supporting high quality candidate search at scale.
Despite its effectiveness in learning embedding vectors for objects in the user-item interaction network, the computational costs to infer users' preferences in continuous embedding space are tremendous.
We propose a simple yet effective discrete representation learning framework to jointly learn continuous and discrete codes.
arXiv Detail & Related papers (2020-03-04T06:59:56Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.