Solving Short-Term Relocalization Problems In Monocular Keyframe Visual SLAM Using Spatial And Semantic Data

• URL: http://arxiv.org/abs/2407.19518v1
• Date: Sun, 28 Jul 2024 15:54:37 GMT
• Title: Solving Short-Term Relocalization Problems In Monocular Keyframe Visual SLAM Using Spatial And Semantic Data
• Abstract summary: This paper focuses on the development of robust short-term relocalization capabilities for mobile robots using a monocular camera system. A novel multimodal descriptor is introduced, that contains semantic information of objects detected in the environment. Using this descriptor, a new Keyframe-based Place Recognition (KPR) method is proposed that is formulated as a multi-stage filtering algorithm.
• Score: 1.2937020918620652
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: In Monocular Keyframe Visual Simultaneous Localization and Mapping (MKVSLAM) frameworks, when incremental position tracking fails, global pose has to be recovered in a short-time window, also known as short-term relocalization. This capability is crucial for mobile robots to have reliable navigation, build accurate maps, and have precise behaviors around human collaborators. This paper focuses on the development of robust short-term relocalization capabilities for mobile robots using a monocular camera system. A novel multimodal keyframe descriptor is introduced, that contains semantic information of objects detected in the environment and the spatial information of the camera. Using this descriptor, a new Keyframe-based Place Recognition (KPR) method is proposed that is formulated as a multi-stage keyframe filtering algorithm, leading to a new relocalization pipeline for MKVSLAM systems. The proposed approach is evaluated over several indoor GPS denied datasets and demonstrates accurate pose recovery, in comparison to a bag-of-words approach.

Related papers

• Compact Object-Level Representations with Open-Vocabulary Understanding for Indoor Visual Relocalization [93.79141221821858]
  OpenReLoc is a camera relocalization system designed to provide scene understanding and accurate pose estimation capabilities.<n>We propose a multi-modal mechanism to integrate open-vocabulary semantic knowledge for effective 2D-3D object matching.<n> Experimental results demonstrate that OpenReLoc achieves superior relocalization recall and accuracy across various datasets.
  arXiv  Detail & Related papers  (2026-06-23T16:27:04Z)
• Generative MIMO Beam Map Construction for Location Recovery and Beam Tracking [67.65578956523403]
  This paper proposes a generative framework to recover location labels directly from sparse channel state information (CSI) measurements.<n>Instead of directly storing raw CSI, we learn a compact low-dimensional radio map embedding and leverage a generative model to reconstruct the high-dimensional CSI.<n> Numerical experiments demonstrate that the proposed model can improve localization accuracy by over 30% and achieve a 20% capacity gain in non-line-of-sight (NLOS) scenarios.
  arXiv  Detail & Related papers  (2025-11-21T07:25:49Z)
• Semi-distributed Cross-modal Air-Ground Relative Localization [11.828259485114598]
  Current approaches for robot relative localization are primarily realized in the form of distributed multi-robot SLAM systems.<n>We fully leverage the high capacity of Unmanned Ground Vehicle (UGV) to integrate multiple sensors.<n>In this work, both the UGV and the Unmanned Aerial Vehicle (UAV) independently perform SLAM while extracting deep learning-based keypoints and global descriptors.
  arXiv  Detail & Related papers  (2025-11-10T06:28:31Z)
• Semantic-Aware Particle Filter for Reliable Vineyard Robot Localisation [4.0016757648498205]
  Localisation is critical for mobile robots in structured outdoor environments, yet LiDAR-based methods often fail in vineyards.<n>We propose a semantic particle filter that incorporates stable object-level detections, specifically vine trunks.<n>Semantic walls connect adjacent landmarks into pseudo-structural constraints that mitigate row aliasing.<n>Our approach maintains localisation within the correct row, recovers from deviations where AMCL fails, and outperforms vision-based SLAM methods such as RTAB-Map.
  arXiv  Detail & Related papers  (2025-09-22T19:04:31Z)
• Why Sample Space Matters: Keyframe Sampling Optimization for LiDAR-based Place Recognition [6.468510459310326]
  We introduce the concept of sample space in place recognition and demonstrate how different sampling techniques affect the query process and overall performance. We then present a novel sampling approach for LiDAR-based place recognition, which focuses on redundancy and information preservation in the hyper-dimensional descriptor space.
  arXiv  Detail & Related papers  (2024-10-03T16:29:47Z)
• RING#: PR-by-PE Global Localization with Roto-translation Equivariant Gram Learning [20.688641105430467]
  Global localization is crucial in autonomous driving and robotics applications when GPS signals are unreliable. Most approaches achieve global localization by sequential place recognition (PR) and pose estimation (PE) We introduce a new paradigm, PR-by-PE localization, which bypasses the need for separate place recognition by directly deriving it from pose estimation. We propose RING#, an end-to-end PR-by-PE localization network that operates in the bird's-eye-view (BEV) space, compatible with both vision and LiDAR sensors.
  arXiv  Detail & Related papers  (2024-08-30T18:42:53Z)
• OverlapMamba: Novel Shift State Space Model for LiDAR-based Place Recognition [10.39935021754015]
  We develop OverlapMamba, a novel network for place recognition as sequences. Our method effectively detects loop closures showing even when traversing previously visited locations from different directions. Relying on raw range view inputs, it outperforms typical LiDAR and multi-view combination methods in time complexity and speed.
  arXiv  Detail & Related papers  (2024-05-13T17:46:35Z)
• UnLoc: A Universal Localization Method for Autonomous Vehicles using LiDAR, Radar and/or Camera Input [51.150605800173366]
  UnLoc is a novel unified neural modeling approach for localization with multi-sensor input in all weather conditions. Our method is extensively evaluated on Oxford Radar RobotCar, ApolloSouthBay and Perth-WA datasets.
  arXiv  Detail & Related papers  (2023-07-03T04:10:55Z)
• Persistent Homology Meets Object Unity: Object Recognition in Clutter [2.356908851188234]
  Recognition of occluded objects in unseen and unstructured indoor environments is a challenging problem for mobile robots. We propose a new descriptor, TOPS, for point clouds generated from depth images and an accompanying recognition framework, THOR, inspired by human reasoning. THOR outperforms state-of-the-art methods on both the datasets and achieves substantially higher recognition accuracy for all the scenarios of the UW-IS Occluded dataset.
  arXiv  Detail & Related papers  (2023-05-05T19:42:39Z)
• Global-to-Local Modeling for Video-based 3D Human Pose and Shape Estimation [53.04781510348416]
  Video-based 3D human pose and shape estimations are evaluated by intra-frame accuracy and inter-frame smoothness. We propose to structurally decouple the modeling of long-term and short-term correlations in an end-to-end framework, Global-to-Local Transformer (GLoT) Our GLoT surpasses previous state-of-the-art methods with the lowest model parameters on popular benchmarks, i.e., 3DPW, MPI-INF-3DHP, and Human3.6M.
  arXiv  Detail & Related papers  (2023-03-26T14:57:49Z)
• HPointLoc: Point-based Indoor Place Recognition using Synthetic RGB-D Images [58.720142291102135]
  We present a novel dataset named as HPointLoc, specially designed for exploring capabilities of visual place recognition in indoor environment. The dataset is based on the popular Habitat simulator, in which it is possible to generate indoor scenes using both own sensor data and open datasets.
  arXiv  Detail & Related papers  (2022-12-30T12:20:56Z)
• Sparse Image based Navigation Architecture to Mitigate the need of precise Localization in Mobile Robots [3.1556608426768324]
  This paper focuses on mitigating the need for exact localization of a mobile robot to pursue autonomous navigation using a sparse set of images. The proposed method consists of a model architecture - RoomNet, for unsupervised learning resulting in a coarse identification of the environment. The latter uses sparse image matching to characterise the similarity of frames achieved vis-a-vis the frames viewed by the robot during the mapping and training stage.
  arXiv  Detail & Related papers  (2022-03-29T06:38:18Z)
• Unsupervised Metric Relocalization Using Transform Consistency Loss [66.19479868638925]
  Training networks to perform metric relocalization traditionally requires accurate image correspondences. We propose a self-supervised solution, which exploits a key insight: localizing a query image within a map should yield the same absolute pose, regardless of the reference image used for registration. We evaluate our framework on synthetic and real-world data, showing our approach outperforms other supervised methods when a limited amount of ground-truth information is available.
  arXiv  Detail & Related papers  (2020-11-01T19:24:27Z)
• POMP: Pomcp-based Online Motion Planning for active visual search in indoor environments [89.43830036483901]
  We focus on the problem of learning an optimal policy for Active Visual Search (AVS) of objects in known indoor environments with an online setup. Our POMP method uses as input the current pose of an agent and a RGB-D frame. We validate our method on the publicly available AVD benchmark, achieving an average success rate of 0.76 with an average path length of 17.1.
  arXiv  Detail & Related papers  (2020-09-17T08:23:50Z)
• Zero-Shot Multi-View Indoor Localization via Graph Location Networks [66.05980368549928]
  indoor localization is a fundamental problem in location-based applications. We propose a novel neural network based architecture Graph Location Networks (GLN) to perform infrastructure-free, multi-view image based indoor localization. GLN makes location predictions based on robust location representations extracted from images through message-passing networks. We introduce a novel zero-shot indoor localization setting and tackle it by extending the proposed GLN to a dedicated zero-shot version.
  arXiv  Detail & Related papers  (2020-08-06T07:36:55Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.