GOTLoc: General Outdoor Text-based Localization Using Scene Graph Retrieval with OpenStreetMap
- URL: http://arxiv.org/abs/2501.08575v1
- Date: Wed, 15 Jan 2025 04:51:10 GMT
- Title: GOTLoc: General Outdoor Text-based Localization Using Scene Graph Retrieval with OpenStreetMap
- Authors: Donghwi Jung, Keonwoo Kim, Seong-Woo Kim,
- Abstract summary: We propose GOTLoc, a robust localization method capable of operating even in outdoor environments where GPS signals are unavailable.
The method achieves this robust localization by leveraging comparisons between scene graphs generated from text descriptions and maps.
Our results demonstrate that the proposed method achieves accuracy comparable to algorithms relying on point cloud maps.
- Score: 4.51019574688293
- License:
- Abstract: We propose GOTLoc, a robust localization method capable of operating even in outdoor environments where GPS signals are unavailable. The method achieves this robust localization by leveraging comparisons between scene graphs generated from text descriptions and maps. Existing text-based localization studies typically represent maps as point clouds and identify the most similar scenes by comparing embeddings of text and point cloud data. However, point cloud maps have limited scalability as it is impractical to pre-generate maps for all outdoor spaces. Furthermore, their large data size makes it challenging to store and utilize them directly on actual robots. To address these issues, GOTLoc leverages compact data structures, such as scene graphs, to store spatial information, enabling individual robots to carry and utilize large amounts of map data. Additionally, by utilizing publicly available map data, such as OpenStreetMap, which provides global information on outdoor spaces, we eliminate the need for additional effort to create custom map data. For performance evaluation, we utilized the KITTI360Pose dataset in conjunction with corresponding OpenStreetMap data to compare the proposed method with existing approaches. Our results demonstrate that the proposed method achieves accuracy comparable to algorithms relying on point cloud maps. Moreover, in city-scale tests, GOTLoc required significantly less storage compared to point cloud-based methods and completed overall processing within a few seconds, validating its applicability to real-world robotics. Our code is available at https://github.com/donghwijung/GOTLoc.
Related papers
- FlexCloud: Direct, Modular Georeferencing and Drift-Correction of Point Cloud Maps [0.7421845364041001]
We propose FlexCloud for an automatic georeferencing of point cloud maps created from SLAM.
Our approach is designed to work modularly with different SLAM methods, utilizing only the generated local point cloud map.
Our approach enables the creation of consistent, globally referenced point cloud maps from data collected by a mobile mapping system.
arXiv Detail & Related papers (2025-02-01T10:56:05Z) - R-SCoRe: Revisiting Scene Coordinate Regression for Robust Large-Scale Visual Localization [66.87005863868181]
We introduce a covisibility graph-based global encoding learning and data augmentation strategy.
We revisit the network architecture and local feature extraction module.
Our method achieves state-of-the-art on challenging large-scale datasets without relying on network ensembles or 3D supervision.
arXiv Detail & Related papers (2025-01-02T18:59:08Z) - DUFOMap: Efficient Dynamic Awareness Mapping [3.3580006471376205]
The dynamic nature of the real world is one of the main challenges in robotics.
Current solutions are often applied in post-processing, where parameter tuning allows the user to adjust the setting for a specific dataset.
We propose DUFOMap, a novel dynamic awareness mapping framework designed for efficient online processing.
arXiv Detail & Related papers (2024-03-03T09:07:16Z) - Loopy-SLAM: Dense Neural SLAM with Loop Closures [53.11936461015725]
We introduce Loopy-SLAM that globally optimize poses and the dense 3D model.
We use frame-to-model tracking using a data-driven point-based submap generation method and trigger loop closures online by performing global place recognition.
Evaluation on the synthetic Replica and real-world TUM-RGBD and ScanNet datasets demonstrate competitive or superior performance in tracking, mapping, and rendering accuracy when compared to existing dense neural RGBD SLAM methods.
arXiv Detail & Related papers (2024-02-14T18:18:32Z) - Neural Implicit Dense Semantic SLAM [83.04331351572277]
We propose a novel RGBD vSLAM algorithm that learns a memory-efficient, dense 3D geometry, and semantic segmentation of an indoor scene in an online manner.
Our pipeline combines classical 3D vision-based tracking and loop closing with neural fields-based mapping.
Our proposed algorithm can greatly enhance scene perception and assist with a range of robot control problems.
arXiv Detail & Related papers (2023-04-27T23:03:52Z) - A Map-matching Algorithm with Extraction of Multi-group Information for
Low-frequency Data [9.476212160807549]
This paper designs a new map-matching method to make full use of "Big data"
We sort all data into four groups according to their spatial and temporal distance from the present matching probe.
We use a modified top-K shortest-path method to search the candidate paths within an ellipse region and then use the fused score to infer the path.
arXiv Detail & Related papers (2022-09-18T08:09:17Z) - Robust Self-Tuning Data Association for Geo-Referencing Using Lane Markings [44.4879068879732]
This paper presents a complete pipeline for resolving ambiguities during the data association.
Its core is a robust self-tuning data association that adapts the search area depending on the entropy of the measurements.
We evaluate our method on real data from urban and rural scenarios around the city of Karlsruhe in Germany.
arXiv Detail & Related papers (2022-07-28T12:29:39Z) - Long-term Visual Map Sparsification with Heterogeneous GNN [47.12309045366042]
In this paper, we aim to overcome the environmental changes and reduce the map size at the same time by selecting points that are valuable to future localization.
Inspired by the recent progress in Graph Neural Network(GNN), we propose the first work that models SfM maps as heterogeneous graphs and predicts 3D point importance scores with a GNN.
Two novel supervisions are proposed: 1) a data-fitting term for selecting valuable points to future localization based on training queries; 2) a K-Cover term for selecting sparse points with full map coverage.
arXiv Detail & Related papers (2022-03-29T01:46:12Z) - GANmapper: geographical content filling [0.0]
We present a new method to create spatial data using a generative adversarial network (GAN)
Our contribution uses coarse and widely available geospatial data to create maps of less available features at the finer scale in the built environment.
We employ land use data and road networks as input to generate building footprints, and conduct experiments in 9 cities around the world.
arXiv Detail & Related papers (2021-08-07T05:50:54Z) - Towards Semantic Segmentation of Urban-Scale 3D Point Clouds: A Dataset,
Benchmarks and Challenges [52.624157840253204]
We present an urban-scale photogrammetric point cloud dataset with nearly three billion richly annotated points.
Our dataset consists of large areas from three UK cities, covering about 7.6 km2 of the city landscape.
We evaluate the performance of state-of-the-art algorithms on our dataset and provide a comprehensive analysis of the results.
arXiv Detail & Related papers (2020-09-07T14:47:07Z) - Rethinking Localization Map: Towards Accurate Object Perception with
Self-Enhancement Maps [78.2581910688094]
This work introduces a novel self-enhancement method to harvest accurate object localization maps and object boundaries with only category labels as supervision.
In particular, the proposed Self-Enhancement Maps achieve the state-of-the-art localization accuracy of 54.88% on ILSVRC.
arXiv Detail & Related papers (2020-06-09T12:35:55Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.