Spotter: Efficient Urban Visual Localization via Geo-Referenced Facade Landmarks in GPS-Degraded Environments
- URL: http://arxiv.org/abs/2608.23290v1
- Date: Mon, 24 Aug 2026 14:15:25 GMT
- Title: Spotter: Efficient Urban Visual Localization via Geo-Referenced Facade Landmarks in GPS-Degraded Environments
- Abstract summary: Spotter is a real-time visual localization framework for robotic and wearable platforms.<n>It processes Google Street View panoramas by semantically segmenting facades and pairing multi-view stereo depth with cartographic data.<n>At runtime, query images are matched via a cascaded retrieval and geometric verification pipeline to recover fine-grained global camera localization.
- Score: 0.5371337604556311
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Accurate visual localization on robotic and wearable platforms remains challenging in dense urban environments. Existing methodologies typically rely on GPS for absolute positioning, yet GPS signals frequently degrade in urban canyons due to multipath propagation. Consequently, standard solutions like visual odometry suffer from unmitigated drift over time, while map-matching techniques struggle to acquire the reliable GPS priors they need, on top of being too computationally heavy for real-time edge execution. To address these limitations, we propose Spotter, a robuts and real-time visual localization framework that uses building facades as a reliable source of global geo-reference, while retaining the capability to integrate GPS signals when available. In an offline stage, Spotter processes Google Street View panoramas by semantically segmenting facades and pairing multi-view stereo depth with cartographic data to build a compact metric database. At runtime, query images are matched via a cascaded retrieval and geometric verification pipeline to recover fine-grained global camera localization. We benchmark Spotter on a newly collected dataset of pedestrian sequences acquired with wearable smart glasses across several districts of Barcelona. Experimental results show that Spotter outperforms odometry-based baselines and achieves localization accuracy comparable to state-of-the-art map-based methods while operating at significantly higher frame rates.
Related papers
- Pixel-wise Geo-registration of Drone and Satellite Images [46.14662444002411]
Pixel-level cross-view geo-registration aims to align a query image (e.g., drone) to a geo-referenced satellite map so that every query pixel can be mapped to real-world GPS coordinates.<n>Existing benchmarks largely provide only GPS labels, limiting evaluation to a single coordinate per image.<n>We introduce SkyReg, a dataset and standardized benchmark for pixel-level drone-to-satellite geo-registration.
arXiv Detail & Related papers (2026-08-28T21:50:29Z) - VGP-Nav: Metric-Aware Visual Geometric Perception for Robot Navigation [59.44896676402453]
VGP-Nav is a unified framework for textitMetric-Aware Visual Geometric Perception<n>It relies solely on monocular RGB input to jointly support metric localization and obstacle perception.<n>VGP-Nav resolves monocular scale ambiguity online and produces localization-grounded, metric obstacle representations.
arXiv Detail & Related papers (2026-06-08T09:38:14Z) - Think over Trajectories: Leveraging Video Generation to Reconstruct GPS Trajectories from Cellular Signaling [24.925378866242426]
This paper studies the Sig2GPS problem: reconstructing GPS trajectories from cellular signaling.<n>To support this paradigm, a paired signaling-to-trajectory video dataset is constructed to fine-tune an open-source video model.<n>Experiments on large-scale real-world datasets show substantial improvements over strong engineered and learning-based baselines.
arXiv Detail & Related papers (2026-03-27T17:07:13Z) - PRISM-Loc: a Lightweight Long-range LiDAR Localization in Urban Environments with Topological Maps [0.8009940044669193]
We propose PRISM-Loc -- a topological map-based approach for localization in large environments.<n>The proposed approach leverages a twofold localization pipeline, which consists of global place recognition and estimation of the local pose inside the found location.<n>We evaluate the proposed method on the ITLP-Campus dataset on a 3 km route, and compare it against the state-of-the-art metric map-based and place recognition-based competitors.
arXiv Detail & Related papers (2025-06-18T19:59:50Z) - Weakly-supervised Camera Localization by Ground-to-satellite Image Registration [52.54992898069471]
We propose a weakly supervised learning strategy for ground-to-satellite image registration.
It derives positive and negative satellite images for each ground image.
We also propose a self-supervision strategy for cross-view image relative rotation estimation.
arXiv Detail & Related papers (2024-09-10T12:57:16Z) - Landmark-based Localization using Stereo Vision and Deep Learning in
GPS-Denied Battlefield Environment [1.19658449368018]
This paper proposes a novel framework for localization in non-GPS battlefield environments using only the passive camera sensors.
The proposed method utilizes a customcalibrated stereo vision camera for distance estimation and the YOLOv8s model, which is trained and fine-tuned with our real-world dataset for landmark recognition.
Experimental results demonstrate that our proposed framework performs better than existing anchorbased DV-Hop algorithms and competes with the most efficient vision-based algorithms in terms of localization error (RMSE)
arXiv Detail & Related papers (2024-02-19T21:20:56Z) - GeoCLIP: Clip-Inspired Alignment between Locations and Images for
Effective Worldwide Geo-localization [61.10806364001535]
Worldwide Geo-localization aims to pinpoint the precise location of images taken anywhere on Earth.
Existing approaches divide the globe into discrete geographic cells, transforming the problem into a classification task.
We propose GeoCLIP, a novel CLIP-inspired Image-to-GPS retrieval approach that enforces alignment between the image and its corresponding GPS locations.
arXiv Detail & Related papers (2023-09-27T20:54:56Z) - Visual Cross-View Metric Localization with Dense Uncertainty Estimates [11.76638109321532]
This work addresses visual cross-view metric localization for outdoor robotics.
Given a ground-level color image and a satellite patch that contains the local surroundings, the task is to identify the location of the ground camera within the satellite patch.
We devise a novel network architecture with denser satellite descriptors, similarity matching at the bottleneck, and a dense spatial distribution as output to capture multi-modal localization ambiguities.
arXiv Detail & Related papers (2022-08-17T20:12:23Z) - Accurate 3-DoF Camera Geo-Localization via Ground-to-Satellite Image
Matching [102.39635336450262]
We address the problem of ground-to-satellite image geo-localization by matching a query image captured at the ground level against a large-scale database with geotagged satellite images.
Our new method is able to achieve the fine-grained location of a query image, up to pixel size precision of the satellite image.
arXiv Detail & Related papers (2022-03-26T20:10:38Z) - Real-time Outdoor Localization Using Radio Maps: A Deep Learning
Approach [59.17191114000146]
LocUNet: A convolutional, end-to-end trained neural network (NN) for the localization task.
We show that LocUNet can localize users with state-of-the-art accuracy and enjoys high robustness to inaccuracies in the estimations of radio maps.
arXiv Detail & Related papers (2021-06-23T17:27:04Z) - Real-time Localization Using Radio Maps [59.17191114000146]
We present a simple yet effective method for localization based on pathloss.
In our approach, the user to be localized reports the received signal strength from a set of base stations with known locations.
arXiv Detail & Related papers (2020-06-09T16:51:17Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.