PEnG: Pose-Enhanced Geo-Localisation

• URL: http://arxiv.org/abs/2411.15742v1
• Date: Sun, 24 Nov 2024 07:42:50 GMT
• Title: PEnG: Pose-Enhanced Geo-Localisation
• Authors: Tavis Shore, Oscar Mendez, Simon Hadfield,
• Abstract summary: Cross-view geo-localisation is typically performed at a coarse granularity, because densely sampled satellite image patches overlap heavily. We develop PEnG, a 2-stage system which first predicts the most likely edges from a city-scale graph representation. It then performs relative pose estimation within these edges to determine a precise position.
• Score: 15.324623975476348
• License:
• Abstract: Cross-view Geo-localisation is typically performed at a coarse granularity, because densely sampled satellite image patches overlap heavily. This heavy overlap would make disambiguating patches very challenging. However, by opting for sparsely sampled patches, prior work has placed an artificial upper bound on the localisation accuracy that is possible. Even a perfect oracle system cannot achieve accuracy greater than the average separation of the tiles. To solve this limitation, we propose combining cross-view geo-localisation and relative pose estimation to increase precision to a level practical for real-world application. We develop PEnG, a 2-stage system which first predicts the most likely edges from a city-scale graph representation upon which a query image lies. It then performs relative pose estimation within these edges to determine a precise position. PEnG presents the first technique to utilise both viewpoints available within cross-view geo-localisation datasets to enhance precision to a sub-metre level, with some examples achieving centimetre level accuracy. Our proposed ensemble achieves state-of-the-art precision - with relative Top-5m retrieval improvements on previous works of 213%. Decreasing the median euclidean distance error by 96.90% from the previous best of 734m down to 22.77m, when evaluating with 90 degree horizontal FOV images. Code will be made available: tavisshore.co.uk/PEnG

Related papers

• GeoCLIP: Clip-Inspired Alignment between Locations and Images for Effective Worldwide Geo-localization [61.10806364001535]
  Worldwide Geo-localization aims to pinpoint the precise location of images taken anywhere on Earth. Existing approaches divide the globe into discrete geographic cells, transforming the problem into a classification task. We propose GeoCLIP, a novel CLIP-inspired Image-to-GPS retrieval approach that enforces alignment between the image and its corresponding GPS locations.
  arXiv  Detail & Related papers  (2023-09-27T20:54:56Z)
• PIGEON: Predicting Image Geolocations [44.99833362998488]
  We present a new geolocalization system that combines semantic geocell creation, multi-task contrastive pretraining, and a novel loss function. PIGEOTTO is the first image geolocalization model that effectively generalizes to unseen places.
  arXiv  Detail & Related papers  (2023-07-11T23:36:49Z)
• Combining geolocation and height estimation of objects from street level imagery [5.887281983256354]
  We propose a pipeline for combined multi-class object geolocation and height estimation from street level RGB imagery. The proposed technique uses image metadata along with coordinates of objects detected in the image plane as found by a custom-trained Convolutional Neural Network.
  arXiv  Detail & Related papers  (2023-05-14T19:40:02Z)
• Convolutional Cross-View Pose Estimation [9.599356978682108]
  We propose a novel end-to-end method for cross-view pose estimation. Our method is validated on the VIGOR and KITTI datasets. On the Oxford RobotCar dataset, our method can reliably estimate the ego-vehicle's pose over time.
  arXiv  Detail & Related papers  (2023-03-09T13:52:28Z)
• A Large Scale Homography Benchmark [52.55694707744518]
  We present a large-scale dataset of Planes in 3D, Pi3D, of roughly 1000 planes observed in 10 000 images from the 1DSfM dataset. We also present HEB, a large-scale homography estimation benchmark leveraging Pi3D.
  arXiv  Detail & Related papers  (2023-02-20T14:18:09Z)
• Visual Cross-View Metric Localization with Dense Uncertainty Estimates [11.76638109321532]
  This work addresses visual cross-view metric localization for outdoor robotics. Given a ground-level color image and a satellite patch that contains the local surroundings, the task is to identify the location of the ground camera within the satellite patch. We devise a novel network architecture with denser satellite descriptors, similarity matching at the bottleneck, and a dense spatial distribution as output to capture multi-modal localization ambiguities.
  arXiv  Detail & Related papers  (2022-08-17T20:12:23Z)
• Beyond Cross-view Image Retrieval: Highly Accurate Vehicle Localization Using Satellite Image [91.29546868637911]
  This paper addresses the problem of vehicle-mounted camera localization by matching a ground-level image with an overhead-view satellite map. The key idea is to formulate the task as pose estimation and solve it by neural-net based optimization. Experiments on standard autonomous vehicle localization datasets have confirmed the superiority of the proposed method.
  arXiv  Detail & Related papers  (2022-04-10T19:16:58Z)
• Accurate 3-DoF Camera Geo-Localization via Ground-to-Satellite Image Matching [102.39635336450262]
  We address the problem of ground-to-satellite image geo-localization by matching a query image captured at the ground level against a large-scale database with geotagged satellite images. Our new method is able to achieve the fine-grained location of a query image, up to pixel size precision of the satellite image.
  arXiv  Detail & Related papers  (2022-03-26T20:10:38Z)
• City-wide Street-to-Satellite Image Geolocalization of a Mobile Ground Agent [38.140216125792755]
  Cross-view image geolocalization provides an estimate of an agent's global position by matching a local ground image to an overhead satellite image without the need for GPS. Our approach, called Wide-Area Geolocalization (WAG), combines a neural network with a particle filter to achieve global position estimates for agents moving in GPS-denied environments. WAG achieves position estimation accuracies on the order of 20 meters, a 98% reduction compared to a baseline training and weighting approach.
  arXiv  Detail & Related papers  (2022-03-10T19:54:12Z)
• Wide-Depth-Range 6D Object Pose Estimation in Space [124.94794113264194]
  6D pose estimation in space poses unique challenges that are not commonly encountered in the terrestrial setting. One of the most striking differences is the lack of atmospheric scattering, allowing objects to be visible from a great distance. We propose a single-stage hierarchical end-to-end trainable network that is more robust to scale variations.
  arXiv  Detail & Related papers  (2021-04-01T08:39:26Z)
• Making Affine Correspondences Work in Camera Geometry Computation [62.7633180470428]
  Local features provide region-to-region rather than point-to-point correspondences. We propose guidelines for effective use of region-to-region matches in the course of a full model estimation pipeline. Experiments show that affine solvers can achieve accuracy comparable to point-based solvers at faster run-times.
  arXiv  Detail & Related papers  (2020-07-20T12:07:48Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.