UAV Localization Using Autoencoded Satellite Images
- URL: http://arxiv.org/abs/2102.05692v1
- Date: Wed, 10 Feb 2021 19:08:10 GMT
- Title: UAV Localization Using Autoencoded Satellite Images
- Authors: Mollie Bianchi and Timothy D. Barfoot
- Abstract summary: We propose and demonstrate a fast, robust method for using satellite images to localize an Unmanned Aerial Vehicle (UAV)
In this work, we collect Google Earth (GE) images for a desired flight path offline and an autoencoder is trained to compress these images to a low-dimensional vector representation.
We robustly matched UAV images from six runs spanning the lighting conditions of a single day to the same map of satellite images.
- Score: 14.39926267531322
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: We propose and demonstrate a fast, robust method for using satellite images
to localize an Unmanned Aerial Vehicle (UAV). Previous work using satellite
images has large storage and computation costs and is unable to run in real
time. In this work, we collect Google Earth (GE) images for a desired flight
path offline and an autoencoder is trained to compress these images to a
low-dimensional vector representation while retaining the key features. This
trained autoencoder is used to compress a real UAV image, which is then
compared to the precollected, nearby, autoencoded GE images using an
inner-product kernel. This results in a distribution of weights over the
corresponding GE image poses and is used to generate a single localization and
associated covariance to represent uncertainty. Our localization is computed in
1% of the time of the current standard and is able to achieve a comparable RMSE
of less than 3m in our experiments, where we robustly matched UAV images from
six runs spanning the lighting conditions of a single day to the same map of
satellite images.
Related papers
- COSMIC: Compress Satellite Images Efficiently via Diffusion Compensation [18.963383434754515]
We propose COSMIC, a simple yet effective learned compression solution to transmit satellite images.
We first design a lightweight encoder on satellite to achieve a high image compression ratio to save satellite-to-ground links.
Then, for reconstructions on the ground, we propose a diffusion-based model to compensate image details when decoding.
arXiv Detail & Related papers (2024-10-02T16:05:15Z) - Game4Loc: A UAV Geo-Localization Benchmark from Game Data [0.0]
We introduce a more practical UAV geo-localization task including partial matches of cross-view paired data.
Experiments demonstrate the effectiveness of our data and training method for UAV geo-localization.
arXiv Detail & Related papers (2024-09-25T13:33:28Z) - UAV-VisLoc: A Large-scale Dataset for UAV Visual Localization [20.37586403749362]
We present a large-scale dataset, UAV-VisLoc, to facilitate the UAV visual localization task.
Our dataset includes 6,742 drone images and 11 satellite maps, with metadata such as latitude, longitude, altitude, and capture date.
arXiv Detail & Related papers (2024-05-20T10:24:10Z) - DiffusionSat: A Generative Foundation Model for Satellite Imagery [63.2807119794691]
We present DiffusionSat, to date the largest generative foundation model trained on a collection of publicly available large, high-resolution remote sensing datasets.
Our method produces realistic samples and can be used to solve multiple generative tasks including temporal generation, superresolution given multi-spectral inputs and in-painting.
arXiv Detail & Related papers (2023-12-06T16:53:17Z) - Energy-Based Models for Cross-Modal Localization using Convolutional
Transformers [52.27061799824835]
We present a novel framework for localizing a ground vehicle mounted with a range sensor against satellite imagery in the absence of GPS.
We propose a method using convolutional transformers that performs accurate metric-level localization in a cross-modal manner.
We train our model end-to-end and demonstrate our approach achieving higher accuracy than the state-of-the-art on KITTI, Pandaset, and a custom dataset.
arXiv Detail & Related papers (2023-06-06T21:27:08Z) - Deep Learning Computer Vision Algorithms for Real-time UAVs On-board
Camera Image Processing [77.34726150561087]
This paper describes how advanced deep learning based computer vision algorithms are applied to enable real-time on-board sensor processing for small UAVs.
All algorithms have been developed using state-of-the-art image processing methods based on deep neural networks.
arXiv Detail & Related papers (2022-11-02T11:10:42Z) - Satellite Image Based Cross-view Localization for Autonomous Vehicle [59.72040418584396]
This paper shows that by using an off-the-shelf high-definition satellite image as a ready-to-use map, we are able to achieve cross-view vehicle localization up to a satisfactory accuracy.
Our method is validated on KITTI and Ford Multi-AV Seasonal datasets as ground view and Google Maps as the satellite view.
arXiv Detail & Related papers (2022-07-27T13:16:39Z) - Beyond Cross-view Image Retrieval: Highly Accurate Vehicle Localization
Using Satellite Image [91.29546868637911]
This paper addresses the problem of vehicle-mounted camera localization by matching a ground-level image with an overhead-view satellite map.
The key idea is to formulate the task as pose estimation and solve it by neural-net based optimization.
Experiments on standard autonomous vehicle localization datasets have confirmed the superiority of the proposed method.
arXiv Detail & Related papers (2022-04-10T19:16:58Z) - Real-time Geo-localization Using Satellite Imagery and Topography for
Unmanned Aerial Vehicles [18.71806336611299]
We propose a framework that is reliable in changing scenes and pragmatic for lightweight embedded systems on UAVs.
The framework is comprised of two stages: offline database preparation and online inference.
We present field experiments of image-based localization on two different UAV platforms to validate our results.
arXiv Detail & Related papers (2021-08-07T01:47:19Z) - OpenREALM: Real-time Mapping for Unmanned Aerial Vehicles [62.997667081978825]
OpenREALM is a real-time mapping framework for Unmanned Aerial Vehicles (UAVs)
Different modes of operation allow OpenREALM to perform simple stitching assuming an approximate plane ground.
In all modes incremental progress of the resulting map can be viewed live by an operator on the ground.
arXiv Detail & Related papers (2020-09-22T12:28:14Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.