Runway Extraction and Improved Mapping from Space Imagery
- URL: http://arxiv.org/abs/2201.00848v1
- Date: Thu, 30 Dec 2021 03:15:45 GMT
- Title: Runway Extraction and Improved Mapping from Space Imagery
- Authors: David A. Noever
- Abstract summary: We identify two generative adversarial networks (GANs) that translate reversibly between plausible runway maps and satellite imagery.
We experimentally show that the traditional grey-tan map palette is not a required training input but can be augmented by higher contrast mapping palettes.
We identify examples of faulty runway maps where the published satellite and mapped runways disagree but an automated update renders the correct map using GANs.
- Score: 0.0
- License: http://creativecommons.org/licenses/by-sa/4.0/
- Abstract: Change detection methods applied to monitoring key infrastructure like
airport runways represent an important capability for disaster relief and urban
planning. The present work identifies two generative adversarial networks (GAN)
architectures that translate reversibly between plausible runway maps and
satellite imagery. We illustrate the training capability using paired images
(satellite-map) from the same point of view and using the Pix2Pix architecture
or conditional GANs. In the absence of available pairs, we likewise show that
CycleGAN architectures with four network heads (discriminator-generator pairs)
can also provide effective style transfer from raw image pixels to outline or
feature maps. To emphasize the runway and tarmac boundaries, we experimentally
show that the traditional grey-tan map palette is not a required training input
but can be augmented by higher contrast mapping palettes (red-black) for
sharper runway boundaries. We preview a potentially novel use case (called
"sketch2satellite") where a human roughly draws the current runway boundaries
and automates the machine output of plausible satellite images. Finally, we
identify examples of faulty runway maps where the published satellite and
mapped runways disagree but an automated update renders the correct map using
GANs.
Related papers
- HPix: Generating Vector Maps from Satellite Images [0.0]
We propose a novel method called HPix, which utilizes modified Generative Adversarial Networks (GANs) to generate vector tile map from satellite images.
Through empirical evaluations, our proposed approach showcases its effectiveness in producing highly accurate and visually captivating vector tile maps.
We further extend our study's application to include mapping of road intersections and building footprints cluster based on their area.
arXiv Detail & Related papers (2024-07-18T16:54:02Z) - Style Alignment based Dynamic Observation Method for UAV-View Geo-localization [7.185123213523453]
We propose a style alignment based dynamic observation method for UAV-view geo-localization.
Specifically, we introduce a style alignment strategy to transfrom the diverse visual style of drone-view images into a unified satellite images visual style.
A dynamic observation module is designed to evaluate the spatial distribution of images by mimicking human observation habits.
arXiv Detail & Related papers (2024-07-03T06:19:42Z) - Sat2Scene: 3D Urban Scene Generation from Satellite Images with Diffusion [77.34078223594686]
We propose a novel architecture for direct 3D scene generation by introducing diffusion models into 3D sparse representations and combining them with neural rendering techniques.
Specifically, our approach generates texture colors at the point level for a given geometry using a 3D diffusion model first, which is then transformed into a scene representation in a feed-forward manner.
Experiments in two city-scale datasets show that our model demonstrates proficiency in generating photo-realistic street-view image sequences and cross-view urban scenes from satellite imagery.
arXiv Detail & Related papers (2024-01-19T16:15:37Z) - Energy-Based Models for Cross-Modal Localization using Convolutional
Transformers [52.27061799824835]
We present a novel framework for localizing a ground vehicle mounted with a range sensor against satellite imagery in the absence of GPS.
We propose a method using convolutional transformers that performs accurate metric-level localization in a cross-modal manner.
We train our model end-to-end and demonstrate our approach achieving higher accuracy than the state-of-the-art on KITTI, Pandaset, and a custom dataset.
arXiv Detail & Related papers (2023-06-06T21:27:08Z) - Path-Aware Graph Attention for HD Maps in Motion Prediction [4.531240717484252]
Success of motion prediction for autonomous driving relies on integration of information from the HD maps.
We propose Path-Aware Graph Attention, a novel attention architecture that infers the attention between two vertices by parsing the sequence of edges forming the paths that connect them.
Our analysis illustrates how the proposed attention mechanism can facilitate learning in a didactic problem where existing graph networks like GCN struggle.
arXiv Detail & Related papers (2022-02-23T09:43:47Z) - Structured Bird's-Eye-View Traffic Scene Understanding from Onboard
Images [128.881857704338]
We study the problem of extracting a directed graph representing the local road network in BEV coordinates, from a single onboard camera image.
We show that the method can be extended to detect dynamic objects on the BEV plane.
We validate our approach against powerful baselines and show that our network achieves superior performance.
arXiv Detail & Related papers (2021-10-05T12:40:33Z) - CAMERAS: Enhanced Resolution And Sanity preserving Class Activation
Mapping for image saliency [61.40511574314069]
Backpropagation image saliency aims at explaining model predictions by estimating model-centric importance of individual pixels in the input.
We propose CAMERAS, a technique to compute high-fidelity backpropagation saliency maps without requiring any external priors.
arXiv Detail & Related papers (2021-06-20T08:20:56Z) - Geometry-Guided Street-View Panorama Synthesis from Satellite Imagery [80.6282101835164]
We present a new approach for synthesizing a novel street-view panorama given an overhead satellite image.
Our method generates a Google's omnidirectional street-view type panorama, as if it is captured from the same geographical location as the center of the satellite patch.
arXiv Detail & Related papers (2021-03-02T10:27:05Z) - End-to-End Deep Structured Models for Drawing Crosswalks [98.9901717499058]
We project both inputs onto the ground surface to produce a top down view of the scene.
We then leverage convolutional neural networks to extract semantic cues about the location of the crosswalks.
Experiments over crosswalks in a large city area show that 96.6% automation can be achieved.
arXiv Detail & Related papers (2020-12-21T18:59:08Z) - Gaussian Process Gradient Maps for Loop-Closure Detection in
Unstructured Planetary Environments [17.276441789710574]
The ability to recognize previously mapped locations is an essential feature for autonomous systems.
Unstructured planetary-like environments pose a major challenge to these systems due to the similarity of the terrain.
This paper presents a method to solve the loop closure problem using only spatial information.
arXiv Detail & Related papers (2020-09-01T04:41:40Z) - Improving Movement Predictions of Traffic Actors in Bird's-Eye View
Models using GANs and Differentiable Trajectory Rasterization [12.652210024012374]
One of the most critical pieces of the self-driving puzzle is the task of predicting future movement of surrounding traffic actors.
Methods based on top-down sceneization on one side and Generative Adrial Networks (GANs) on the other have shown to be particularly successful.
In this paper we build upon these two directions and propose aversa-based conditional GAN architecture.
We evaluate the proposed method on a large-scale, real-world data set, showing that it outperforms state-of-the-art GAN-based baselines.
arXiv Detail & Related papers (2020-04-14T00:41:17Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.