DeepDualMapper: A Gated Fusion Network for Automatic Map Extraction using Aerial Images and Trajectories

• URL: http://arxiv.org/abs/2002.06832v1
• Date: Mon, 17 Feb 2020 08:33:46 GMT
• Title: DeepDualMapper: A Gated Fusion Network for Automatic Map Extraction using Aerial Images and Trajectories
• Authors: Hao Wu, Hanyuan Zhang, Xinyu Zhang, Weiwei Sun, Baihua Zheng, Yuning Jiang
• Abstract summary: We propose a deep convolutional neural network called DeepDualMapper to fuse aerial image and GPS trajectory data. Our experiments demonstrate that DeepDualMapper can fuse the information of images and trajectories much more effectively than existing approaches.
• Score: 28.89392735657318
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Automatic map extraction is of great importance to urban computing and location-based services. Aerial image and GPS trajectory data refer to two different data sources that could be leveraged to generate the map, although they carry different types of information. Most previous works on data fusion between aerial images and data from auxiliary sensors do not fully utilize the information of both modalities and hence suffer from the issue of information loss. We propose a deep convolutional neural network called DeepDualMapper which fuses the aerial image and trajectory data in a more seamless manner to extract the digital map. We design a gated fusion module to explicitly control the information flows from both modalities in a complementary-aware manner. Moreover, we propose a novel densely supervised refinement decoder to generate the prediction in a coarse-to-fine way. Our comprehensive experiments demonstrate that DeepDualMapper can fuse the information of images and trajectories much more effectively than existing approaches, and is able to generate maps with higher accuracy.

Related papers

• Neural Semantic Map-Learning for Autonomous Vehicles [85.8425492858912]
  We present a mapping system that fuses local submaps gathered from a fleet of vehicles at a central instance to produce a coherent map of the road environment. Our method jointly aligns and merges the noisy and incomplete local submaps using a scene-specific Neural Signed Distance Field. We leverage memory-efficient sparse feature-grids to scale to large areas and introduce a confidence score to model uncertainty in scene reconstruction.
  arXiv  Detail & Related papers  (2024-10-10T10:10:03Z)
• Map-aided annotation for pole base detection [0.0]
  In this paper, a 2D HD map is used to automatically annotate pole-like features in images. In the absence of height information, the map features are represented as pole bases at the ground level. We show how an object detector can be trained to detect a pole base.
  arXiv  Detail & Related papers  (2024-03-04T09:23:11Z)
• Diffusion-based Data Augmentation for Object Counting Problems [62.63346162144445]
  We develop a pipeline that utilizes a diffusion model to generate extensive training data. We are the first to generate images conditioned on a location dot map with a diffusion model. Our proposed counting loss for the diffusion model effectively minimizes the discrepancies between the location dot map and the crowd images generated.
  arXiv  Detail & Related papers  (2024-01-25T07:28:22Z)
• Radio Map Estimation -- An Open Dataset with Directive Transmitter Antennas and Initial Experiments [49.61405888107356]
  We release a dataset of simulated path loss radio maps together with realistic city maps from real-world locations and aerial images from open datasources. Initial experiments regarding model architectures, input feature design and estimation of radio maps from aerial images are presented.
  arXiv  Detail & Related papers  (2024-01-12T14:56:45Z)
• Transformer-Based Neural Surrogate for Link-Level Path Loss Prediction from Variable-Sized Maps [11.327456466796681]
  Estimating path loss for a transmitter-receiver location is key to many use-cases including network planning and handover. We present a transformer-based neural network architecture that enables predicting link-level properties from maps of various dimensions and from sparse measurements.
  arXiv  Detail & Related papers  (2023-10-06T20:17:40Z)
• Aerial Images Meet Crowdsourced Trajectories: A New Approach to Robust Road Extraction [110.61383502442598]
  We introduce a novel neural network framework termed Cross-Modal Message Propagation Network (CMMPNet) CMMPNet is composed of two deep Auto-Encoders for modality-specific representation learning and a tailor-designed Dual Enhancement Module for cross-modal representation refinement. Experiments on three real-world benchmarks demonstrate the effectiveness of our CMMPNet for robust road extraction.
  arXiv  Detail & Related papers  (2021-11-30T04:30:10Z)
• Synthesizing Optical and SAR Imagery From Land Cover Maps and Auxiliary Raster Data [14.407683537373325]
  We synthesize both optical RGB and synthetic aperture radar (SAR) remote sensing images from land cover maps and auxiliary data using generative adversarial networks (GANs) In remote sensing, many types of data, such as digital elevation models (DEMs) or precipitation maps, are often not reflected in land cover maps but still influence image content or structure. Our method successfully synthesizes medium (10 m) and high (1 m) resolution images when trained with the corresponding data set.
  arXiv  Detail & Related papers  (2020-11-23T10:28:10Z)
• Radar-based Dynamic Occupancy Grid Mapping and Object Detection [55.74894405714851]
  In recent years, the classical occupancy grid map approach has been extended to dynamic occupancy grid maps. This paper presents the further development of a previous approach. The data of multiple radar sensors are fused, and a grid-based object tracking and mapping method is applied.
  arXiv  Detail & Related papers  (2020-08-09T09:26:30Z)
• RoutedFusion: Learning Real-time Depth Map Fusion [73.0378509030908]
  We present a novel real-time capable machine learning-based method for depth map fusion. We propose a neural network that predicts non-linear updates to better account for typical fusion errors. Our network is composed of a 2D depth routing network and a 3D depth fusion network which efficiently handle sensor-specific noise and outliers.
  arXiv  Detail & Related papers  (2020-01-13T16:46:41Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.