Radar-to-Lidar: Heterogeneous Place Recognition via Joint Learning

• URL: http://arxiv.org/abs/2102.04960v1
• Date: Sat, 30 Jan 2021 15:34:58 GMT
• Title: Radar-to-Lidar: Heterogeneous Place Recognition via Joint Learning
• Authors: Huan Yin, Xuecheng Xu, Yue Wang and Rong Xiong
• Abstract summary: In this paper, a heterogeneous measurements based framework is proposed for long-term place recognition. A deep neural network is built with joint training in the learning stage, and then in the testing stage, shared embeddings of radar and lidar are extracted for heterogeneous place recognition. The experimental results indicate that our model is able to perform multiple place recognitions: lidar-to-lidar, radar-to-radar and radar-to-lidar, while the learned model is trained only once.
• Score: 11.259276512983492
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Place recognition is critical for both offline mapping and online localization. However, current single-sensor based place recognition still remains challenging in adverse conditions. In this paper, a heterogeneous measurements based framework is proposed for long-term place recognition, which retrieves the query radar scans from the existing lidar maps. To achieve this, a deep neural network is built with joint training in the learning stage, and then in the testing stage, shared embeddings of radar and lidar are extracted for heterogeneous place recognition. To validate the effectiveness of the proposed method, we conduct tests and generalization on the multi-session public datasets compared to other competitive methods. The experimental results indicate that our model is able to perform multiple place recognitions: lidar-to-lidar, radar-to-radar and radar-to-lidar, while the learned model is trained only once. We also release the source code publicly.

Related papers

• Deep Homography Estimation for Visual Place Recognition [49.235432979736395]
  We propose a transformer-based deep homography estimation (DHE) network. It takes the dense feature map extracted by a backbone network as input and fits homography for fast and learnable geometric verification. Experiments on benchmark datasets show that our method can outperform several state-of-the-art methods.
  arXiv  Detail & Related papers  (2024-02-25T13:22:17Z)
• Radio Map Estimation -- An Open Dataset with Directive Transmitter Antennas and Initial Experiments [49.61405888107356]
  We release a dataset of simulated path loss radio maps together with realistic city maps from real-world locations and aerial images from open datasources. Initial experiments regarding model architectures, input feature design and estimation of radio maps from aerial images are presented.
  arXiv  Detail & Related papers  (2024-01-12T14:56:45Z)
• Multi-stage Learning for Radar Pulse Activity Segmentation [51.781832424705094]
  Radio signal recognition is a crucial function in electronic warfare. Precise identification and localisation of radar pulse activities are required by electronic warfare systems. Deep learning-based radar pulse activity recognition methods have remained largely underexplored.
  arXiv  Detail & Related papers  (2023-12-15T01:56:27Z)
• RaLF: Flow-based Global and Metric Radar Localization in LiDAR Maps [8.625083692154414]
  We propose RaLF, a novel deep neural network-based approach for localizing radar scans in a LiDAR map of the environment. RaLF is composed of radar and LiDAR feature encoders, a place recognition head that generates global descriptors, and a metric localization head that predicts the 3-DoF transformation between the radar scan and the map. We extensively evaluate our approach on multiple real-world driving datasets and show that RaLF achieves state-of-the-art performance for both place recognition and metric localization.
  arXiv  Detail & Related papers  (2023-09-18T15:37:01Z)
• Semantic Segmentation of Radar Detections using Convolutions on Point Clouds [59.45414406974091]
  We introduce a deep-learning based method to convolve radar detections into point clouds. We adapt this algorithm to radar-specific properties through distance-dependent clustering and pre-processing of input point clouds. Our network outperforms state-of-the-art approaches that are based on PointNet++ on the task of semantic segmentation of radar point clouds.
  arXiv  Detail & Related papers  (2023-05-22T07:09:35Z)
• DOAD: Decoupled One Stage Action Detection Network [77.14883592642782]
  Localizing people and recognizing their actions from videos is a challenging task towards high-level video understanding. Existing methods are mostly two-stage based, with one stage for person bounding box generation and the other stage for action recognition. We present a decoupled one-stage network dubbed DOAD, to improve the efficiency for-temporal action detection.
  arXiv  Detail & Related papers  (2023-04-01T08:06:43Z)
• Contrastive Learning for Unsupervised Radar Place Recognition [31.04172735067443]
  We learn, in an unsupervised way, an embedding from sequences of radar images that is suitable for solving the place recognition problem with complex radar data. We experiment across two prominent urban radar datasets totalling over 400 km of driving and show that we achieve a new radar place recognition state-of-the-art.
  arXiv  Detail & Related papers  (2021-10-06T13:34:09Z)
• RadarLoc: Learning to Relocalize in FMCW Radar [36.68888832365474]
  We propose a novel end-to-end neural network with self-attention, termed RadarLoc, which is able to estimate 6-DoF global poses directly. We validate our approach on the recently released challenging outdoor dataset Oxford Radar RobotCar.
  arXiv  Detail & Related papers  (2021-03-22T03:22:37Z)
• TraND: Transferable Neighborhood Discovery for Unsupervised Cross-domain Gait Recognition [77.77786072373942]
  This paper proposes a Transferable Neighborhood Discovery (TraND) framework to bridge the domain gap for unsupervised cross-domain gait recognition. We design an end-to-end trainable approach to automatically discover the confident neighborhoods of unlabeled samples in the latent space. Our method achieves state-of-the-art results on two public datasets, i.e., CASIA-B and OU-LP.
  arXiv  Detail & Related papers  (2021-02-09T03:07:07Z)
• RaLL: End-to-end Radar Localization on Lidar Map Using Differentiable Measurement Model [14.155337185792279]
  We propose an end-to-end deep learning framework for Radar Localization on Lidar Map (RaLL) RaLL exploits the mature lidar mapping technique, thus reducing the cost of radar mapping. Our proposed system achieves superior performance over $90km$ driving, even in generalization scenarios where the model training is in UK.
  arXiv  Detail & Related papers  (2020-09-15T13:13:38Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.