Improved Radar Localization on Lidar Maps Using Shared Embedding
- URL: http://arxiv.org/abs/2106.10000v1
- Date: Fri, 18 Jun 2021 08:40:04 GMT
- Title: Improved Radar Localization on Lidar Maps Using Shared Embedding
- Authors: Huan Yin, Yue Wang and Rong Xiong
- Abstract summary: We present a framework for solving radar global localization and pose tracking on pre-built lidar maps.
Deep neural networks are constructed to create shared embedding space for radar scans and lidar maps.
- Score: 12.65429845365685
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: We present a heterogeneous localization framework for solving radar global
localization and pose tracking on pre-built lidar maps. To bridge the gap of
sensing modalities, deep neural networks are constructed to create shared
embedding space for radar scans and lidar maps. Herein learned feature
embeddings are supportive for similarity measurement, thus improving map
retrieval and data matching respectively. In RobotCar and MulRan datasets, we
demonstrate the effectiveness of the proposed framework with the comparison to
Scan Context and RaLL. In addition, the proposed pose tracking pipeline is with
less neural networks compared to the original RaLL.
Related papers
- Neural Semantic Map-Learning for Autonomous Vehicles [85.8425492858912]
We present a mapping system that fuses local submaps gathered from a fleet of vehicles at a central instance to produce a coherent map of the road environment.
Our method jointly aligns and merges the noisy and incomplete local submaps using a scene-specific Neural Signed Distance Field.
We leverage memory-efficient sparse feature-grids to scale to large areas and introduce a confidence score to model uncertainty in scene reconstruction.
arXiv Detail & Related papers (2024-10-10T10:10:03Z) - SparseRadNet: Sparse Perception Neural Network on Subsampled Radar Data [5.344444942640663]
Radar raw data often contains excessive noise, whereas radar point clouds retain only limited information.
We introduce an adaptive subsampling method together with a tailored network architecture that exploits the sparsity patterns.
Experiments on the RADIal dataset show that our SparseRadNet exceeds state-of-the-art (SOTA) performance in object detection and achieves close to SOTA accuracy in freespace segmentation.
arXiv Detail & Related papers (2024-06-15T11:26:10Z) - RaLF: Flow-based Global and Metric Radar Localization in LiDAR Maps [8.625083692154414]
We propose RaLF, a novel deep neural network-based approach for localizing radar scans in a LiDAR map of the environment.
RaLF is composed of radar and LiDAR feature encoders, a place recognition head that generates global descriptors, and a metric localization head that predicts the 3-DoF transformation between the radar scan and the map.
We extensively evaluate our approach on multiple real-world driving datasets and show that RaLF achieves state-of-the-art performance for both place recognition and metric localization.
arXiv Detail & Related papers (2023-09-18T15:37:01Z) - Semantic Segmentation of Radar Detections using Convolutions on Point
Clouds [59.45414406974091]
We introduce a deep-learning based method to convolve radar detections into point clouds.
We adapt this algorithm to radar-specific properties through distance-dependent clustering and pre-processing of input point clouds.
Our network outperforms state-of-the-art approaches that are based on PointNet++ on the task of semantic segmentation of radar point clouds.
arXiv Detail & Related papers (2023-05-22T07:09:35Z) - Subspace Perturbation Analysis for Data-Driven Radar Target Localization [20.34399283905663]
We use subspace analysis to benchmark radar target localization accuracy across mismatched scenarios.
We generate comprehensive datasets by randomly placing targets of variable strengths in mismatched constrained areas.
We estimate target locations from these heatmap tensors using a convolutional neural network.
arXiv Detail & Related papers (2023-03-14T21:22:26Z) - iSDF: Real-Time Neural Signed Distance Fields for Robot Perception [64.80458128766254]
iSDF is a continuous learning system for real-time signed distance field reconstruction.
It produces more accurate reconstructions and better approximations of collision costs and gradients.
arXiv Detail & Related papers (2022-04-05T15:48:39Z) - Large-Scale Topological Radar Localization Using Learned Descriptors [15.662820454886202]
We present a simple yet efficient deep network architecture to compute a rotationally invariant discriminative global descriptor from a radar scan image.
The performance and generalization ability of the proposed method is experimentally evaluated on two large scale driving datasets.
arXiv Detail & Related papers (2021-10-06T21:57:23Z) - GANav: Group-wise Attention Network for Classifying Navigable Regions in
Unstructured Outdoor Environments [54.21959527308051]
We present a new learning-based method for identifying safe and navigable regions in off-road terrains and unstructured environments from RGB images.
Our approach consists of classifying groups of terrain classes based on their navigability levels using coarse-grained semantic segmentation.
We show through extensive evaluations on the RUGD and RELLIS-3D datasets that our learning algorithm improves the accuracy of visual perception in off-road terrains for navigation.
arXiv Detail & Related papers (2021-03-07T02:16:24Z) - Unsupervised Metric Relocalization Using Transform Consistency Loss [66.19479868638925]
Training networks to perform metric relocalization traditionally requires accurate image correspondences.
We propose a self-supervised solution, which exploits a key insight: localizing a query image within a map should yield the same absolute pose, regardless of the reference image used for registration.
We evaluate our framework on synthetic and real-world data, showing our approach outperforms other supervised methods when a limited amount of ground-truth information is available.
arXiv Detail & Related papers (2020-11-01T19:24:27Z) - RaLL: End-to-end Radar Localization on Lidar Map Using Differentiable
Measurement Model [14.155337185792279]
We propose an end-to-end deep learning framework for Radar Localization on Lidar Map (RaLL)
RaLL exploits the mature lidar mapping technique, thus reducing the cost of radar mapping.
Our proposed system achieves superior performance over $90km$ driving, even in generalization scenarios where the model training is in UK.
arXiv Detail & Related papers (2020-09-15T13:13:38Z) - Radar-based Dynamic Occupancy Grid Mapping and Object Detection [55.74894405714851]
In recent years, the classical occupancy grid map approach has been extended to dynamic occupancy grid maps.
This paper presents the further development of a previous approach.
The data of multiple radar sensors are fused, and a grid-based object tracking and mapping method is applied.
arXiv Detail & Related papers (2020-08-09T09:26:30Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.