Under the Radar: Learning to Predict Robust Keypoints for Odometry Estimation and Metric Localisation in Radar

• URL: http://arxiv.org/abs/2001.10789v3
• Date: Mon, 24 Feb 2020 13:43:32 GMT
• Title: Under the Radar: Learning to Predict Robust Keypoints for Odometry Estimation and Metric Localisation in Radar
• Authors: Dan Barnes and Ingmar Posner
• Abstract summary: We run experiments on 280km of real world driving from the Oxford Radar RobotCar dataset. We improve on the state-of-the-art in point-based radar odometry, reducing errors by up to 45%. We provide a framework capable of full mapping and localisation with radar in urban environments.
• Score: 26.382149876115918
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: This paper presents a self-supervised framework for learning to detect robust keypoints for odometry estimation and metric localisation in radar. By embedding a differentiable point-based motion estimator inside our architecture, we learn keypoint locations, scores and descriptors from localisation error alone. This approach avoids imposing any assumption on what makes a robust keypoint and crucially allows them to be optimised for our application. Furthermore the architecture is sensor agnostic and can be applied to most modalities. We run experiments on 280km of real world driving from the Oxford Radar RobotCar Dataset and improve on the state-of-the-art in point-based radar odometry, reducing errors by up to 45% whilst running an order of magnitude faster, simultaneously solving metric loop closures. Combining these outputs, we provide a framework capable of full mapping and localisation with radar in urban environments.

Related papers

• Improved LiDAR Odometry and Mapping using Deep Semantic Segmentation and Novel Outliers Detection [1.0334138809056097]
  We propose a novel framework for real-time LiDAR odometry and mapping based on LOAM architecture for fast moving platforms. Our framework utilizes semantic information produced by a deep learning model to improve point-to-line and point-to-plane matching. We study the effect of improving the matching process on the robustness of LiDAR odometry against high speed motion.
  arXiv  Detail & Related papers  (2024-03-05T16:53:24Z)
• SpirDet: Towards Efficient, Accurate and Lightweight Infrared Small Target Detector [60.42293239557962]
  We propose SpirDet, a novel approach for efficient detection of infrared small targets. We employ a new dual-branch sparse decoder to restore the feature map. Extensive experiments show that the proposed SpirDet significantly outperforms state-of-the-art models.
  arXiv  Detail & Related papers  (2024-02-08T05:06:14Z)
• Unsupervised Domain Adaptation for Self-Driving from Past Traversal Features [69.47588461101925]
  We propose a method to adapt 3D object detectors to new driving environments. Our approach enhances LiDAR-based detection models using spatial quantized historical features. Experiments on real-world datasets demonstrate significant improvements.
  arXiv  Detail & Related papers  (2023-09-21T15:00:31Z)
• RaLF: Flow-based Global and Metric Radar Localization in LiDAR Maps [8.625083692154414]
  We propose RaLF, a novel deep neural network-based approach for localizing radar scans in a LiDAR map of the environment. RaLF is composed of radar and LiDAR feature encoders, a place recognition head that generates global descriptors, and a metric localization head that predicts the 3-DoF transformation between the radar scan and the map. We extensively evaluate our approach on multiple real-world driving datasets and show that RaLF achieves state-of-the-art performance for both place recognition and metric localization.
  arXiv  Detail & Related papers  (2023-09-18T15:37:01Z)
• Semantic Segmentation of Radar Detections using Convolutions on Point Clouds [59.45414406974091]
  We introduce a deep-learning based method to convolve radar detections into point clouds. We adapt this algorithm to radar-specific properties through distance-dependent clustering and pre-processing of input point clouds. Our network outperforms state-of-the-art approaches that are based on PointNet++ on the task of semantic segmentation of radar point clouds.
  arXiv  Detail & Related papers  (2023-05-22T07:09:35Z)
• Anomaly Detection in Radar Data Using PointNets [7.3600716208089825]
  We present an approach based on PointNets to detect anomalous radar targets. Our method is evaluated on a real-world dataset in urban scenarios.
  arXiv  Detail & Related papers  (2021-09-20T10:02:24Z)
• R4Dyn: Exploring Radar for Self-Supervised Monocular Depth Estimation of Dynamic Scenes [69.6715406227469]
  Self-supervised monocular depth estimation in driving scenarios has achieved comparable performance to supervised approaches. We present R4Dyn, a novel set of techniques to use cost-efficient radar data on top of a self-supervised depth estimation framework.
  arXiv  Detail & Related papers  (2021-08-10T17:57:03Z)
• Radar-based Automotive Localization using Landmarks in a Multimodal Sensor Graph-based Approach [0.0]
  In this paper, we address the problem of localization with automotive-grade radars. The system uses landmarks and odometry information as an abstraction layer. A single, semantic landmark map is used and maintained for all sensors.
  arXiv  Detail & Related papers  (2021-04-29T07:35:20Z)
• RaLL: End-to-end Radar Localization on Lidar Map Using Differentiable Measurement Model [14.155337185792279]
  We propose an end-to-end deep learning framework for Radar Localization on Lidar Map (RaLL) RaLL exploits the mature lidar mapping technique, thus reducing the cost of radar mapping. Our proposed system achieves superior performance over $90km$ driving, even in generalization scenarios where the model training is in UK.
  arXiv  Detail & Related papers  (2020-09-15T13:13:38Z)
• Radar-based Dynamic Occupancy Grid Mapping and Object Detection [55.74894405714851]
  In recent years, the classical occupancy grid map approach has been extended to dynamic occupancy grid maps. This paper presents the further development of a previous approach. The data of multiple radar sensors are fused, and a grid-based object tracking and mapping method is applied.
  arXiv  Detail & Related papers  (2020-08-09T09:26:30Z)
• A Self-Training Approach for Point-Supervised Object Detection and Counting in Crowds [54.73161039445703]
  We propose a novel self-training approach that enables a typical object detector trained only with point-level annotations. During training, we utilize the available point annotations to supervise the estimation of the center points of objects. Experimental results show that our approach significantly outperforms state-of-the-art point-supervised methods under both detection and counting tasks.
  arXiv  Detail & Related papers  (2020-07-25T02:14:42Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.