Scene-aware Learning Network for Radar Object Detection

• URL: http://arxiv.org/abs/2107.01469v1
• Date: Sat, 3 Jul 2021 17:19:56 GMT
• Title: Scene-aware Learning Network for Radar Object Detection
• Abstract summary: Radar has been drawing more and more attention due to its robustness and low cost. In this paper, we propose a scene-aware radar learning framework for accurate and robust object detection.
• Score: 29.869186047966945
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Object detection is essential to safe autonomous or assisted driving. Previous works usually utilize RGB images or LiDAR point clouds to identify and localize multiple objects in self-driving. However, cameras tend to fail in bad driving conditions, e.g. bad weather or weak lighting, while LiDAR scanners are too expensive to get widely deployed in commercial applications. Radar has been drawing more and more attention due to its robustness and low cost. In this paper, we propose a scene-aware radar learning framework for accurate and robust object detection. First, the learning framework contains branches conditioning on the scene category of the radar sequence; with each branch optimized for a specific type of scene. Second, three different 3D autoencoder-based architectures are proposed for radar object detection and ensemble learning is performed over the different architectures to further boost the final performance. Third, we propose novel scene-aware sequence mix augmentation (SceneMix) and scene-specific post-processing to generate more robust detection results. In the ROD2021 Challenge, we achieved a final result of average precision of 75.0% and an average recall of 81.0%. Moreover, in the parking lot scene, our framework ranks first with an average precision of 97.8% and an average recall of 98.6%, which demonstrates the effectiveness of our framework.

Related papers

• Robostral Navigate [138.74472687550374]
  Robostral Navigate is a vision-language model for navigation systems at scale.<n>It consumes only a stream of monocular RGB images and predicts waypoints by pointing to the next target location in the current camera view.<n>We generate 2.4 million trajectories across 350k simulated scenes to reduce the reliance on real-world data collection.
  arXiv  Detail & Related papers  (2026-07-22T23:13:05Z)
• RobuRCDet: Enhancing Robustness of Radar-Camera Fusion in Bird's Eye View for 3D Object Detection [68.99784784185019]
  Poor lighting or adverse weather conditions degrade camera performance. Radar suffers from noise and positional ambiguity. We propose RobuRCDet, a robust object detection model in BEV.
  arXiv  Detail & Related papers  (2025-02-18T17:17:38Z)
• Radar Fields: Frequency-Space Neural Scene Representations for FMCW Radar [62.51065633674272]
  We introduce Radar Fields - a neural scene reconstruction method designed for active radar imagers. Our approach unites an explicit, physics-informed sensor model with an implicit neural geometry and reflectance model to directly synthesize raw radar measurements. We validate the effectiveness of the method across diverse outdoor scenarios, including urban scenes with dense vehicles and infrastructure.
  arXiv  Detail & Related papers  (2024-05-07T20:44:48Z)
• Better Monocular 3D Detectors with LiDAR from the Past [64.6759926054061]
  Camera-based 3D detectors often suffer inferior performance compared to LiDAR-based counterparts due to inherent depth ambiguities in images. In this work, we seek to improve monocular 3D detectors by leveraging unlabeled historical LiDAR data. We show consistent and significant performance gain across multiple state-of-the-art models and datasets with a negligible additional latency of 9.66 ms and a small storage cost.
  arXiv  Detail & Related papers  (2024-04-08T01:38:43Z)
• ROFusion: Efficient Object Detection using Hybrid Point-wise Radar-Optical Fusion [14.419658061805507]
  We propose a hybrid point-wise Radar-Optical fusion approach for object detection in autonomous driving scenarios. The framework benefits from dense contextual information from both the range-doppler spectrum and images which are integrated to learn a multi-modal feature representation.
  arXiv  Detail & Related papers  (2023-07-17T04:25:46Z)
• CRN: Camera Radar Net for Accurate, Robust, Efficient 3D Perception [20.824179713013734]
  We propose Camera Radar Net (CRN), a novel camera-radar fusion framework. CRN generates semantically rich and spatially accurate bird's-eye-view (BEV) feature map for various tasks. CRN with real-time setting operates at 20 FPS while achieving comparable performance to LiDAR detectors on nuScenes.
  arXiv  Detail & Related papers  (2023-04-03T00:47:37Z)
• Benchmarking the Robustness of LiDAR-Camera Fusion for 3D Object Detection [58.81316192862618]
  Two critical sensors for 3D perception in autonomous driving are the camera and the LiDAR. fusing these two modalities can significantly boost the performance of 3D perception models. We benchmark the state-of-the-art fusion methods for the first time.
  arXiv  Detail & Related papers  (2022-05-30T09:35:37Z)
• RODNet: A Real-Time Radar Object Detection Network Cross-Supervised by Camera-Radar Fused Object 3D Localization [30.42848269877982]
  We propose a deep radar object detection network, named RODNet, which is cross-supervised by a camera-radar fused algorithm. Our proposed RODNet takes a sequence of RF images as the input to predict the likelihood of objects in the radar field of view (FoV) With intensive experiments, our proposed cross-supervised RODNet achieves 86% average precision and 88% average recall of object detection performance.
  arXiv  Detail & Related papers  (2021-02-09T22:01:55Z)
• LiRaNet: End-to-End Trajectory Prediction using Spatio-Temporal Radar Fusion [52.59664614744447]
  We present LiRaNet, a novel end-to-end trajectory prediction method which utilizes radar sensor information along with widely used lidar and high definition (HD) maps. automotive radar provides rich, complementary information, allowing for longer range vehicle detection as well as instantaneous velocity measurements.
  arXiv  Detail & Related papers  (2020-10-02T00:13:00Z)
• Radar+RGB Attentive Fusion for Robust Object Detection in Autonomous Vehicles [0.5801044612920815]
  The proposed architecture aims to use radar signal data along with RGB camera images to form a robust detection network. BIRANet yields 72.3/75.3% average AP/AR on the NuScenes dataset. RANet gives 69.6/71.9% average AP/AR on the same dataset, which is reasonably acceptable performance.
  arXiv  Detail & Related papers  (2020-08-31T14:27:02Z)
• RadarNet: Exploiting Radar for Robust Perception of Dynamic Objects [73.80316195652493]
  We tackle the problem of exploiting Radar for perception in the context of self-driving cars. We propose a new solution that exploits both LiDAR and Radar sensors for perception. Our approach, dubbed RadarNet, features a voxel-based early fusion and an attention-based late fusion.
  arXiv  Detail & Related papers  (2020-07-28T17:15:02Z)
• RODNet: Radar Object Detection Using Cross-Modal Supervision [34.33920572597379]
  Radar is usually more robust than the camera in severe driving scenarios. Unlike RGB images captured by a camera, semantic information from the radar signals is noticeably difficult to extract. We propose a deep radar object detection network (RODNet) to effectively detect objects purely from the radar frequency data.
  arXiv  Detail & Related papers  (2020-03-03T22:33:16Z)
• Road Curb Detection and Localization with Monocular Forward-view Vehicle Camera [74.45649274085447]
  We propose a robust method for estimating road curb 3D parameters using a calibrated monocular camera equipped with a fisheye lens. Our approach is able to estimate the vehicle to curb distance in real time with mean accuracy of more than 90%.
  arXiv  Detail & Related papers  (2020-02-28T00:24:18Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.