Fully Sparse 3D Object Detection

• URL: http://arxiv.org/abs/2207.10035v1
• Date: Wed, 20 Jul 2022 17:01:33 GMT
• Title: Fully Sparse 3D Object Detection
• Authors: Lue Fan, Feng Wang, Naiyan Wang, Zhaoxiang Zhang
• Abstract summary: We build a fully sparse 3D object detector (FSD) for long-range LiDAR-based object detection. FSD is built upon the general sparse voxel encoder and a novel sparse instance recognition (SIR) module. SIR avoids the time-consuming neighbor queries in previous point-based methods by grouping points into instances.
• Score: 57.05834683261658
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: As the perception range of LiDAR increases, LiDAR-based 3D object detection becomes a dominant task in the long-range perception task of autonomous driving. The mainstream 3D object detectors usually build dense feature maps in the network backbone and prediction head. However, the computational and spatial costs on the dense feature map are quadratic to the perception range, which makes them hardly scale up to the long-range setting. To enable efficient long-range LiDAR-based object detection, we build a fully sparse 3D object detector (FSD). The computational and spatial cost of FSD is roughly linear to the number of points and independent of the perception range. FSD is built upon the general sparse voxel encoder and a novel sparse instance recognition (SIR) module. SIR first groups the points into instances and then applies instance-wise feature extraction and prediction. In this way, SIR resolves the issue of center feature missing, which hinders the design of the fully sparse architecture for all center-based or anchor-based detectors. Moreover, SIR avoids the time-consuming neighbor queries in previous point-based methods by grouping points into instances. We conduct extensive experiments on the large-scale Waymo Open Dataset to reveal the working mechanism of FSD, and state-of-the-art performance is reported. To demonstrate the superiority of FSD in long-range detection, we also conduct experiments on Argoverse 2 Dataset, which has a much larger perception range ($200m$) than Waymo Open Dataset ($75m$). On such a large perception range, FSD achieves state-of-the-art performance and is 2.4$\times$ faster than the dense counterpart.Codes will be released at https://github.com/TuSimple/SST.

Related papers

• SAFDNet: A Simple and Effective Network for Fully Sparse 3D Object Detection [22.120656021516695]
  SAFDNet is a straightforward yet highly effective architecture for fully sparse 3D object detection. We conducted extensive experiments on Open, nuScenes, and Argoverse2 datasets. SAFDNet surpassed the previous best hybrid detector HEDNet by 2.6% mAP while being 2.1x faster.
  arXiv  Detail & Related papers  (2024-03-09T06:48:19Z)
• HEDNet: A Hierarchical Encoder-Decoder Network for 3D Object Detection in Point Clouds [19.1921315424192]
  3D object detection in point clouds is important for autonomous driving systems. A primary challenge in 3D object detection stems from the sparse distribution of points within the 3D scene. We propose HEDNet, a hierarchical encoder-decoder network for 3D object detection.
  arXiv  Detail & Related papers  (2023-10-31T07:32:08Z)
• Fully Sparse Fusion for 3D Object Detection [69.32694845027927]
  Currently prevalent multimodal 3D detection methods are built upon LiDAR-based detectors that usually use dense Bird's-Eye-View feature maps. Fully sparse architecture is gaining attention as they are highly efficient in long-range perception. In this paper, we study how to effectively leverage image modality in the emerging fully sparse architecture.
  arXiv  Detail & Related papers  (2023-04-24T17:57:43Z)
• VoxelNeXt: Fully Sparse VoxelNet for 3D Object Detection and Tracking [78.25819070166351]
  We propose VoxelNext for fully sparse 3D object detection. Our core insight is to predict objects directly based on sparse voxel features, without relying on hand-crafted proxies. Our strong sparse convolutional network VoxelNeXt detects and tracks 3D objects through voxel features entirely.
  arXiv  Detail & Related papers  (2023-03-20T17:40:44Z)
• LiDAR-CS Dataset: LiDAR Point Cloud Dataset with Cross-Sensors for 3D Object Detection [36.77084564823707]
  deep learning methods heavily rely on annotated data and often face domain generalization issues. LiDAR-CS dataset is the first dataset that addresses the sensor-related gaps in the domain of 3D object detection in real traffic.
  arXiv  Detail & Related papers  (2023-01-29T19:10:35Z)
• Super Sparse 3D Object Detection [48.684300007948906]
  LiDAR-based 3D object detection contributes ever-increasingly to the long-range perception in autonomous driving. To enable efficient long-range detection, we first propose a fully sparse object detector termed FSD. FSD++ generates residual points, which indicate the point changes between consecutive frames.
  arXiv  Detail & Related papers  (2023-01-05T17:03:56Z)
• Embracing Single Stride 3D Object Detector with Sparse Transformer [63.179720817019096]
  In LiDAR-based 3D object detection for autonomous driving, the ratio of the object size to input scene size is significantly smaller compared to 2D detection cases. Many 3D detectors directly follow the common practice of 2D detectors, which downsample the feature maps even after quantizing the point clouds. We propose Single-stride Sparse Transformer (SST) to maintain the original resolution from the beginning to the end of the network.
  arXiv  Detail & Related papers  (2021-12-13T02:12:02Z)
• PLUME: Efficient 3D Object Detection from Stereo Images [95.31278688164646]
  Existing methods tackle the problem in two steps: first depth estimation is performed, a pseudo LiDAR point cloud representation is computed from the depth estimates, and then object detection is performed in 3D space. We propose a model that unifies these two tasks in the same metric space. Our approach achieves state-of-the-art performance on the challenging KITTI benchmark, with significantly reduced inference time compared with existing methods.
  arXiv  Detail & Related papers  (2021-01-17T05:11:38Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.