Can We Remove the Ground? Obstacle-aware Point Cloud Compression for Remote Object Detection

• URL: http://arxiv.org/abs/2410.00582v1
• Date: Tue, 1 Oct 2024 11:05:33 GMT
• Title: Can We Remove the Ground? Obstacle-aware Point Cloud Compression for Remote Object Detection
• Abstract summary: We propose a lightweight obstacle-aware Pillar-based Ground Removal (PGR) algorithm. PGR filters out ground points that do not provide context to object recognition. Not using heavy object detection or semantic segmentation models, PGR is light-weight, highly parallelizable, and effective.
• Score: 7.745500652350134
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Efficient point cloud (PC) compression is crucial for streaming applications, such as augmented reality and cooperative perception. Classic PC compression techniques encode all the points in a frame. Tailoring compression towards perception tasks at the receiver side, we ask the question, "Can we remove the ground points during transmission without sacrificing the detection performance?" Our study reveals a strong dependency on the ground from state-of-the-art (SOTA) 3D object detection models, especially on those points below and around the object. In this work, we propose a lightweight obstacle-aware Pillar-based Ground Removal (PGR) algorithm. PGR filters out ground points that do not provide context to object recognition, significantly improving compression ratio without sacrificing the receiver side perception performance. Not using heavy object detection or semantic segmentation models, PGR is light-weight, highly parallelizable, and effective. Our evaluations on KITTI and Waymo Open Dataset show that SOTA detection models work equally well with PGR removing 20-30% of the points, with a speeding of 86 FPS.

Related papers

• Reflectance Prediction-based Knowledge Distillation for Robust 3D Object Detection in Compressed Point Clouds [45.694869892846945]
  This paper proposes a 3D object detection framework with reflectance prediction-based knowledge distillation (RPKD)<n>We compress point coordinates while discarding reflectance during low-bitrate transmission, and feed the decoded non-reflectance compressed point clouds into a student detector.<n>Our method can boost detection accuracy for compressed point clouds across multiple code rates.
  arXiv  Detail & Related papers  (2025-05-23T03:52:27Z)
• StraightPCF: Straight Point Cloud Filtering [50.66412286723848]
  Point cloud filtering is a fundamental 3D vision task, which aims to remove noise while recovering the underlying clean surfaces. We introduce StraightPCF, a new deep learning based method for point cloud filtering. It works by moving noisy points along straight paths, thus reducing discretization errors while ensuring faster convergence to the clean surfaces.
  arXiv  Detail & Related papers  (2024-05-14T05:41:59Z)
• PointCompress3D: A Point Cloud Compression Framework for Roadside LiDARs in Intelligent Transportation Systems [24.783727646151583]
  This work introduces PointCompress3D, a novel point cloud compression framework tailored specifically for roadside LiDARs. We adapt, extend, integrate, and evaluate three cutting-edge compression methods using our real-world-based TUMTraf dataset family. In extensive experiments and ablation studies, we finally achieved a PSNR d2 of 94.46 and a BPP of 6.54 on our dataset.
  arXiv  Detail & Related papers  (2024-05-02T21:35:45Z)
• Poster: Making Edge-assisted LiDAR Perceptions Robust to Lossy Point Cloud Compression [0.0]
  We present an algorithm improving the quality of a LiDAR point cloud to mitigate the perception performance loss due to lossy compression. Compared to existing image algorithms, our algorithm shows a better qualitative result when the point cloud is reconstructed from the range image.
  arXiv  Detail & Related papers  (2023-09-08T18:34:48Z)
• V-DETR: DETR with Vertex Relative Position Encoding for 3D Object Detection [73.37781484123536]
  We introduce a highly performant 3D object detector for point clouds using the DETR framework. To address the limitation, we introduce a novel 3D Relative Position (3DV-RPE) method. We show exceptional results on the challenging ScanNetV2 benchmark.
  arXiv  Detail & Related papers  (2023-08-08T17:14:14Z)
• PSA-Det3D: Pillar Set Abstraction for 3D object Detection [14.788139868324155]
  We propose a pillar set abstraction (PSA) and foreground point compensation (FPC) to improve the detection performance for small object. The experiments on the KITTI 3D detection benchmark show that our proposed PSA-Det3D outperforms other algorithms with high accuracy for small object detection.
  arXiv  Detail & Related papers  (2022-10-20T03:05:34Z)
• Embracing Single Stride 3D Object Detector with Sparse Transformer [63.179720817019096]
  In LiDAR-based 3D object detection for autonomous driving, the ratio of the object size to input scene size is significantly smaller compared to 2D detection cases. Many 3D detectors directly follow the common practice of 2D detectors, which downsample the feature maps even after quantizing the point clouds. We propose Single-stride Sparse Transformer (SST) to maintain the original resolution from the beginning to the end of the network.
  arXiv  Detail & Related papers  (2021-12-13T02:12:02Z)
• 3D-VField: Learning to Adversarially Deform Point Clouds for Robust 3D Object Detection [111.32054128362427]
  In safety-critical settings, robustness on out-of-distribution and long-tail samples is fundamental to circumvent dangerous issues. We substantially improve the generalization of 3D object detectors to out-of-domain data by taking into account deformed point clouds during training. We propose and share open source CrashD: a synthetic dataset of realistic damaged and rare cars.
  arXiv  Detail & Related papers  (2021-12-09T08:50:54Z)
• VPFNet: Improving 3D Object Detection with Virtual Point based LiDAR and Stereo Data Fusion [62.24001258298076]
  VPFNet is a new architecture that cleverly aligns and aggregates the point cloud and image data at the virtual' points. Our VPFNet achieves 83.21% moderate 3D AP and 91.86% moderate BEV AP on the KITTI test set, ranking the 1st since May 21th, 2021.
  arXiv  Detail & Related papers  (2021-11-29T08:51:20Z)
• Progressive Coordinate Transforms for Monocular 3D Object Detection [52.00071336733109]
  We propose a novel and lightweight approach, dubbed em Progressive Coordinate Transforms (PCT) to facilitate learning coordinate representations. In this paper, we propose a novel and lightweight approach, dubbed em Progressive Coordinate Transforms (PCT) to facilitate learning coordinate representations.
  arXiv  Detail & Related papers  (2021-08-12T15:22:33Z)
• DeepCompress: Efficient Point Cloud Geometry Compression [1.808877001896346]
  We propose a more efficient deep learning-based encoder architecture for point clouds compression. We show that incorporating the learned activation function from Efficient Neural Image Compression (CENIC) yields dramatic gains in efficiency and performance. Our proposed modifications outperform the baseline approaches by a small margin in terms of Bjontegard delta rate and PSNR values.
  arXiv  Detail & Related papers  (2021-06-02T23:18:11Z)
• Multiscale Point Cloud Geometry Compression [29.605320327889142]
  We propose a multiscale-to-end learning framework which hierarchically reconstructs the 3D Point Cloud Geometry. The framework is developed on top of a sparse convolution based autoencoder for point cloud compression and reconstruction.
  arXiv  Detail & Related papers  (2020-11-07T16:11:16Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.