CSI: Enhancing the Robustness of 3D Point Cloud Recognition against Corruption

• URL: http://arxiv.org/abs/2310.03360v1
• Date: Thu, 5 Oct 2023 07:30:52 GMT
• Title: CSI: Enhancing the Robustness of 3D Point Cloud Recognition against Corruption
• Authors: Zhuoyuan Wu, Jiachen Sun, Chaowei Xiao
• Abstract summary: Real-world safety-critical applications present challenges due to unavoidable data corruption. In this study, we harness the inherent set property of point cloud data to introduce a novel critical subset identification (CSI) method. Our CSI framework integrates two pivotal components: density-aware sampling (DAS) and self-entropy minimization (SEM)
• Score: 33.70232326721406
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Despite recent advancements in deep neural networks for point cloud recognition, real-world safety-critical applications present challenges due to unavoidable data corruption. Current models often fall short in generalizing to unforeseen distribution shifts. In this study, we harness the inherent set property of point cloud data to introduce a novel critical subset identification (CSI) method, aiming to bolster recognition robustness in the face of data corruption. Our CSI framework integrates two pivotal components: density-aware sampling (DAS) and self-entropy minimization (SEM), which cater to static and dynamic CSI, respectively. DAS ensures efficient robust anchor point sampling by factoring in local density, while SEM is employed during training to accentuate the most salient point-to-point attention. Evaluations reveal that our CSI approach yields error rates of 18.4\% and 16.3\% on ModelNet40-C and PointCloud-C, respectively, marking a notable improvement over state-of-the-art methods by margins of 5.2\% and 4.2\% on the respective benchmarks. Code is available at \href{https://github.com/masterwu2115/CSI/tree/main}{https://github.com/masterwu2115/CSI/tree/main}

Related papers

• Point Cloud Understanding via Attention-Driven Contrastive Learning [64.65145700121442]
  Transformer-based models have advanced point cloud understanding by leveraging self-attention mechanisms. PointACL is an attention-driven contrastive learning framework designed to address these limitations. Our method employs an attention-driven dynamic masking strategy that guides the model to focus on under-attended regions.
  arXiv  Detail & Related papers  (2024-11-22T05:41:00Z)
• SGCCNet: Single-Stage 3D Object Detector With Saliency-Guided Data Augmentation and Confidence Correction Mechanism [7.631190617438259]
  Single-stage point-based 3D object detectors face challenges such as inadequate learning of low-quality objects (ILQ) and misalignment between localization accuracy and classification confidence (MLC) For ILQ, SGCCNet adopts a Saliency-Guided Data Augmentation (SGDA) strategy to enhance the robustness of the model on low-quality objects. For MLC, we design a Confidence Correction Mechanism ( CCM) specifically for point-based multi-class detectors.
  arXiv  Detail & Related papers  (2024-07-01T12:36:01Z)
• Point Cloud Pre-training with Diffusion Models [62.12279263217138]
  We propose a novel pre-training method called Point cloud Diffusion pre-training (PointDif) PointDif achieves substantial improvement across various real-world datasets for diverse downstream tasks such as classification, segmentation and detection.
  arXiv  Detail & Related papers  (2023-11-25T08:10:05Z)
• Sample-adaptive Augmentation for Point Cloud Recognition Against Real-world Corruptions [20.95456179904285]
  We propose an alternative to make sample-adaptive transformations based on the structure of the sample, named as AdaptPoint. A discriminator is utilized to prevent the generation of excessive corruption that deviates from the original data distribution. Experiments show that our method achieves state-of-the-art results on multiple corruption benchmarks, including ModelNet-C, our ScanObjectNN-C, and ShapeNet-C.
  arXiv  Detail & Related papers  (2023-09-19T08:46:43Z)
• Small Object Detection via Coarse-to-fine Proposal Generation and Imitation Learning [52.06176253457522]
  We propose a two-stage framework tailored for small object detection based on the Coarse-to-fine pipeline and Feature Imitation learning. CFINet achieves state-of-the-art performance on the large-scale small object detection benchmarks, SODA-D and SODA-A.
  arXiv  Detail & Related papers  (2023-08-18T13:13:09Z)
• Risk-optimized Outlier Removal for Robust 3D Point Cloud Classification [54.286437930350445]
  This paper highlights the challenges of point cloud classification posed by various forms of noise. We introduce an innovative point outlier cleansing method that harnesses the power of downstream classification models. Our proposed technique not only robustly filters diverse point cloud outliers but also consistently and significantly enhances existing robust methods for point cloud classification.
  arXiv  Detail & Related papers  (2023-07-20T13:47:30Z)
• Benchmarking Robustness of 3D Point Cloud Recognition Against Common Corruptions [38.89370166717221]
  We present ModelNet40-C, the first comprehensive benchmark on 3D point cloud corruption robustness. Our evaluation shows a significant gap between the performances on ModelNet40 and ModelNet40-C for state-of-the-art (SOTA) models. We unveil that Transformer-based architectures with proper training recipes achieve the strongest robustness.
  arXiv  Detail & Related papers  (2022-01-28T18:01:42Z)
• Contrastive Embedding Distribution Refinement and Entropy-Aware Attention for 3D Point Cloud Classification [3.710922682020501]
  This work offers a new strategy for learning powerful representations via a contrastive learning approach that can be embedded into any point cloud classification network. Our method achieves 82.9% accuracy on the real-world ScanObjectNN dataset and substantial performance gains up to 2.9% in DCGNN, 3.1% in PointNet++, and 2.4% in GBNet.
  arXiv  Detail & Related papers  (2022-01-27T09:10:28Z)
• CLNet: Complex Input Lightweight Neural Network designed for Massive MIMO CSI Feedback [7.63185216082836]
  This paper presents a novel neural network CLNet tailored for CSI feedback problem based on the intrinsic properties of CSI. The experiment result shows that CLNet outperforms the state-of-the-art method by average accuracy improvement of 5.41% in both outdoor and indoor scenarios.
  arXiv  Detail & Related papers  (2021-02-15T12:16:11Z)
• PC-RGNN: Point Cloud Completion and Graph Neural Network for 3D Object Detection [57.49788100647103]
  LiDAR-based 3D object detection is an important task for autonomous driving. Current approaches suffer from sparse and partial point clouds of distant and occluded objects. In this paper, we propose a novel two-stage approach, namely PC-RGNN, dealing with such challenges by two specific solutions.
  arXiv  Detail & Related papers  (2020-12-18T18:06:43Z)
• Uncertainty-Aware Deep Calibrated Salient Object Detection [74.58153220370527]
  Existing deep neural network based salient object detection (SOD) methods mainly focus on pursuing high network accuracy. These methods overlook the gap between network accuracy and prediction confidence, known as the confidence uncalibration problem. We introduce an uncertaintyaware deep SOD network, and propose two strategies to prevent deep SOD networks from being overconfident.
  arXiv  Detail & Related papers  (2020-12-10T23:28:36Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.