PointASNL: Robust Point Clouds Processing using Nonlocal Neural Networks with Adaptive Sampling

• URL: http://arxiv.org/abs/2003.00492v3
• Date: Tue, 5 May 2020 07:46:18 GMT
• Title: PointASNL: Robust Point Clouds Processing using Nonlocal Neural Networks with Adaptive Sampling
• Authors: Xu Yan, Chaoda Zheng, Zhen Li, Sheng Wang and Shuguang Cui
• Abstract summary: We present a novel end-to-end network for robust point clouds processing, named PointASNL. Key component in our approach is the adaptive sampling (AS) module. Our AS module can not only benefit the feature learning of point clouds, but also ease the biased effect of outliers.
• Score: 39.36827481232841
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Raw point clouds data inevitably contains outliers or noise through acquisition from 3D sensors or reconstruction algorithms. In this paper, we present a novel end-to-end network for robust point clouds processing, named PointASNL, which can deal with point clouds with noise effectively. The key component in our approach is the adaptive sampling (AS) module. It first re-weights the neighbors around the initial sampled points from farthest point sampling (FPS), and then adaptively adjusts the sampled points beyond the entire point cloud. Our AS module can not only benefit the feature learning of point clouds, but also ease the biased effect of outliers. To further capture the neighbor and long-range dependencies of the sampled point, we proposed a local-nonlocal (L-NL) module inspired by the nonlocal operation. Such L-NL module enables the learning process insensitive to noise. Extensive experiments verify the robustness and superiority of our approach in point clouds processing tasks regardless of synthesis data, indoor data, and outdoor data with or without noise. Specifically, PointASNL achieves state-of-the-art robust performance for classification and segmentation tasks on all datasets, and significantly outperforms previous methods on real-world outdoor SemanticKITTI dataset with considerate noise. Our code is released through https://github.com/yanx27/PointASNL.

Related papers

• P2P-Bridge: Diffusion Bridges for 3D Point Cloud Denoising [81.92854168911704]
  We tackle the task of point cloud denoising through a novel framework that adapts Diffusion Schr"odinger bridges to points clouds. Experiments on object datasets show that P2P-Bridge achieves significant improvements over existing methods.
  arXiv  Detail & Related papers  (2024-08-29T08:00:07Z)
• Learning Continuous Implicit Field with Local Distance Indicator for Arbitrary-Scale Point Cloud Upsampling [55.05706827963042]
  Point cloud upsampling aims to generate dense and uniformly distributed point sets from a sparse point cloud. Previous methods typically split a sparse point cloud into several local patches, upsample patch points, and merge all upsampled patches. We propose a novel approach that learns an unsigned distance field guided by local priors for point cloud upsampling.
  arXiv  Detail & Related papers  (2023-12-23T01:52:14Z)
• SphereNet: Learning a Noise-Robust and General Descriptor for Point Cloud Registration [5.641476052216014]
  We introduce SphereNet to learn a noise-robust and unseen-general descriptor for point cloud registration. A new benchmark 3DMatch-noise with strong noise is introduced to evaluate our methods. It sets a new state-of-the-art performance for the 3DMatch and 3DLoMatch benchmarks with 93.5% and 75.6% registration recall.
  arXiv  Detail & Related papers  (2023-07-18T15:37:35Z)
• Self-Supervised Arbitrary-Scale Point Clouds Upsampling via Implicit Neural Representation [79.60988242843437]
  We propose a novel approach that achieves self-supervised and magnification-flexible point clouds upsampling simultaneously. Experimental results demonstrate that our self-supervised learning based scheme achieves competitive or even better performance than supervised learning based state-of-the-art methods.
  arXiv  Detail & Related papers  (2022-04-18T07:18:25Z)
• Learning with Noisy Labels for Robust Point Cloud Segmentation [22.203927159777123]
  Object class labels are often mislabeled in real-world point cloud datasets. We propose a novel Point Noise-Adaptive Learning (PNAL) framework. We conduct extensive experiments to demonstrate the effectiveness of PNAL on both synthetic and real-world noisy datasets.
  arXiv  Detail & Related papers  (2021-07-29T17:59:54Z)
• Score-Based Point Cloud Denoising [26.090445369658312]
  Point clouds acquired from scanning devices are often perturbed by noise, which affects downstream tasks such as surface reconstruction and analysis. We propose to increase the log-likelihood of each point from $p * n$ via gradient ascent -- iteratively updating each point's position. We derive objective functions for training the network and develop a denoising algorithm leveraging on the estimated scores.
  arXiv  Detail & Related papers  (2021-07-23T01:13:03Z)
• Learning Semantic Segmentation of Large-Scale Point Clouds with Random Sampling [52.464516118826765]
  We introduce RandLA-Net, an efficient and lightweight neural architecture to infer per-point semantics for large-scale point clouds. The key to our approach is to use random point sampling instead of more complex point selection approaches. Our RandLA-Net can process 1 million points in a single pass up to 200x faster than existing approaches.
  arXiv  Detail & Related papers  (2021-07-06T05:08:34Z)
• PRIN/SPRIN: On Extracting Point-wise Rotation Invariant Features [91.2054994193218]
  We propose a point-set learning framework PRIN, focusing on rotation invariant feature extraction in point clouds analysis. In addition, we extend PRIN to a sparse version called SPRIN, which directly operates on sparse point clouds. Results show that, on the dataset with randomly rotated point clouds, SPRIN demonstrates better performance than state-of-the-art methods without any data augmentation.
  arXiv  Detail & Related papers  (2021-02-24T06:44:09Z)
• Differentiable Manifold Reconstruction for Point Cloud Denoising [23.33652755967715]
  3D point clouds are often perturbed by noise due to the inherent limitation of acquisition equipments. We propose to learn the underlying manifold of a noisy point cloud from differentiably subsampled points. We show that our method significantly outperforms state-of-the-art denoising methods under both synthetic noise and real world noise.
  arXiv  Detail & Related papers  (2020-07-27T13:31:41Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.