Deep Positional and Relational Feature Learning for Rotation-Invariant Point Cloud Analysis

• URL: http://arxiv.org/abs/2011.09080v1
• Date: Wed, 18 Nov 2020 04:16:51 GMT
• Title: Deep Positional and Relational Feature Learning for Rotation-Invariant Point Cloud Analysis
• Authors: Ruixuan Yu, Xin Wei, Federico Tombari, and Jian Sun
• Abstract summary: We propose a rotation-invariant deep network for point clouds analysis. The network is hierarchical and relies on two modules: a positional feature embedding block and a relational feature embedding block. Experiments show state-of-the-art classification and segmentation performances on benchmark datasets.
• Score: 107.9979381402172
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In this paper we propose a rotation-invariant deep network for point clouds analysis. Point-based deep networks are commonly designed to recognize roughly aligned 3D shapes based on point coordinates, but suffer from performance drops with shape rotations. Some geometric features, e.g., distances and angles of points as inputs of network, are rotation-invariant but lose positional information of points. In this work, we propose a novel deep network for point clouds by incorporating positional information of points as inputs while yielding rotation-invariance. The network is hierarchical and relies on two modules: a positional feature embedding block and a relational feature embedding block. Both modules and the whole network are proven to be rotation-invariant when processing point clouds as input. Experiments show state-of-the-art classification and segmentation performances on benchmark datasets, and ablation studies demonstrate effectiveness of the network design.

Related papers

• CRIN: Rotation-Invariant Point Cloud Analysis and Rotation Estimation via Centrifugal Reference Frame [60.24797081117877]
  We propose the CRIN, namely Centrifugal Rotation-Invariant Network. CRIN directly takes the coordinates of points as input and transforms local points into rotation-invariant representations. A continuous distribution for 3D rotations based on points is introduced.
  arXiv  Detail & Related papers  (2023-03-06T13:14:10Z)
• RIConv++: Effective Rotation Invariant Convolutions for 3D Point Clouds Deep Learning [32.18566879365623]
  3D point clouds deep learning is a promising field of research that allows a neural network to learn features of point clouds directly. We propose a simple yet effective convolution operator that enhances feature distinction by designing powerful rotation invariant features from the local regions. Our network architecture can capture both local and global context by simply tuning the neighborhood size in each convolution layer.
  arXiv  Detail & Related papers  (2022-02-26T08:32:44Z)
• PRIN/SPRIN: On Extracting Point-wise Rotation Invariant Features [91.2054994193218]
  We propose a point-set learning framework PRIN, focusing on rotation invariant feature extraction in point clouds analysis. In addition, we extend PRIN to a sparse version called SPRIN, which directly operates on sparse point clouds. Results show that, on the dataset with randomly rotated point clouds, SPRIN demonstrates better performance than state-of-the-art methods without any data augmentation.
  arXiv  Detail & Related papers  (2021-02-24T06:44:09Z)
• ODFNet: Using orientation distribution functions to characterize 3D point clouds [0.0]
  We leverage on point orientation distributions around a point in order to obtain an expressive local neighborhood representation for point clouds. New ODFNet model achieves state-of-the-art accuracy for object classification on ModelNet40 and ScanObjectNN datasets.
  arXiv  Detail & Related papers  (2020-12-08T19:54:20Z)
• Refinement of Predicted Missing Parts Enhance Point Cloud Completion [62.997667081978825]
  Point cloud completion is the task of predicting complete geometry from partial observations using a point set representation for a 3D shape. Previous approaches propose neural networks to directly estimate the whole point cloud through encoder-decoder models fed by the incomplete point set. This paper proposes an end-to-end neural network architecture that focuses on computing the missing geometry and merging the known input and the predicted point cloud.
  arXiv  Detail & Related papers  (2020-10-08T22:01:23Z)
• A Rotation-Invariant Framework for Deep Point Cloud Analysis [132.91915346157018]
  We introduce a new low-level purely rotation-invariant representation to replace common 3D Cartesian coordinates as the network inputs. Also, we present a network architecture to embed these representations into features, encoding local relations between points and their neighbors, and the global shape structure. We evaluate our method on multiple point cloud analysis tasks, including shape classification, part segmentation, and shape retrieval.
  arXiv  Detail & Related papers  (2020-03-16T14:04:45Z)
• 6D Object Pose Regression via Supervised Learning on Point Clouds [42.21181542960924]
  This paper addresses the task of estimating the 6 degrees of freedom pose of a known 3D object from depth information represented by a point cloud. We use depth information represented by point clouds as the input to both deep networks and geometry-based pose refinement. Our simple yet effective approach clearly outperforms state-of-the-art methods on the YCB-video dataset.
  arXiv  Detail & Related papers  (2020-01-24T10:29:54Z)
• Quaternion Equivariant Capsule Networks for 3D Point Clouds [58.566467950463306]
  We present a 3D capsule module for processing point clouds that is equivariant to 3D rotations and translations. We connect dynamic routing between capsules to the well-known Weiszfeld algorithm. Based on our operator, we build a capsule network that disentangles geometry from pose.
  arXiv  Detail & Related papers  (2019-12-27T13:51:17Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.