Rethinking Rotation Invariance with Point Cloud Registration

• URL: http://arxiv.org/abs/2301.00149v1
• Date: Sat, 31 Dec 2022 08:17:09 GMT
• Title: Rethinking Rotation Invariance with Point Cloud Registration
• Authors: Jianhui Yu, Chaoyi Zhang, Weidong Cai
• Abstract summary: We propose an effective framework for rotation invariance learning via three sequential stages, namely rotation-invariant shape encoding, aligned feature integration, and deep feature registration. Experimental results on 3D shape classification, part segmentation, and retrieval tasks prove the feasibility of our work.
• Score: 18.829454172955202
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Recent investigations on rotation invariance for 3D point clouds have been devoted to devising rotation-invariant feature descriptors or learning canonical spaces where objects are semantically aligned. Examinations of learning frameworks for invariance have seldom been looked into. In this work, we review rotation invariance in terms of point cloud registration and propose an effective framework for rotation invariance learning via three sequential stages, namely rotation-invariant shape encoding, aligned feature integration, and deep feature registration. We first encode shape descriptors constructed with respect to reference frames defined over different scales, e.g., local patches and global topology, to generate rotation-invariant latent shape codes. Within the integration stage, we propose Aligned Integration Transformer to produce a discriminative feature representation by integrating point-wise self- and cross-relations established within the shape codes. Meanwhile, we adopt rigid transformations between reference frames to align the shape codes for feature consistency across different scales. Finally, the deep integrated feature is registered to both rotation-invariant shape codes to maximize feature similarities, such that rotation invariance of the integrated feature is preserved and shared semantic information is implicitly extracted from shape codes. Experimental results on 3D shape classification, part segmentation, and retrieval tasks prove the feasibility of our work. Our project page is released at: https://rotation3d.github.io/.

Related papers

• Learning SO(3)-Invariant Semantic Correspondence via Local Shape Transform [62.27337227010514]
  We introduce a novel self-supervised Rotation-Invariant 3D correspondence learner with Local Shape Transform, dubbed RIST. RIST learns to establish dense correspondences between shapes even under challenging intra-class variations and arbitrary orientations. RIST demonstrates state-of-the-art performances on 3D part label transfer and semantic keypoint transfer given arbitrarily rotated point cloud pairs.
  arXiv  Detail & Related papers  (2024-04-17T08:09:25Z)
• CRIN: Rotation-Invariant Point Cloud Analysis and Rotation Estimation via Centrifugal Reference Frame [60.24797081117877]
  We propose the CRIN, namely Centrifugal Rotation-Invariant Network. CRIN directly takes the coordinates of points as input and transforms local points into rotation-invariant representations. A continuous distribution for 3D rotations based on points is introduced.
  arXiv  Detail & Related papers  (2023-03-06T13:14:10Z)
• General Rotation Invariance Learning for Point Clouds via Weight-Feature Alignment [40.421478916432676]
  We propose Weight-Feature Alignment (WFA) to construct a local Invariant Reference Frame (IRF) Our WFA algorithm provides a general solution for the point clouds of all scenes.
  arXiv  Detail & Related papers  (2023-02-20T11:08:07Z)
• PaRot: Patch-Wise Rotation-Invariant Network via Feature Disentanglement and Pose Restoration [16.75367717130046]
  State-of-the-art models are not robust to rotations, which remains an unknown prior to real applications. We introduce a novel Patch-wise Rotation-invariant network (PaRot) Our disentanglement module extracts high-quality rotation-robust features and the proposed lightweight model achieves competitive results.
  arXiv  Detail & Related papers  (2023-02-06T02:13:51Z)
• RIConv++: Effective Rotation Invariant Convolutions for 3D Point Clouds Deep Learning [32.18566879365623]
  3D point clouds deep learning is a promising field of research that allows a neural network to learn features of point clouds directly. We propose a simple yet effective convolution operator that enhances feature distinction by designing powerful rotation invariant features from the local regions. Our network architecture can capture both local and global context by simply tuning the neighborhood size in each convolution layer.
  arXiv  Detail & Related papers  (2022-02-26T08:32:44Z)
• PRIN/SPRIN: On Extracting Point-wise Rotation Invariant Features [91.2054994193218]
  We propose a point-set learning framework PRIN, focusing on rotation invariant feature extraction in point clouds analysis. In addition, we extend PRIN to a sparse version called SPRIN, which directly operates on sparse point clouds. Results show that, on the dataset with randomly rotated point clouds, SPRIN demonstrates better performance than state-of-the-art methods without any data augmentation.
  arXiv  Detail & Related papers  (2021-02-24T06:44:09Z)
• Deep Positional and Relational Feature Learning for Rotation-Invariant Point Cloud Analysis [107.9979381402172]
  We propose a rotation-invariant deep network for point clouds analysis. The network is hierarchical and relies on two modules: a positional feature embedding block and a relational feature embedding block. Experiments show state-of-the-art classification and segmentation performances on benchmark datasets.
  arXiv  Detail & Related papers  (2020-11-18T04:16:51Z)
• Global Context Aware Convolutions for 3D Point Cloud Understanding [32.953907994511376]
  We propose a novel convolution operator that enhances feature distinction by integrating global context information from the input point cloud to the convolution. A convolution can then be performed to transform the points and anchor features into final rotation-invariant features.
  arXiv  Detail & Related papers  (2020-08-07T04:33:27Z)
• A Rotation-Invariant Framework for Deep Point Cloud Analysis [132.91915346157018]
  We introduce a new low-level purely rotation-invariant representation to replace common 3D Cartesian coordinates as the network inputs. Also, we present a network architecture to embed these representations into features, encoding local relations between points and their neighbors, and the global shape structure. We evaluate our method on multiple point cloud analysis tasks, including shape classification, part segmentation, and shape retrieval.
  arXiv  Detail & Related papers  (2020-03-16T14:04:45Z)
• Quaternion Equivariant Capsule Networks for 3D Point Clouds [58.566467950463306]
  We present a 3D capsule module for processing point clouds that is equivariant to 3D rotations and translations. We connect dynamic routing between capsules to the well-known Weiszfeld algorithm. Based on our operator, we build a capsule network that disentangles geometry from pose.
  arXiv  Detail & Related papers  (2019-12-27T13:51:17Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.