Rotation-Invariant Transformer for Point Cloud Matching

• URL: http://arxiv.org/abs/2303.08231v3
• Date: Wed, 27 Mar 2024 06:00:18 GMT
• Title: Rotation-Invariant Transformer for Point Cloud Matching
• Authors: Hao Yu, Zheng Qin, Ji Hou, Mahdi Saleh, Dongsheng Li, Benjamin Busam, Slobodan Ilic,
• Abstract summary: We introduce RoITr, a Rotation-Invariant Transformer to cope with the pose variations in the point cloud matching task. We propose a global transformer with rotation-invariant cross-frame spatial awareness learned by the self-attention mechanism. RoITr surpasses the existing methods by at least 13 and 5 percentage points in terms of Inlier Ratio and Registration Recall.
• Score: 42.5714375149213
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The intrinsic rotation invariance lies at the core of matching point clouds with handcrafted descriptors. However, it is widely despised by recent deep matchers that obtain the rotation invariance extrinsically via data augmentation. As the finite number of augmented rotations can never span the continuous SO(3) space, these methods usually show instability when facing rotations that are rarely seen. To this end, we introduce RoITr, a Rotation-Invariant Transformer to cope with the pose variations in the point cloud matching task. We contribute both on the local and global levels. Starting from the local level, we introduce an attention mechanism embedded with Point Pair Feature (PPF)-based coordinates to describe the pose-invariant geometry, upon which a novel attention-based encoder-decoder architecture is constructed. We further propose a global transformer with rotation-invariant cross-frame spatial awareness learned by the self-attention mechanism, which significantly improves the feature distinctiveness and makes the model robust with respect to the low overlap. Experiments are conducted on both the rigid and non-rigid public benchmarks, where RoITr outperforms all the state-of-the-art models by a considerable margin in the low-overlapping scenarios. Especially when the rotations are enlarged on the challenging 3DLoMatch benchmark, RoITr surpasses the existing methods by at least 13 and 5 percentage points in terms of Inlier Ratio and Registration Recall, respectively.

Related papers

• CRIN: Rotation-Invariant Point Cloud Analysis and Rotation Estimation via Centrifugal Reference Frame [60.24797081117877]
  We propose the CRIN, namely Centrifugal Rotation-Invariant Network. CRIN directly takes the coordinates of points as input and transforms local points into rotation-invariant representations. A continuous distribution for 3D rotations based on points is introduced.
  arXiv  Detail & Related papers  (2023-03-06T13:14:10Z)
• General Rotation Invariance Learning for Point Clouds via Weight-Feature Alignment [40.421478916432676]
  We propose Weight-Feature Alignment (WFA) to construct a local Invariant Reference Frame (IRF) Our WFA algorithm provides a general solution for the point clouds of all scenes.
  arXiv  Detail & Related papers  (2023-02-20T11:08:07Z)
• PaRot: Patch-Wise Rotation-Invariant Network via Feature Disentanglement and Pose Restoration [16.75367717130046]
  State-of-the-art models are not robust to rotations, which remains an unknown prior to real applications. We introduce a novel Patch-wise Rotation-invariant network (PaRot) Our disentanglement module extracts high-quality rotation-robust features and the proposed lightweight model achieves competitive results.
  arXiv  Detail & Related papers  (2023-02-06T02:13:51Z)
• ART-Point: Improving Rotation Robustness of Point Cloud Classifiers via Adversarial Rotation [89.47574181669903]
  In this study, we show that the rotation robustness of point cloud classifiers can also be acquired via adversarial training. Specifically, our proposed framework named ART-Point regards the rotation of the point cloud as an attack. We propose a fast one-step optimization to efficiently reach the final robust model.
  arXiv  Detail & Related papers  (2022-03-08T07:20:16Z)
• Attentive Rotation Invariant Convolution for Point Cloud-based Large Scale Place Recognition [11.433270318356675]
  We propose an Attentive Rotation Invariant Convolution (ARIConv) in this paper. We experimentally demonstrate that our model can achieve state-of-the-art performance on large scale place recognition task when the point cloud scans are rotated.
  arXiv  Detail & Related papers  (2021-08-29T09:10:56Z)
• PRIN/SPRIN: On Extracting Point-wise Rotation Invariant Features [91.2054994193218]
  We propose a point-set learning framework PRIN, focusing on rotation invariant feature extraction in point clouds analysis. In addition, we extend PRIN to a sparse version called SPRIN, which directly operates on sparse point clouds. Results show that, on the dataset with randomly rotated point clouds, SPRIN demonstrates better performance than state-of-the-art methods without any data augmentation.
  arXiv  Detail & Related papers  (2021-02-24T06:44:09Z)
• A Rotation-Invariant Framework for Deep Point Cloud Analysis [132.91915346157018]
  We introduce a new low-level purely rotation-invariant representation to replace common 3D Cartesian coordinates as the network inputs. Also, we present a network architecture to embed these representations into features, encoding local relations between points and their neighbors, and the global shape structure. We evaluate our method on multiple point cloud analysis tasks, including shape classification, part segmentation, and shape retrieval.
  arXiv  Detail & Related papers  (2020-03-16T14:04:45Z)
• Quaternion Equivariant Capsule Networks for 3D Point Clouds [58.566467950463306]
  We present a 3D capsule module for processing point clouds that is equivariant to 3D rotations and translations. We connect dynamic routing between capsules to the well-known Weiszfeld algorithm. Based on our operator, we build a capsule network that disentangles geometry from pose.
  arXiv  Detail & Related papers  (2019-12-27T13:51:17Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.