Coarse-to-Fine Point Cloud Registration with SE(3)-Equivariant Representations

• URL: http://arxiv.org/abs/2210.02045v1
• Date: Wed, 5 Oct 2022 06:35:01 GMT
• Title: Coarse-to-Fine Point Cloud Registration with SE(3)-Equivariant Representations
• Authors: Cheng-Wei Lin, Tung-I Chen, Hsin-Ying Lee, Wen-Chin Chen, and Winston H. Hsu
• Abstract summary: Point cloud registration is a crucial problem in computer vision and robotics. We adopt a coarse-to-fine pipeline that concurrently handles both issues. Our proposed method increases the recall rate by 20% compared to state-of-the-art methods.
• Score: 24.772676537277547
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Point cloud registration is a crucial problem in computer vision and robotics. Existing methods either rely on matching local geometric features, which are sensitive to the pose differences, or leverage global shapes and thereby lead to inconsistency when facing distribution variances such as partial overlapping. Combining the advantages of both types of methods, we adopt a coarse-to-fine pipeline that concurrently handles both issues. We first reduce the pose differences between input point clouds by aligning global features; then we match the local features to further refine the inaccurate alignments resulting from distribution variances. As global feature alignment requires the features to preserve the poses of input point clouds and local feature matching expects the features to be invariant to these poses, we propose an SE(3)-equivariant feature extractor to simultaneously generate two types of features. In this feature extractor, representations preserving the poses are first encoded by our novel SE(3)-equivariant network and then converted into pose-invariant ones by a pose-detaching module. Experiments demonstrate that our proposed method increases the recall rate by 20% compared to state-of-the-art methods when facing both pose differences and distribution variances.

Related papers

• BiEquiFormer: Bi-Equivariant Representations for Global Point Cloud Registration [28.75341781515012]
  We show that state-of-the-art deep learning methods suffer from huge performance degradation when the point clouds are arbitrarily placed in space. We design BiEquiformer a novel and scalable textitbi-equivariant pipeline. This allows us to extract high-quality superpoint correspondences and in turn, robust point-cloud registration.
  arXiv  Detail & Related papers  (2024-07-11T17:58:10Z)
• Generalizing Neural Human Fitting to Unseen Poses With Articulated SE(3) Equivariance [48.39751410262664]
  ArtEq is a part-based SE(3)-equivariant neural architecture for SMPL model estimation from point clouds. Experimental results show that ArtEq generalizes to poses not seen during training, outperforming state-of-the-art methods by 44% in terms of body reconstruction accuracy.
  arXiv  Detail & Related papers  (2023-04-20T17:58:26Z)
• SSP-Pose: Symmetry-Aware Shape Prior Deformation for Direct Category-Level Object Pose Estimation [77.88624073105768]
  Category-level pose estimation is a challenging problem due to intra-class shape variations. We propose an end-to-end trainable network SSP-Pose for category-level pose estimation. SSP-Pose produces superior performance compared with competitors with a real-time inference speed at about 25Hz.
  arXiv  Detail & Related papers  (2022-08-13T14:37:31Z)
• E2PN: Efficient SE(3)-Equivariant Point Network [12.520265159777255]
  This paper proposes a convolution structure for learning SE(3)-equivariant features from 3D point clouds. It can be viewed as an equivariant version of kernel point convolutions (KPConv), a widely used convolution form to process point cloud data.
  arXiv  Detail & Related papers  (2022-06-11T02:15:46Z)
• SE(3)-Equivariant Attention Networks for Shape Reconstruction in Function Space [50.14426188851305]
  We propose the first SE(3)-equivariant coordinate-based network for learning occupancy fields from point clouds. In contrast to previous shape reconstruction methods that align the input to a regular grid, we operate directly on the irregular, unoriented point cloud. We show that our method outperforms previous SO(3)-equivariant methods, as well as non-equivariant methods trained on SO(3)-augmented datasets.
  arXiv  Detail & Related papers  (2022-04-05T17:59:15Z)
• Shape-Pose Disentanglement using SE(3)-equivariant Vector Neurons [59.83721247071963]
  We introduce an unsupervised technique for encoding point clouds into a canonical shape representation, by disentangling shape and pose. Our encoder is stable and consistent, meaning that the shape encoding is purely pose-invariant. The extracted rotation and translation are able to semantically align different input shapes of the same class to a common canonical pose.
  arXiv  Detail & Related papers  (2022-04-03T21:00:44Z)
• Correspondence-Free Point Cloud Registration with SO(3)-Equivariant Implicit Shape Representations [12.343333815270402]
  The proposed shape registration method achieves three major advantages through combining equivariant feature learning with implicit shape models. Results show superior performance compared with existing correspondence-free deep registration methods.
  arXiv  Detail & Related papers  (2021-07-21T18:18:21Z)
• Dynamic Convolution for 3D Point Cloud Instance Segmentation [146.7971476424351]
  We propose an approach to instance segmentation from 3D point clouds based on dynamic convolution. We gather homogeneous points that have identical semantic categories and close votes for the geometric centroids. The proposed approach is proposal-free, and instead exploits a convolution process that adapts to the spatial and semantic characteristics of each instance.
  arXiv  Detail & Related papers  (2021-07-18T09:05:16Z)
• A Rotation-Invariant Framework for Deep Point Cloud Analysis [132.91915346157018]
  We introduce a new low-level purely rotation-invariant representation to replace common 3D Cartesian coordinates as the network inputs. Also, we present a network architecture to embed these representations into features, encoding local relations between points and their neighbors, and the global shape structure. We evaluate our method on multiple point cloud analysis tasks, including shape classification, part segmentation, and shape retrieval.
  arXiv  Detail & Related papers  (2020-03-16T14:04:45Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.