Consistent Two-Flow Network for Tele-Registration of Point Clouds

• URL: http://arxiv.org/abs/2106.00329v1
• Date: Tue, 1 Jun 2021 09:03:21 GMT
• Title: Consistent Two-Flow Network for Tele-Registration of Point Clouds
• Authors: Zihao Yan, Zimu Yi, Ruizhen Hu, Niloy J. Mitra, Daniel Cohen-Or, Hui Huang
• Abstract summary: We present a learning-based technique that allows registration between point clouds, presented in arbitrary poses, and having little or even no overlap. Our technique is based on a novel neural network design that learns a prior of a class of shapes and can complete a partial shape. We show that, compared with each separate flow, this two-flow training leads to robust and reliable tele-registration.
• Score: 74.51029406361997
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Rigid registration of partial observations is a fundamental problem in various applied fields. In computer graphics, special attention has been given to the registration between two partial point clouds generated by scanning devices. State-of-the-art registration techniques still struggle when the overlap region between the two point clouds is small, and completely fail if there is no overlap between the scan pairs. In this paper, we present a learning-based technique that alleviates this problem, and allows registration between point clouds, presented in arbitrary poses, and having little or even no overlap, a setting that has been referred to as tele-registration. Our technique is based on a novel neural network design that learns a prior of a class of shapes and can complete a partial shape. The key idea is combining the registration and completion tasks in a way that reinforces each other. In particular, we simultaneously train the registration network and completion network using two coupled flows, one that register-and-complete, and one that complete-and-register, and encourage the two flows to produce a consistent result. We show that, compared with each separate flow, this two-flow training leads to robust and reliable tele-registration, and hence to a better point cloud prediction that completes the registered scans. It is also worth mentioning that each of the components in our neural network outperforms state-of-the-art methods in both completion and registration. We further analyze our network with several ablation studies and demonstrate its performance on a large number of partial point clouds, both synthetic and real-world, that have only small or no overlap.

Related papers

• Cross-Modal Information-Guided Network using Contrastive Learning for Point Cloud Registration [17.420425069785946]
  We present a novel Cross-Modal Information-Guided Network (CMIGNet) for point cloud registration. We first incorporate the projected images from the point clouds and fuse the cross-modal features using the attention mechanism. We employ two contrastive learning strategies, namely overlapping contrastive learning and cross-modal contrastive learning.
  arXiv  Detail & Related papers  (2023-11-02T12:56:47Z)
• DBDNet:Partial-to-Partial Point Cloud Registration with Dual Branches Decoupling [15.382633946370978]
  We propose an effective registration method with dual branches decoupling for partial-to-partial registration, dubbed as DBDNet. We present an overlap predictor that benefits from explicit feature interaction, which is achieved by the powerful attention mechanism to accurately predict pointwise masks. We design a multi-resolution feature extraction network to capture both local and global patterns thus enhancing both overlap prediction and registration module.
  arXiv  Detail & Related papers  (2023-10-18T06:09:12Z)
• Overlap Bias Matching is Necessary for Point Cloud Registration [21.584033532099134]
  Overlap between point clouds to be registered may be relatively small. We propose an unsupervised network Overlap Bias Matching Network (OBMNet) for partial point cloud registration.
  arXiv  Detail & Related papers  (2023-08-18T07:47:22Z)
• Robust Multiview Point Cloud Registration with Reliable Pose Graph Initialization and History Reweighting [63.95845583460312]
  We present a new method for the multiview registration of point cloud. Our method achieves 11% higher registration recall on the 3DMatch dataset and 13% lower registration errors on the ScanNet dataset.
  arXiv  Detail & Related papers  (2023-04-02T06:43:40Z)
• GenReg: Deep Generative Method for Fast Point Cloud Registration [18.66568286698704]
  We propose a new data-driven registration algorithm by investigating deep generative neural networks to point cloud registration. The experiments on both ModelNet40 and 7Scene datasets demonstrate that the proposed algorithm achieves state-of-the-art accuracy and efficiency.
  arXiv  Detail & Related papers  (2021-11-23T10:52:09Z)
• PCAM: Product of Cross-Attention Matrices for Rigid Registration of Point Clouds [79.99653758293277]
  PCAM is a neural network whose key element is a pointwise product of cross-attention matrices. We show that PCAM achieves state-of-the-art results among methods which, like us, solve steps (a) and (b) jointly via deepnets.
  arXiv  Detail & Related papers  (2021-10-04T09:23:27Z)
• Cascaded Refinement Network for Point Cloud Completion with Self-supervision [74.80746431691938]
  We introduce a two-branch network for shape completion. The first branch is a cascaded shape completion sub-network to synthesize complete objects. The second branch is an auto-encoder to reconstruct the original partial input.
  arXiv  Detail & Related papers  (2020-10-17T04:56:22Z)
• Refinement of Predicted Missing Parts Enhance Point Cloud Completion [62.997667081978825]
  Point cloud completion is the task of predicting complete geometry from partial observations using a point set representation for a 3D shape. Previous approaches propose neural networks to directly estimate the whole point cloud through encoder-decoder models fed by the incomplete point set. This paper proposes an end-to-end neural network architecture that focuses on computing the missing geometry and merging the known input and the predicted point cloud.
  arXiv  Detail & Related papers  (2020-10-08T22:01:23Z)
• Learning multiview 3D point cloud registration [74.39499501822682]
  We present a novel, end-to-end learnable, multiview 3D point cloud registration algorithm. Our approach outperforms the state-of-the-art by a significant margin, while being end-to-end trainable and computationally less costly.
  arXiv  Detail & Related papers  (2020-01-15T03:42:14Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.