DBDNet:Partial-to-Partial Point Cloud Registration with Dual Branches
Decoupling
- URL: http://arxiv.org/abs/2310.11733v1
- Date: Wed, 18 Oct 2023 06:09:12 GMT
- Title: DBDNet:Partial-to-Partial Point Cloud Registration with Dual Branches
Decoupling
- Authors: Shiqi Li, Jihua Zhu, Yifan Xie
- Abstract summary: We propose an effective registration method with dual branches decoupling for partial-to-partial registration, dubbed as DBDNet.
We present an overlap predictor that benefits from explicit feature interaction, which is achieved by the powerful attention mechanism to accurately predict pointwise masks.
We design a multi-resolution feature extraction network to capture both local and global patterns thus enhancing both overlap prediction and registration module.
- Score: 15.382633946370978
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Point cloud registration plays a crucial role in various computer vision
tasks, and usually demands the resolution of partial overlap registration in
practice. Most existing methods perform a serial calculation of rotation and
translation, while jointly predicting overlap during registration, this
coupling tends to degenerate the registration performance. In this paper, we
propose an effective registration method with dual branches decoupling for
partial-to-partial registration, dubbed as DBDNet. Specifically, we introduce a
dual branches structure to eliminate mutual interference error between rotation
and translation by separately creating two individual correspondence matrices.
For partial-to-partial registration, we consider overlap prediction as a
preordering task before the registration procedure. Accordingly, we present an
overlap predictor that benefits from explicit feature interaction, which is
achieved by the powerful attention mechanism to accurately predict pointwise
masks. Furthermore, we design a multi-resolution feature extraction network to
capture both local and global patterns thus enhancing both overlap prediction
and registration module. Experimental results on both synthetic and real
datasets validate the effectiveness of our proposed method.
Related papers
- Semi-weakly-supervised neural network training for medical image
registration [18.520388065729552]
This paper describes a semi-weakly-supervised registration pipeline that improves the model performance.
We examine two types of augmentation methods by perturbation on network weights and image resampling.
Experiments using 589 male pelvic MR images, labelled with eight anatomical ROIs, show the improvement in registration performance.
arXiv Detail & Related papers (2024-02-16T14:44:40Z) - Overlap Bias Matching is Necessary for Point Cloud Registration [21.584033532099134]
Overlap between point clouds to be registered may be relatively small.
We propose an unsupervised network Overlap Bias Matching Network (OBMNet) for partial point cloud registration.
arXiv Detail & Related papers (2023-08-18T07:47:22Z) - RegFormer: An Efficient Projection-Aware Transformer Network for
Large-Scale Point Cloud Registration [73.69415797389195]
We propose an end-to-end transformer network (RegFormer) for large-scale point cloud alignment.
Specifically, a projection-aware hierarchical transformer is proposed to capture long-range dependencies and filter outliers.
Our transformer has linear complexity, which guarantees high efficiency even for large-scale scenes.
arXiv Detail & Related papers (2023-03-22T08:47:37Z) - Overlap-guided Gaussian Mixture Models for Point Cloud Registration [61.250516170418784]
Probabilistic 3D point cloud registration methods have shown competitive performance in overcoming noise, outliers, and density variations.
This paper proposes a novel overlap-guided probabilistic registration approach that computes the optimal transformation from matched Gaussian Mixture Model (GMM) parameters.
arXiv Detail & Related papers (2022-10-17T08:02:33Z) - ReAct: Temporal Action Detection with Relational Queries [84.76646044604055]
This work aims at advancing temporal action detection (TAD) using an encoder-decoder framework with action queries.
We first propose a relational attention mechanism in the decoder, which guides the attention among queries based on their relations.
Lastly, we propose to predict the localization quality of each action query at inference in order to distinguish high-quality queries.
arXiv Detail & Related papers (2022-07-14T17:46:37Z) - FINet: Dual Branches Feature Interaction for Partial-to-Partial Point
Cloud Registration [31.014309817116175]
We present FINet, a feature interaction-based structure with the capability to enable and strengthen the information associating between the inputs at multiple stages.
Experiments demonstrate that our method performs higher precision and robustness compared to the state-of-the-art traditional and learning-based methods.
arXiv Detail & Related papers (2021-06-07T10:15:02Z) - Consistent Two-Flow Network for Tele-Registration of Point Clouds [74.51029406361997]
We present a learning-based technique that allows registration between point clouds, presented in arbitrary poses, and having little or even no overlap.
Our technique is based on a novel neural network design that learns a prior of a class of shapes and can complete a partial shape.
We show that, compared with each separate flow, this two-flow training leads to robust and reliable tele-registration.
arXiv Detail & Related papers (2021-06-01T09:03:21Z) - Unsupervised Partial Point Set Registration via Joint Shape Completion
and Registration [15.900382629390297]
We propose a self-supervised method for partial point set registration.
We use a shape completion network to bridge the performance gaps between partial point set registration and full point set registration.
Experiments on the ModelNet40 dataset demonstrate the effectiveness of our model for partial point set registration.
arXiv Detail & Related papers (2020-09-11T08:50:53Z) - DeepGMR: Learning Latent Gaussian Mixture Models for Registration [113.74060941036664]
Point cloud registration is a fundamental problem in 3D computer vision, graphics and robotics.
In this paper, we introduce Deep Gaussian Mixture Registration (DeepGMR), the first learning-based registration method.
Our proposed method shows favorable performance when compared with state-of-the-art geometry-based and learning-based registration methods.
arXiv Detail & Related papers (2020-08-20T17:25:16Z) - Learning multiview 3D point cloud registration [74.39499501822682]
We present a novel, end-to-end learnable, multiview 3D point cloud registration algorithm.
Our approach outperforms the state-of-the-art by a significant margin, while being end-to-end trainable and computationally less costly.
arXiv Detail & Related papers (2020-01-15T03:42:14Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.