Learning multiview 3D point cloud registration
- URL: http://arxiv.org/abs/2001.05119v2
- Date: Tue, 31 Mar 2020 07:53:36 GMT
- Title: Learning multiview 3D point cloud registration
- Authors: Zan Gojcic, Caifa Zhou, Jan D. Wegner, Leonidas J. Guibas, Tolga
Birdal
- Abstract summary: We present a novel, end-to-end learnable, multiview 3D point cloud registration algorithm.
Our approach outperforms the state-of-the-art by a significant margin, while being end-to-end trainable and computationally less costly.
- Score: 74.39499501822682
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: We present a novel, end-to-end learnable, multiview 3D point cloud
registration algorithm. Registration of multiple scans typically follows a
two-stage pipeline: the initial pairwise alignment and the globally consistent
refinement. The former is often ambiguous due to the low overlap of neighboring
point clouds, symmetries and repetitive scene parts. Therefore, the latter
global refinement aims at establishing the cyclic consistency across multiple
scans and helps in resolving the ambiguous cases. In this paper we propose, to
the best of our knowledge, the first end-to-end algorithm for joint learning of
both parts of this two-stage problem. Experimental evaluation on well accepted
benchmark datasets shows that our approach outperforms the state-of-the-art by
a significant margin, while being end-to-end trainable and computationally less
costly. Moreover, we present detailed analysis and an ablation study that
validate the novel components of our approach. The source code and pretrained
models are publicly available under
https://github.com/zgojcic/3D_multiview_reg.
Related papers
- Incremental Multiview Point Cloud Registration with Two-stage Candidate Retrieval [12.528821749262931]
Multiview point cloud registration serves as a cornerstone of various computer vision tasks.
We propose an incremental multiview point cloud registration method that progressively registers all scans to a growing meta-shape.
arXiv Detail & Related papers (2024-07-10T10:24:28Z) - Incremental Multiview Point Cloud Registration [18.830104930321223]
We propose an incremental pipeline to progressively align scans into a canonical coordinate system.
For detector-free matchers, we incorporate a Track refinement process.
Experiments demonstrate that the proposed framework outperforms existing multiview registration methods on three benchmark datasets.
arXiv Detail & Related papers (2024-07-06T09:28:23Z) - Multiway Point Cloud Mosaicking with Diffusion and Global Optimization [74.3802812773891]
We introduce a novel framework for multiway point cloud mosaicking (named Wednesday)
At the core of our approach is ODIN, a learned pairwise registration algorithm that identifies overlaps and refines attention scores.
Tested on four diverse, large-scale datasets, our method state-of-the-art pairwise and rotation registration results by a large margin on all benchmarks.
arXiv Detail & Related papers (2024-03-30T17:29:13Z) - Robust Multiview Point Cloud Registration with Reliable Pose Graph
Initialization and History Reweighting [63.95845583460312]
We present a new method for the multiview registration of point cloud.
Our method achieves 11% higher registration recall on the 3DMatch dataset and 13% lower registration errors on the ScanNet dataset.
arXiv Detail & Related papers (2023-04-02T06:43:40Z) - Point Cloud Registration for LiDAR and Photogrammetric Data: a Critical
Synthesis and Performance Analysis on Classic and Deep Learning Algorithms [7.874736360019618]
We provide a comprehensive review of the state-of-the-art (SOTA) point cloud registration methods.
We analyze and evaluate these methods using a diverse set of point cloud data from indoor to satellite sources.
More than ten methods, including classic hand-crafted, deep-learning-based feature correspondence, and robust C2C methods were tested.
arXiv Detail & Related papers (2023-02-14T16:52:26Z) - 3DMODT: Attention-Guided Affinities for Joint Detection & Tracking in 3D
Point Clouds [95.54285993019843]
We propose a method for joint detection and tracking of multiple objects in 3D point clouds.
Our model exploits temporal information employing multiple frames to detect objects and track them in a single network.
arXiv Detail & Related papers (2022-11-01T20:59:38Z) - Self-Supervised Arbitrary-Scale Point Clouds Upsampling via Implicit
Neural Representation [79.60988242843437]
We propose a novel approach that achieves self-supervised and magnification-flexible point clouds upsampling simultaneously.
Experimental results demonstrate that our self-supervised learning based scheme achieves competitive or even better performance than supervised learning based state-of-the-art methods.
arXiv Detail & Related papers (2022-04-18T07:18:25Z) - Consistent Two-Flow Network for Tele-Registration of Point Clouds [74.51029406361997]
We present a learning-based technique that allows registration between point clouds, presented in arbitrary poses, and having little or even no overlap.
Our technique is based on a novel neural network design that learns a prior of a class of shapes and can complete a partial shape.
We show that, compared with each separate flow, this two-flow training leads to robust and reliable tele-registration.
arXiv Detail & Related papers (2021-06-01T09:03:21Z) - Point Set Voting for Partial Point Cloud Analysis [26.31029112502835]
techniques for point cloud classification and segmentation have in recent years achieved incredible performance driven in part by leveraging large synthetic datasets.
This paper proposes a general model for partial point clouds analysis wherein the latent feature encoding a complete point clouds is inferred by applying a local point set voting strategy.
arXiv Detail & Related papers (2020-07-09T03:37:31Z) - Unsupervised Learning of Global Registration of Temporal Sequence of
Point Clouds [16.019588704177288]
Global registration of point clouds aims to find an optimal alignment of a sequence of 2D or 3D point sets.
We present a novel method that takes advantage of current deep learning techniques for unsupervised learning of global registration from a temporal sequence of point clouds.
arXiv Detail & Related papers (2020-06-17T06:00:36Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.