Category-Level Global Camera Pose Estimation with Multi-Hypothesis Point Cloud Correspondences

• URL: http://arxiv.org/abs/2209.14419v1
• Date: Wed, 28 Sep 2022 21:12:51 GMT
• Title: Category-Level Global Camera Pose Estimation with Multi-Hypothesis Point Cloud Correspondences
• Authors: Jun-Jee Chao, Selim Engin, Nicolai H\"ani and Volkan Isler
• Abstract summary: Correspondence search is an essential step in rigid point cloud registration algorithms. This paper proposes an optimization method that retains all possible correspondences for each keypoint when matching a partial point cloud to a complete point cloud. We also propose a new point feature descriptor that measures the similarity between local point cloud regions.
• Score: 26.885846254261626
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Correspondence search is an essential step in rigid point cloud registration algorithms. Most methods maintain a single correspondence at each step and gradually remove wrong correspondances. However, building one-to-one correspondence with hard assignments is extremely difficult, especially when matching two point clouds with many locally similar features. This paper proposes an optimization method that retains all possible correspondences for each keypoint when matching a partial point cloud to a complete point cloud. These uncertain correspondences are then gradually updated with the estimated rigid transformation by considering the matching cost. Moreover, we propose a new point feature descriptor that measures the similarity between local point cloud regions. Extensive experiments show that our method outperforms the state-of-the-art (SoTA) methods even when matching different objects within the same category. Notably, our method outperforms the SoTA methods when registering real-world noisy depth images to a template shape by up to 20% performance.

Related papers

• BiEquiFormer: Bi-Equivariant Representations for Global Point Cloud Registration [28.75341781515012]
  We show that state-of-the-art deep learning methods suffer from huge performance degradation when the point clouds are arbitrarily placed in space. We design BiEquiformer a novel and scalable textitbi-equivariant pipeline. This allows us to extract high-quality superpoint correspondences and in turn, robust point-cloud registration.
  arXiv  Detail & Related papers  (2024-07-11T17:58:10Z)
• Multiway Point Cloud Mosaicking with Diffusion and Global Optimization [74.3802812773891]
  We introduce a novel framework for multiway point cloud mosaicking (named Wednesday) At the core of our approach is ODIN, a learned pairwise registration algorithm that identifies overlaps and refines attention scores. Tested on four diverse, large-scale datasets, our method state-of-the-art pairwise and rotation registration results by a large margin on all benchmarks.
  arXiv  Detail & Related papers  (2024-03-30T17:29:13Z)
• HybridFusion: LiDAR and Vision Cross-Source Point Cloud Fusion [15.94976936555104]
  We propose a cross-source point cloud fusion algorithm called HybridFusion. It can register cross-source dense point clouds from different viewing angle in outdoor large scenes. The proposed approach is evaluated comprehensively through qualitative and quantitative experiments.
  arXiv  Detail & Related papers  (2023-04-10T10:54:54Z)
• PointCLM: A Contrastive Learning-based Framework for Multi-instance Point Cloud Registration [4.969636478156443]
  PointCLM is a contrastive learning-based framework for mutli-instance point cloud registration. Our method outperforms the state-of-the-art methods on both synthetic and real datasets by a large margin.
  arXiv  Detail & Related papers  (2022-09-01T04:30:05Z)
• Multiway Non-rigid Point Cloud Registration via Learned Functional Map Synchronization [105.14877281665011]
  We present SyNoRiM, a novel way to register multiple non-rigid shapes by synchronizing the maps relating learned functions defined on the point clouds. We demonstrate via extensive experiments that our method achieves a state-of-the-art performance in registration accuracy.
  arXiv  Detail & Related papers  (2021-11-25T02:37:59Z)
• DeepBBS: Deep Best Buddies for Point Cloud Registration [55.12101890792121]
  DeepBBS is a novel method for learning a representation that takes into account the best buddy distance between points during training. Our experiments show improved performance compared to previous methods.
  arXiv  Detail & Related papers  (2021-10-06T19:00:07Z)
• Pairwise Point Cloud Registration using Graph Matching and Rotation-invariant Features [8.897670503102342]
  We develop a coarse-to-fine registration strategy, which utilizes rotation-invariant features and a new weighted graph matching method. Our proposed method can achieve a fine registration with rotation errors of less than 0.2 degrees and translation errors of less than 0.1m.
  arXiv  Detail & Related papers  (2021-05-05T16:03:05Z)
• DeepI2P: Image-to-Point Cloud Registration via Deep Classification [71.3121124994105]
  DeepI2P is a novel approach for cross-modality registration between an image and a point cloud. Our method estimates the relative rigid transformation between the coordinate frames of the camera and Lidar. We circumvent the difficulty by converting the registration problem into a classification and inverse camera projection optimization problem.
  arXiv  Detail & Related papers  (2021-04-08T04:27:32Z)
• Robust Point Cloud Registration Framework Based on Deep Graph Matching [5.865029600972316]
  3D point cloud registration is a fundamental problem in computer vision and robotics. We propose a novel deep graph matchingbased framework for point cloud registration.
  arXiv  Detail & Related papers  (2021-03-07T04:20:29Z)
• RPM-Net: Robust Point Matching using Learned Features [79.52112840465558]
  RPM-Net is a less sensitive and more robust deep learning-based approach for rigid point cloud registration. Unlike some existing methods, our RPM-Net handles missing correspondences and point clouds with partial visibility.
  arXiv  Detail & Related papers  (2020-03-30T13:45:27Z)
• Learning multiview 3D point cloud registration [74.39499501822682]
  We present a novel, end-to-end learnable, multiview 3D point cloud registration algorithm. Our approach outperforms the state-of-the-art by a significant margin, while being end-to-end trainable and computationally less costly.
  arXiv  Detail & Related papers  (2020-01-15T03:42:14Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.