Generalisable and distinctive 3D local deep descriptors for point cloud registration

• URL: http://arxiv.org/abs/2105.10382v1
• Date: Fri, 21 May 2021 14:47:55 GMT
• Title: Generalisable and distinctive 3D local deep descriptors for point cloud registration
• Authors: Fabio Poiesi and Davide Boscaini
• Abstract summary: We present a simple but yet effective method to learn generalisable and distinctive 3D local descriptors. Point cloud patches are extracted, canonicalised with respect to their local reference frame, and encoded into scale and rotation-invariant compact descriptors. Our descriptors can effectively generalise across sensor modalities from locally and randomly sampled points.
• Score: 4.619541348328937
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: An effective 3D descriptor should be invariant to different geometric transformations, such as scale and rotation, repeatable in the case of occlusions and clutter, and generalisable in different contexts when data is captured with different sensors. We present a simple but yet effective method to learn generalisable and distinctive 3D local descriptors that can be used to register point clouds captured in different contexts with different sensors. Point cloud patches are extracted, canonicalised with respect to their local reference frame, and encoded into scale and rotation-invariant compact descriptors by a point permutation-invariant deep neural network. Our descriptors can effectively generalise across sensor modalities from locally and randomly sampled points. We evaluate and compare our descriptors with alternative handcrafted and deep learning-based descriptors on several indoor and outdoor datasets reconstructed using both RGBD sensors and laser scanners. Our descriptors outperform most recent descriptors by a large margin in terms of generalisation, and become the state of the art also in benchmarks where training and testing are performed in the same scenarios.

Related papers

• RIGA: Rotation-Invariant and Globally-Aware Descriptors for Point Cloud Registration [44.23935553097983]
  We introduce RIGA to learn descriptors that are Rotation-Invariant by design and Globally-Aware. RIGA surpasses the state-of-the-art methods by a margin of 8degree in terms of the Relative Rotation Error on ModelNet40 and improves the Feature Matching Recall by at least 5 percentage points on 3DLoMatch.
  arXiv  Detail & Related papers  (2022-09-27T08:45:56Z)
• UPDesc: Unsupervised Point Descriptor Learning for Robust Registration [54.95201961399334]
  UPDesc is an unsupervised method to learn point descriptors for robust point cloud registration. We show that our learned descriptors yield superior performance over existing unsupervised methods.
  arXiv  Detail & Related papers  (2021-08-05T17:11:08Z)
• Robust Kernel-based Feature Representation for 3D Point Cloud Analysis via Circular Graph Convolutional Network [2.42919716430661]
  We present a new local feature description method that is robust to rotation, density, and scale variations. To improve representations of the local descriptors, we propose a global aggregation method. Our method shows superior performances when compared to the state-of-the-art methods.
  arXiv  Detail & Related papers  (2020-12-22T18:02:57Z)
• SpinNet: Learning a General Surface Descriptor for 3D Point Cloud Registration [57.28608414782315]
  We introduce a new, yet conceptually simple, neural architecture, termed SpinNet, to extract local features. Experiments on both indoor and outdoor datasets demonstrate that SpinNet outperforms existing state-of-the-art techniques.
  arXiv  Detail & Related papers  (2020-11-24T15:00:56Z)
• Distinctive 3D local deep descriptors [2.512827436728378]
  Point cloud patches are extracted, canonicalised with respect to their estimated local reference frame and encoded by a PointNet-based deep neural network. We evaluate and compare DIPs against alternative hand-crafted and deep descriptors on several datasets consisting of point clouds reconstructed using different sensors.
  arXiv  Detail & Related papers  (2020-09-01T06:25:06Z)
• DH3D: Deep Hierarchical 3D Descriptors for Robust Large-Scale 6DoF Relocalization [56.15308829924527]
  We propose a Siamese network that jointly learns 3D local feature detection and description directly from raw 3D points. For detecting 3D keypoints we predict the discriminativeness of the local descriptors in an unsupervised manner. Experiments on various benchmarks demonstrate that our method achieves competitive results for both global point cloud retrieval and local point cloud registration.
  arXiv  Detail & Related papers  (2020-07-17T20:21:22Z)
• A Rotation-Invariant Framework for Deep Point Cloud Analysis [132.91915346157018]
  We introduce a new low-level purely rotation-invariant representation to replace common 3D Cartesian coordinates as the network inputs. Also, we present a network architecture to embed these representations into features, encoding local relations between points and their neighbors, and the global shape structure. We evaluate our method on multiple point cloud analysis tasks, including shape classification, part segmentation, and shape retrieval.
  arXiv  Detail & Related papers  (2020-03-16T14:04:45Z)
• End-to-End Learning Local Multi-view Descriptors for 3D Point Clouds [67.27510166559563]
  We propose an end-to-end framework to learn local multi-view descriptors for 3D point clouds. Our method outperforms existing local descriptors both quantitatively and qualitatively.
  arXiv  Detail & Related papers  (2020-03-12T15:41:34Z)
• MGCN: Descriptor Learning using Multiscale GCNs [50.14172863706108]
  We present a new non-learned feature that uses graph wavelets to decompose the Dirichlet energy on a surface. We also propose a new graph convolutional network (MGCN) to transform a non-learned feature to a more discriminative descriptor.
  arXiv  Detail & Related papers  (2020-01-28T17:25:14Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.