Snowflake Point Deconvolution for Point Cloud Completion and Generation with Skip-Transformer

• URL: http://arxiv.org/abs/2202.09367v2
• Date: Tue, 22 Feb 2022 11:58:29 GMT
• Title: Snowflake Point Deconvolution for Point Cloud Completion and Generation with Skip-Transformer
• Authors: Peng Xiang, Xin Wen, Yu-Shen Liu, Yan-Pei Cao, Pengfei Wan, Wen Zheng, Zhizhong Han
• Abstract summary: We propose SnowflakeNet with Snowflake Point Deconvolution (SPD) to generate the complete point clouds. SPD models the generation of complete point clouds as the snowflake-like growth of points, where the child points are progressively generated by splitting their parent points after each SPD. Our insight of revealing detailed geometry is to introduce skip-transformer in SPD to learn point splitting patterns which can fit local regions the best.
• Score: 60.32185890237936
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Most existing point cloud completion methods suffered from discrete nature of point clouds and unstructured prediction of points in local regions, which makes it hard to reveal fine local geometric details. To resolve this issue, we propose SnowflakeNet with Snowflake Point Deconvolution (SPD) to generate the complete point clouds. SPD models the generation of complete point clouds as the snowflake-like growth of points, where the child points are progressively generated by splitting their parent points after each SPD. Our insight of revealing detailed geometry is to introduce skip-transformer in SPD to learn point splitting patterns which can fit local regions the best. Skip-transformer leverages attention mechanism to summarize the splitting patterns used in previous SPD layer to produce the splitting in current SPD layer. The locally compact and structured point clouds generated by SPD precisely reveal the structure characteristic of 3D shape in local patches, which enables us to predict highly detailed geometries. Moreover, since SPD is a general operation, which is not limited to completion, we further explore the applications of SPD on other generative tasks, including point cloud auto-encoding, generation, single image reconstruction and upsampling. Our experimental results outperform the state-of-the-art methods under widely used benchmarks.

Related papers

• PointAttN: You Only Need Attention for Point Cloud Completion [89.88766317412052]
  Point cloud completion refers to completing 3D shapes from partial 3D point clouds. We propose a novel neural network for processing point cloud in a per-point manner to eliminate kNNs. The proposed framework, namely PointAttN, is simple, neat and effective, which can precisely capture the structural information of 3D shapes.
  arXiv  Detail & Related papers  (2022-03-16T09:20:01Z)
• PMP-Net++: Point Cloud Completion by Transformer-Enhanced Multi-step Point Moving Paths [60.32185890237936]
  We design a novel neural network, named PMP-Net++, to mimic behavior of an earth mover. It moves each point of incomplete input to obtain a complete point cloud, where total distance of point moving paths (PMPs) should be the shortest. The network learns a strict and unique correspondence on point-level, and thus improves quality of predicted complete shape.
  arXiv  Detail & Related papers  (2022-02-19T03:00:40Z)
• SnowflakeNet: Point Cloud Completion by Snowflake Point Deconvolution with Skip-Transformer [54.45987960347304]
  We propose SnowflakeNet with Snowflake Point Deconvolution (SPD) to generate the complete point clouds. SPD learns point splitting patterns which can fit local regions the best. Our experimental results outperform the state-of-the-art point cloud completion methods under widely used benchmarks.
  arXiv  Detail & Related papers  (2021-08-10T04:33:37Z)
• PMP-Net: Point Cloud Completion by Learning Multi-step Point Moving Paths [54.459879603473034]
  We design a novel neural network, named PMP-Net, to mimic the behavior of an earth mover. It moves each point of the incomplete input to complete the point cloud, where the total distance of point moving paths should be shortest. It learns a strict and unique correspondence on point-level, which can capture the detailed topology and structure relationships between the incomplete shape and the complete target.
  arXiv  Detail & Related papers  (2020-12-07T01:34:38Z)
• Point Cloud Completion by Skip-attention Network with Hierarchical Folding [61.59710288271434]
  We propose Skip-Attention Network (SA-Net) for 3D point cloud completion. First, we propose a skip-attention mechanism to effectively exploit the local structure details of incomplete point clouds. Second, in order to fully utilize the selected geometric information encoded by skip-attention mechanism at different resolutions, we propose a novel structure-preserving decoder.
  arXiv  Detail & Related papers  (2020-05-08T06:23:51Z)
• SK-Net: Deep Learning on Point Cloud via End-to-end Discovery of Spatial Keypoints [7.223394571022494]
  This paper presents an end-to-end framework, SK-Net, to jointly optimize the inference of spatial keypoint with the learning of feature representation of a point cloud. Our proposed method performs better than or comparable with the state-of-the-art approaches in point cloud tasks.
  arXiv  Detail & Related papers  (2020-03-31T08:15:40Z)
• PF-Net: Point Fractal Network for 3D Point Cloud Completion [6.504317278066694]
  Point Fractal Network (PF-Net) is a novel learning-based approach for precise and high-fidelity point cloud completion. PF-Net preserves the spatial arrangements of the incomplete point cloud and can figure out the detailed geometrical structure of the missing region(s) in the prediction. Our experiments demonstrate the effectiveness of our method for several challenging point cloud completion tasks.
  arXiv  Detail & Related papers  (2020-03-01T05:40:21Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.