Completing Partial Point Clouds with Outliers by Collaborative Completion and Segmentation

• URL: http://arxiv.org/abs/2203.09772v1
• Date: Fri, 18 Mar 2022 07:31:41 GMT
• Title: Completing Partial Point Clouds with Outliers by Collaborative Completion and Segmentation
• Authors: Changfeng Ma, Yang Yang, Jie Guo, Chongjun Wang, Yanwen Guo
• Abstract summary: We propose an end-to-end network, named CS-Net, to complete the point clouds contaminated by noises or containing outliers. Our comprehensive experiments and comparisons against state-of-the-art completion methods demonstrate our superiority.
• Score: 22.521376982725517
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Most existing point cloud completion methods are only applicable to partial point clouds without any noises and outliers, which does not always hold in practice. We propose in this paper an end-to-end network, named CS-Net, to complete the point clouds contaminated by noises or containing outliers. In our CS-Net, the completion and segmentation modules work collaboratively to promote each other, benefited from our specifically designed cascaded structure. With the help of segmentation, more clean point cloud is fed into the completion module. We design a novel completion decoder which harnesses the labels obtained by segmentation together with FPS to purify the point cloud and leverages KNN-grouping for better generation. The completion and segmentation modules work alternately share the useful information from each other to gradually improve the quality of prediction. To train our network, we build a dataset to simulate the real case where incomplete point clouds contain outliers. Our comprehensive experiments and comparisons against state-of-the-art completion methods demonstrate our superiority. We also compare with the scheme of segmentation followed by completion and their end-to-end fusion, which also proves our efficacy.

Related papers

• P2C: Self-Supervised Point Cloud Completion from Single Partial Clouds [44.02541315496045]
  Point cloud completion aims to recover the complete shape based on a partial observation. Existing methods require either complete point clouds or multiple partial observations of the same object for learning. We present Partial2Complete, the first self-supervised framework that completes point cloud objects.
  arXiv  Detail & Related papers  (2023-07-27T09:31:01Z)
• CasFusionNet: A Cascaded Network for Point Cloud Semantic Scene Completion by Dense Feature Fusion [14.34344002500153]
  We present CasFusionNet, a novel cascaded network for point cloud semantic scene completion by dense feature fusion. We organize the above three modules via dense feature fusion in each level, and cascade a total of four levels, where we also employ feature fusion between each level for sufficient information usage.
  arXiv  Detail & Related papers  (2022-11-24T16:36:42Z)
• Reconstruction-Aware Prior Distillation for Semi-supervised Point Cloud Completion [10.649666758735663]
  Real-world sensors often produce incomplete, irregular, and noisy point clouds. This paper proposes RaPD, a novel semi-supervised point cloud completion method.
  arXiv  Detail & Related papers  (2022-04-20T02:14:20Z)
• Learning a Structured Latent Space for Unsupervised Point Cloud Completion [48.79411151132766]
  We propose a novel framework, which learns a unified and structured latent space that encoding both partial and complete point clouds. Our proposed method consistently outperforms state-of-the-art unsupervised methods on both synthetic ShapeNet and real-world KITTI, ScanNet, and Matterport3D datasets.
  arXiv  Detail & Related papers  (2022-03-29T13:58:44Z)
• CP-Net: Contour-Perturbed Reconstruction Network for Self-Supervised Point Cloud Learning [53.1436669083784]
  We propose a generic Contour-Perturbed Reconstruction Network (CP-Net), which can effectively guide self-supervised reconstruction to learn semantic content in the point cloud. For classification, we get a competitive result with the fully-supervised methods on ModelNet40 (92.5% accuracy) and ScanObjectNN (87.9% accuracy)
  arXiv  Detail & Related papers  (2022-01-20T15:04:12Z)
• Voxel-based Network for Shape Completion by Leveraging Edge Generation [76.23436070605348]
  We develop a voxel-based network for point cloud completion by leveraging edge generation (VE-PCN) We first embed point clouds into regular voxel grids, and then generate complete objects with the help of the hallucinated shape edges. This decoupled architecture together with a multi-scale grid feature learning is able to generate more realistic on-surface details.
  arXiv  Detail & Related papers  (2021-08-23T05:10:29Z)
• Cascaded Refinement Network for Point Cloud Completion with Self-supervision [74.80746431691938]
  We introduce a two-branch network for shape completion. The first branch is a cascaded shape completion sub-network to synthesize complete objects. The second branch is an auto-encoder to reconstruct the original partial input.
  arXiv  Detail & Related papers  (2020-10-17T04:56:22Z)
• Refinement of Predicted Missing Parts Enhance Point Cloud Completion [62.997667081978825]
  Point cloud completion is the task of predicting complete geometry from partial observations using a point set representation for a 3D shape. Previous approaches propose neural networks to directly estimate the whole point cloud through encoder-decoder models fed by the incomplete point set. This paper proposes an end-to-end neural network architecture that focuses on computing the missing geometry and merging the known input and the predicted point cloud.
  arXiv  Detail & Related papers  (2020-10-08T22:01:23Z)
• Cascaded Refinement Network for Point Cloud Completion [74.80746431691938]
  We propose a cascaded refinement network together with a coarse-to-fine strategy to synthesize the detailed object shapes. Considering the local details of partial input with the global shape information together, we can preserve the existing details in the incomplete point set. We also design a patch discriminator that guarantees every local area has the same pattern with the ground truth to learn the complicated point distribution.
  arXiv  Detail & Related papers  (2020-04-07T13:03:29Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.