Rethinking Sampling in 3D Point Cloud Generative Adversarial Networks

• URL: http://arxiv.org/abs/2006.07029v1
• Date: Fri, 12 Jun 2020 09:29:24 GMT
• Title: Rethinking Sampling in 3D Point Cloud Generative Adversarial Networks
• Authors: He Wang, Zetian Jiang, Li Yi, Kaichun Mo, Hao Su, Leonidas J. Guibas
• Abstract summary: We show that sampling-insensitive discriminators produce shape point clouds with point clustering artifacts while sampling-oversensitive discriminators fail to guide valid shape generation. We propose the concept of sampling spectrum to depict the different sampling sensitivities of discriminators. We discover a middle-point sampling-aware baseline discriminator, PointNet-Mix, which improves all existing point cloud generators by a large margin on sampling-related metrics.
• Score: 82.72642388129843
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In this paper, we examine the long-neglected yet important effects of point sampling patterns in point cloud GANs. Through extensive experiments, we show that sampling-insensitive discriminators (e.g.PointNet-Max) produce shape point clouds with point clustering artifacts while sampling-oversensitive discriminators (e.g.PointNet++, DGCNN) fail to guide valid shape generation. We propose the concept of sampling spectrum to depict the different sampling sensitivities of discriminators. We further study how different evaluation metrics weigh the sampling pattern against the geometry and propose several perceptual metrics forming a sampling spectrum of metrics. Guided by the proposed sampling spectrum, we discover a middle-point sampling-aware baseline discriminator, PointNet-Mix, which improves all existing point cloud generators by a large margin on sampling-related metrics. We point out that, though recent research has been focused on the generator design, the main bottleneck of point cloud GAN actually lies in the discriminator design. Our work provides both suggestions and tools for building future discriminators. We will release the code to facilitate future research.

Related papers

• Controllable Mesh Generation Through Sparse Latent Point Diffusion Models [105.83595545314334]
  We design a novel sparse latent point diffusion model for mesh generation. Our key insight is to regard point clouds as an intermediate representation of meshes, and model the distribution of point clouds instead. Our proposed sparse latent point diffusion model achieves superior performance in terms of generation quality and controllability.
  arXiv  Detail & Related papers  (2023-03-14T14:25:29Z)
• Attention-based Point Cloud Edge Sampling [0.0]
  Point cloud sampling is a less explored research topic for this data representation. This paper proposes a non-generative Attention-based Point cloud Edge Sampling method (APES) Both qualitative and quantitative experimental results show the superior performance of our sampling method on common benchmark tasks.
  arXiv  Detail & Related papers  (2023-02-28T15:36:17Z)
• APSNet: Attention Based Point Cloud Sampling [0.7734726150561088]
  We develop an attention-based point cloud sampling network (APSNet) to tackle this problem. Both supervised learning and knowledge distillation-based self-supervised learning of APSNet are proposed. Experiments demonstrate the superior performance of APSNet against state-of-the-arts in various downstream tasks.
  arXiv  Detail & Related papers  (2022-10-11T17:30:46Z)
• BIMS-PU: Bi-Directional and Multi-Scale Point Cloud Upsampling [60.257912103351394]
  We develop a new point cloud upsampling pipeline called BIMS-PU. We decompose the up/downsampling procedure into several up/downsampling sub-steps by breaking the target sampling factor into smaller factors. We show that our method achieves superior results to state-of-the-art approaches.
  arXiv  Detail & Related papers  (2022-06-25T13:13:37Z)
• PUFA-GAN: A Frequency-Aware Generative Adversarial Network for 3D Point Cloud Upsampling [56.463507980857216]
  We propose a generative adversarial network for point cloud upsampling. It can make the upsampled points evenly distributed on the underlying surface but also efficiently generate clean high frequency regions.
  arXiv  Detail & Related papers  (2022-03-02T07:47:46Z)
• Beyond Farthest Point Sampling in Point-Wise Analysis [52.218037492342546]
  We propose a novel data-driven sampler learning strategy for point-wise analysis tasks. We learn sampling and downstream applications jointly. Our experiments show that jointly learning of the sampler and task brings remarkable improvement over previous baseline methods.
  arXiv  Detail & Related papers  (2021-07-09T08:08:44Z)
• PointLIE: Locally Invertible Embedding for Point Cloud Sampling and Recovery [35.353458457283544]
  Point Cloud Sampling and Recovery (PCSR) is critical for massive real-time point cloud collection and processing. We propose a novel Locally Invertible Embedding for point cloud adaptive sampling and recovery (PointLIE) PointLIE unifies point cloud sampling and upsampling to one single framework through bi-directional learning.
  arXiv  Detail & Related papers  (2021-04-30T05:55:59Z)
• PRIN/SPRIN: On Extracting Point-wise Rotation Invariant Features [91.2054994193218]
  We propose a point-set learning framework PRIN, focusing on rotation invariant feature extraction in point clouds analysis. In addition, we extend PRIN to a sparse version called SPRIN, which directly operates on sparse point clouds. Results show that, on the dataset with randomly rotated point clouds, SPRIN demonstrates better performance than state-of-the-art methods without any data augmentation.
  arXiv  Detail & Related papers  (2021-02-24T06:44:09Z)
• RSKDD-Net: Random Sample-based Keypoint Detector and Descriptor [11.393546826269372]
  This paper proposes Random Sample-based Keypoint Detector and Descriptor Network (RSKDD-Net) for large scale point cloud registration. The key idea is using random sampling to efficiently select candidate points and using a learning-based method to jointly generate keypoints and descriptors. Experiments on two large scale outdoor LiDAR datasets show that the proposed RSKDD-Net achieves state-of-the-art performance with more than 15 times faster than existing methods.
  arXiv  Detail & Related papers  (2020-10-23T13:29:29Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.