Neural Points: Point Cloud Representation with Neural Fields

• URL: http://arxiv.org/abs/2112.04148v1
• Date: Wed, 8 Dec 2021 07:34:17 GMT
• Title: Neural Points: Point Cloud Representation with Neural Fields
• Authors: Wanquan Feng, Jin Li, Hongrui Cai, Xiaonan Luo, Juyong Zhang
• Abstract summary: We propose emphNeural Points, a novel point cloud representation. Each point in Neural Points represents a local continuous geometric shape via neural fields. We show that Neural Points has powerful representation ability and demonstrate excellent robustness and generalization ability.
• Score: 31.167929128314096
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In this paper, we propose \emph{Neural Points}, a novel point cloud representation. Unlike traditional point cloud representation where each point only represents a position or a local plane in the 3D space, each point in Neural Points represents a local continuous geometric shape via neural fields. Therefore, Neural Points can express much more complex details and thus have a stronger representation ability. Neural Points is trained with high-resolution surface containing rich geometric details, such that the trained model has enough expression ability for various shapes. Specifically, we extract deep local features on the points and construct neural fields through the local isomorphism between the 2D parametric domain and the 3D local patch. In the final, local neural fields are integrated together to form the global surface. Experimental results show that Neural Points has powerful representation ability and demonstrate excellent robustness and generalization ability. With Neural Points, we can resample point cloud with arbitrary resolutions, and it outperforms state-of-the-art point cloud upsampling methods by a large margin.

Related papers

• Neural varifolds: an aggregate representation for quantifying the geometry of point clouds [2.2474167740753557]
  We propose a new surface geometry characterisation, namely a neural varifold representation of point clouds. The varifold representation quantifies the surface geometry of point clouds through the manifold-based discrimination. The proposed neural varifold is evaluated on three different sought-after tasks -- shape matching, few-shot shape classification and shape reconstruction.
  arXiv  Detail & Related papers  (2024-07-05T20:08:16Z)
• Object Dynamics Modeling with Hierarchical Point Cloud-based Representations [1.3934784414106087]
  We propose a novel U-net architecture based on continuous point convolution which embeds information from 3D coordinates. Bottleneck layers in the downsampled point clouds lead to better long-range interaction modeling. Our approach significantly improves the state-of-the-art, especially in scenarios that require accurate gravity or collision reasoning.
  arXiv  Detail & Related papers  (2024-04-09T06:10:15Z)
• Polyhedral Surface: Self-supervised Point Cloud Reconstruction Based on Polyhedral Surface [14.565612328814312]
  We propose a novel polyhedral surface to represent local surface. It does not require any local coordinate system, which is important when introducing neural networks. Our method achieves state-of-the-art results on three commonly used networks.
  arXiv  Detail & Related papers  (2023-10-23T04:24:31Z)
• SimNP: Learning Self-Similarity Priors Between Neural Points [52.4201466988562]
  SimNP is a method to learn category-level self-similarities. We show that SimNP is able to outperform previous methods in reconstructing symmetric unseen object regions.
  arXiv  Detail & Related papers  (2023-09-07T16:02:40Z)
• Neural Convolutional Surfaces [59.172308741945336]
  This work is concerned with a representation of shapes that disentangles fine, local and possibly repeating geometry, from global, coarse structures. We show that this approach achieves better neural shape compression than the state of the art, as well as enabling manipulation and transfer of shape details.
  arXiv  Detail & Related papers  (2022-04-05T15:40:11Z)
• Concentric Spherical GNN for 3D Representation Learning [53.45704095146161]
  We propose a novel multi-resolution convolutional architecture for learning over concentric spherical feature maps. Our hierarchical architecture is based on alternatively learning to incorporate both intra-sphere and inter-sphere information. We demonstrate the effectiveness of our approach in improving state-of-the-art performance on 3D classification tasks with rotated data.
  arXiv  Detail & Related papers  (2021-03-18T19:05:04Z)
• EllipsoidNet: Ellipsoid Representation for Point Cloud Classification and Segmentation [24.36469430784483]
  Point cloud representation in 2D space has attracted increasing research interest since it exposes the local geometry features in a 2D space. We propose a novel 2D representation method that projects a point cloud onto an ellipsoid surface space, where local patterns are well exposed in ellipsoid-level and point-level. A novel convolutional neural network named EllipsoidNet is proposed to utilize those features for point cloud classification and segmentation applications.
  arXiv  Detail & Related papers  (2021-03-03T16:43:08Z)
• ODFNet: Using orientation distribution functions to characterize 3D point clouds [0.0]
  We leverage on point orientation distributions around a point in order to obtain an expressive local neighborhood representation for point clouds. New ODFNet model achieves state-of-the-art accuracy for object classification on ModelNet40 and ScanObjectNN datasets.
  arXiv  Detail & Related papers  (2020-12-08T19:54:20Z)
• PMP-Net: Point Cloud Completion by Learning Multi-step Point Moving Paths [54.459879603473034]
  We design a novel neural network, named PMP-Net, to mimic the behavior of an earth mover. It moves each point of the incomplete input to complete the point cloud, where the total distance of point moving paths should be shortest. It learns a strict and unique correspondence on point-level, which can capture the detailed topology and structure relationships between the incomplete shape and the complete target.
  arXiv  Detail & Related papers  (2020-12-07T01:34:38Z)
• SpinNet: Learning a General Surface Descriptor for 3D Point Cloud Registration [57.28608414782315]
  We introduce a new, yet conceptually simple, neural architecture, termed SpinNet, to extract local features. Experiments on both indoor and outdoor datasets demonstrate that SpinNet outperforms existing state-of-the-art techniques.
  arXiv  Detail & Related papers  (2020-11-24T15:00:56Z)
• PUGeo-Net: A Geometry-centric Network for 3D Point Cloud Upsampling [103.09504572409449]
  We propose a novel deep neural network based method, called PUGeo-Net, to generate uniform dense point clouds. Thanks to its geometry-centric nature, PUGeo-Net works well for both CAD models with sharp features and scanned models with rich geometric details.
  arXiv  Detail & Related papers  (2020-02-24T14:13:29Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.