Point2Mesh: A Self-Prior for Deformable Meshes

• URL: http://arxiv.org/abs/2005.11084v1
• Date: Fri, 22 May 2020 10:01:04 GMT
• Title: Point2Mesh: A Self-Prior for Deformable Meshes
• Authors: Rana Hanocka, Gal Metzer, Raja Giryes, Daniel Cohen-Or
• Abstract summary: We introduce Point2Mesh, a technique for reconstructing a surface mesh from an input point cloud. The self-prior encapsulates reoccurring geometric repetitions from a single shape within the weights of a deep neural network. We show that Point2Mesh converges to a desirable solution; compared to a prescribed smoothness prior, which often becomes trapped in undesirable local minima.
• Score: 83.31236364265403
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In this paper, we introduce Point2Mesh, a technique for reconstructing a surface mesh from an input point cloud. Instead of explicitly specifying a prior that encodes the expected shape properties, the prior is defined automatically using the input point cloud, which we refer to as a self-prior. The self-prior encapsulates reoccurring geometric repetitions from a single shape within the weights of a deep neural network. We optimize the network weights to deform an initial mesh to shrink-wrap a single input point cloud. This explicitly considers the entire reconstructed shape, since shared local kernels are calculated to fit the overall object. The convolutional kernels are optimized globally across the entire shape, which inherently encourages local-scale geometric self-similarity across the shape surface. We show that shrink-wrapping a point cloud with a self-prior converges to a desirable solution; compared to a prescribed smoothness prior, which often becomes trapped in undesirable local minima. While the performance of traditional reconstruction approaches degrades in non-ideal conditions that are often present in real world scanning, i.e., unoriented normals, noise and missing (low density) parts, Point2Mesh is robust to non-ideal conditions. We demonstrate the performance of Point2Mesh on a large variety of shapes with varying complexity.

Related papers

• Learning Neural Volumetric Field for Point Cloud Geometry Compression [13.691147541041804]
  We propose to code the geometry of a given point cloud by learning a neural field. We divide the entire space into small cubes and represent each non-empty cube by a neural network and an input latent code. The network is shared among all the cubes in a single frame or multiple frames, to exploit the spatial and temporal redundancy.
  arXiv  Detail & Related papers  (2022-12-11T19:55:24Z)
• GRASP-Net: Geometric Residual Analysis and Synthesis for Point Cloud Compression [16.98171403698783]
  We propose a heterogeneous approach with deep learning for lossy point cloud geometry compression. Specifically, a point-based network is applied to convert the erratic local details to latent features residing on the coarse point cloud.
  arXiv  Detail & Related papers  (2022-09-09T17:09:02Z)
• Differentiable Convolution Search for Point Cloud Processing [114.66038862207118]
  We propose a novel differential convolution search paradigm on point clouds. It can work in a purely data-driven manner and thus is capable of auto-creating a group of suitable convolutions for geometric shape modeling. We also propose a joint optimization framework for simultaneous search of internal convolution and external architecture, and introduce epsilon-greedy algorithm to alleviate the effect of discretization error.
  arXiv  Detail & Related papers  (2021-08-29T14:42:03Z)
• Refinement of Predicted Missing Parts Enhance Point Cloud Completion [62.997667081978825]
  Point cloud completion is the task of predicting complete geometry from partial observations using a point set representation for a 3D shape. Previous approaches propose neural networks to directly estimate the whole point cloud through encoder-decoder models fed by the incomplete point set. This paper proposes an end-to-end neural network architecture that focuses on computing the missing geometry and merging the known input and the predicted point cloud.
  arXiv  Detail & Related papers  (2020-10-08T22:01:23Z)
• Self-Sampling for Neural Point Cloud Consolidation [83.31236364265403]
  We introduce a novel technique for neural point cloud consolidation which learns from only the input point cloud. We repeatedly self-sample the input point cloud with global subsets that are used to train a deep neural network. We demonstrate the ability to consolidate point sets from a variety of shapes, while eliminating outliers and noise.
  arXiv  Detail & Related papers  (2020-08-14T17:16:02Z)
• Meshing Point Clouds with Predicted Intrinsic-Extrinsic Ratio Guidance [30.863194319818223]
  We propose to leverage the input point cloud as much as possible, by only adding connectivity information to existing points. Our key innovation is a surrogate of local connectivity, calculated by comparing the intrinsic/extrinsic metrics. We demonstrate that our method can not only preserve details, handle ambiguous structures, but also possess strong generalizability to unseen categories.
  arXiv  Detail & Related papers  (2020-07-17T22:36:00Z)
• Neural Subdivision [58.97214948753937]
  This paper introduces Neural Subdivision, a novel framework for data-driven coarseto-fine geometry modeling. We optimize for the same set of network weights across all local mesh patches, thus providing an architecture that is not constrained to a specific input mesh, fixed genus, or category. We demonstrate that even when trained on a single high-resolution mesh our method generates reasonable subdivisions for novel shapes.
  arXiv  Detail & Related papers  (2020-05-04T20:03:21Z)
• PointGMM: a Neural GMM Network for Point Clouds [83.9404865744028]
  Point clouds are popular representation for 3D shapes, but encode a particular sampling without accounting for shape priors or non-local information. We present PointGMM, a neural network that learns to generate hGMMs which are characteristic of the shape class. We show that as a generative model, PointGMM learns a meaningful latent space which enables generating consistents between existing shapes.
  arXiv  Detail & Related papers  (2020-03-30T10:34:59Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.