MeshUDF: Fast and Differentiable Meshing of Unsigned Distance Field Networks

• URL: http://arxiv.org/abs/2111.14549v1
• Date: Mon, 29 Nov 2021 14:24:02 GMT
• Title: MeshUDF: Fast and Differentiable Meshing of Unsigned Distance Field Networks
• Authors: Benoit Guillard and Federico Stella and Pascal Fua
• Abstract summary: Recent work modelling 3D open surfaces train deep neural networks to approximate Unsigned Distance Fields (UDFs) We propose to directly mesh deep UDFs as open surfaces with an extension of marching cubes, by locally detecting surface crossings. Our method is order of magnitude faster than meshing a dense point cloud, and more accurate than inflating open surfaces.
• Score: 68.82901764109685
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Recent work modelling 3D open surfaces train deep neural networks to approximate Unsigned Distance Fields (UDFs) and implicitly represent shapes. To convert this representation to an explicit mesh, they either use computationally expensive methods to mesh a dense point cloud sampling of the surface, or distort the surface by inflating it into a Signed Distance Field (SDF). By contrast, we propose to directly mesh deep UDFs as open surfaces with an extension of marching cubes, by locally detecting surface crossings. Our method is order of magnitude faster than meshing a dense point cloud, and more accurate than inflating open surfaces. Moreover, we make our surface extraction differentiable, and show it can help fit sparse supervision signals.

Related papers

• Statistical Edge Detection And UDF Learning For Shape Representation [1.9799527196428242]
  We propose a method for learning UDFs that improves the fidelity of the obtained Neural UDF to the original 3D surface. We show that sampling more training points around surface edges allows better local accuracy of the trained Neural UDF. Our method is shown to detect surface edges more accurately than a commonly used local geometric descriptor.
  arXiv  Detail & Related papers  (2024-05-06T11:40:57Z)
• Surface Reconstruction from Point Clouds via Grid-based Intersection Prediction [12.329450385760051]
  We propose a novel approach that directly predicts the intersection points between line segment of point pairs and implicit surfaces. Our approach demonstrates state-of-the-art performance on three datasets: ShapeNet, MGN, and ScanNet.
  arXiv  Detail & Related papers  (2024-03-21T02:31:17Z)
• GeoUDF: Surface Reconstruction from 3D Point Clouds via Geometry-guided Distance Representation [73.77505964222632]
  We present a learning-based method, namely GeoUDF, to tackle the problem of reconstructing a discrete surface from a sparse point cloud. To be specific, we propose a geometry-guided learning method for UDF and its gradient estimation. To extract triangle meshes from the predicted UDF, we propose a customized edge-based marching cube module.
  arXiv  Detail & Related papers  (2022-11-30T06:02:01Z)
• CAP-UDF: Learning Unsigned Distance Functions Progressively from Raw Point Clouds with Consistency-Aware Field Optimization [54.69408516025872]
  CAP-UDF is a novel method to learn consistency-aware UDF from raw point clouds. We train a neural network to gradually infer the relationship between queries and the approximated surface. We also introduce a polygonization algorithm to extract surfaces using the gradients of the learned UDF.
  arXiv  Detail & Related papers  (2022-10-06T08:51:08Z)
• Reconstructing Surfaces for Sparse Point Clouds with On-Surface Priors [52.25114448281418]
  Current methods are able to reconstruct surfaces by learning Signed Distance Functions (SDFs) from single point clouds without ground truth signed distances or point normals. We propose to reconstruct highly accurate surfaces from sparse point clouds with an on-surface prior. Our method can learn SDFs from a single sparse point cloud without ground truth signed distances or point normals.
  arXiv  Detail & Related papers  (2022-04-22T09:45:20Z)
• Deep Implicit Surface Point Prediction Networks [49.286550880464866]
  Deep neural representations of 3D shapes as implicit functions have been shown to produce high fidelity models. This paper presents a novel approach that models such surfaces using a new class of implicit representations called the closest surface-point (CSP) representation.
  arXiv  Detail & Related papers  (2021-06-10T14:31:54Z)
• DUDE: Deep Unsigned Distance Embeddings for Hi-Fidelity Representation of Complex 3D Surfaces [8.104199886760275]
  DUDE is a disentangled shape representation that utilizes an unsigned distance field (uDF) to represent proximity to a surface, and a normal vector field (nVF) to represent surface orientation. We show that a combination of these two (uDF+nVF) can be used to learn high fidelity representations for arbitrary open/closed shapes.
  arXiv  Detail & Related papers  (2020-11-04T22:49:05Z)
• Neural Unsigned Distance Fields for Implicit Function Learning [53.241423815726925]
  We propose Neural Distance Fields (NDF), a neural network based model which predicts the unsigned distance field for arbitrary 3D shapes. NDF represent surfaces at high resolutions as prior implicit models, but do not require closed surface data. NDF can be used for multi-target regression (multiple outputs for one input) with techniques that have been exclusively used for rendering in graphics.
  arXiv  Detail & Related papers  (2020-10-26T22:49:45Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.