Refine-Net: Normal Refinement Neural Network for Noisy Point Clouds
- URL: http://arxiv.org/abs/2203.12514v1
- Date: Wed, 23 Mar 2022 16:18:51 GMT
- Title: Refine-Net: Normal Refinement Neural Network for Noisy Point Clouds
- Authors: Haoran Zhou, Honghua Chen, Yingkui Zhang, Mingqiang Wei, Haoran Xie,
Jun Wang, Tong Lu, Jing Qin, and Xiao-Ping Zhang
- Abstract summary: We propose a normal refinement network, called Refine-Net, to predict accurate normals for noisy point clouds.
Our network is designed to refine the initial normal of each point by extracting additional information from multiple feature representations.
- Score: 36.414785147181995
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Point normal, as an intrinsic geometric property of 3D objects, not only
serves conventional geometric tasks such as surface consolidation and
reconstruction, but also facilitates cutting-edge learning-based techniques for
shape analysis and generation. In this paper, we propose a normal refinement
network, called Refine-Net, to predict accurate normals for noisy point clouds.
Traditional normal estimation wisdom heavily depends on priors such as surface
shapes or noise distributions, while learning-based solutions settle for single
types of hand-crafted features. Differently, our network is designed to refine
the initial normal of each point by extracting additional information from
multiple feature representations. To this end, several feature modules are
developed and incorporated into Refine-Net by a novel connection module.
Besides the overall network architecture of Refine-Net, we propose a new
multi-scale fitting patch selection scheme for the initial normal estimation,
by absorbing geometry domain knowledge. Also, Refine-Net is a generic normal
estimation framework: 1) point normals obtained from other methods can be
further refined, and 2) any feature module related to the surface geometric
structures can be potentially integrated into the framework. Qualitative and
quantitative evaluations demonstrate the clear superiority of Refine-Net over
the state-of-the-arts on both synthetic and real-scanned datasets. Our code is
available at https://github.com/hrzhou2/refinenet.
Related papers
- Segmenting objects with Bayesian fusion of active contour models and convnet priors [0.729597981661727]
We propose a novel instance segmentation method geared towards Natural Resource Monitoring (NRM) imagery.
We formulate the problem as Bayesian maximum a posteriori inference which, in learning the individual object contours, incorporates shape, location, and position priors.
In experiments, we tackle the challenging, real-world problem of segmenting individual dead tree crowns and precise contours.
arXiv Detail & Related papers (2024-10-09T20:36:43Z) - SieveNet: Selecting Point-Based Features for Mesh Networks [41.74190660234404]
Meshes are widely used in 3D computer vision and graphics, but their irregular topology poses challenges in applying them to existing neural network architectures.
Recent advances in mesh neural networks turn to remeshing and push the boundary of pioneer methods that solely take the raw meshes as input.
We propose SieveNet, a novel paradigm that takes into account both the regular topology and the exact geometry.
arXiv Detail & Related papers (2023-08-24T03:40:16Z) - PCDNF: Revisiting Learning-based Point Cloud Denoising via Joint Normal
Filtering [10.411935152370136]
We propose an end-to-end network, named PCDNF, to denoise point clouds via joint normal filtering.
In particular, we introduce an auxiliary normal filtering task to help the overall network remove noise more effectively.
In addition to the overall architecture, our network has two novel modules.
arXiv Detail & Related papers (2022-09-02T03:10:21Z) - Spelunking the Deep: Guaranteed Queries for General Neural Implicit
Surfaces [35.438964954948574]
This work presents a new approach to perform queries directly on general neural implicit functions for a wide range of existing architectures.
Our key tool is the application of range analysis to neural networks, using automatic arithmetic rules to bound the output of a network over a region.
We use the resulting bounds to develop queries including ray casting, intersection testing, constructing spatial hierarchies, fast mesh extraction, closest-point evaluation.
arXiv Detail & Related papers (2022-02-05T00:37:08Z) - GeoNet++: Iterative Geometric Neural Network with Edge-Aware Refinement
for Joint Depth and Surface Normal Estimation [204.13451624763735]
We propose a geometric neural network with edge-aware refinement (GeoNet++) to jointly predict both depth and surface normal maps from a single image.
GeoNet++ effectively predicts depth and surface normals with strong 3D consistency and sharp boundaries.
In contrast to current metrics that focus on evaluating pixel-wise error/accuracy, 3DGM measures whether the predicted depth can reconstruct high-quality 3D surface normals.
arXiv Detail & Related papers (2020-12-13T06:48:01Z) - Primal-Dual Mesh Convolutional Neural Networks [62.165239866312334]
We propose a primal-dual framework drawn from the graph-neural-network literature to triangle meshes.
Our method takes features for both edges and faces of a 3D mesh as input and dynamically aggregates them.
We provide theoretical insights of our approach using tools from the mesh-simplification literature.
arXiv Detail & Related papers (2020-10-23T14:49:02Z) - Refinement of Predicted Missing Parts Enhance Point Cloud Completion [62.997667081978825]
Point cloud completion is the task of predicting complete geometry from partial observations using a point set representation for a 3D shape.
Previous approaches propose neural networks to directly estimate the whole point cloud through encoder-decoder models fed by the incomplete point set.
This paper proposes an end-to-end neural network architecture that focuses on computing the missing geometry and merging the known input and the predicted point cloud.
arXiv Detail & Related papers (2020-10-08T22:01:23Z) - Point2Mesh: A Self-Prior for Deformable Meshes [83.31236364265403]
We introduce Point2Mesh, a technique for reconstructing a surface mesh from an input point cloud.
The self-prior encapsulates reoccurring geometric repetitions from a single shape within the weights of a deep neural network.
We show that Point2Mesh converges to a desirable solution; compared to a prescribed smoothness prior, which often becomes trapped in undesirable local minima.
arXiv Detail & Related papers (2020-05-22T10:01:04Z) - Neural Subdivision [58.97214948753937]
This paper introduces Neural Subdivision, a novel framework for data-driven coarseto-fine geometry modeling.
We optimize for the same set of network weights across all local mesh patches, thus providing an architecture that is not constrained to a specific input mesh, fixed genus, or category.
We demonstrate that even when trained on a single high-resolution mesh our method generates reasonable subdivisions for novel shapes.
arXiv Detail & Related papers (2020-05-04T20:03:21Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.