Surface Geometry Processing: An Efficient Normal-based Detail Representation

• URL: http://arxiv.org/abs/2307.07945v1
• Date: Sun, 16 Jul 2023 04:46:32 GMT
• Title: Surface Geometry Processing: An Efficient Normal-based Detail Representation
• Authors: Wuyuan Xie, Miaohui Wang, Di Lin, Boxin Shi, and Jianmin Jiang
• Abstract summary: We introduce an efficient surface detail processing framework in 2D normal domain. We show that the proposed normal-based representation has three important properties, including detail separability, detail transferability and detail idempotence. Three new schemes are further designed for geometric surface detail processing applications, including geometric texture synthesis, geometry detail transfer, and 3D surface super-resolution.
• Score: 66.69000350849328
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: With the rapid development of high-resolution 3D vision applications, the traditional way of manipulating surface detail requires considerable memory and computing time. To address these problems, we introduce an efficient surface detail processing framework in 2D normal domain, which extracts new normal feature representations as the carrier of micro geometry structures that are illustrated both theoretically and empirically in this article. Compared with the existing state of the arts, we verify and demonstrate that the proposed normal-based representation has three important properties, including detail separability, detail transferability and detail idempotence. Finally, three new schemes are further designed for geometric surface detail processing applications, including geometric texture synthesis, geometry detail transfer, and 3D surface super-resolution. Theoretical analysis and experimental results on the latest benchmark dataset verify the effectiveness and versatility of our normal-based representation, which accepts 30 times of the input surface vertices but at the same time only takes 6.5% memory cost and 14.0% running time in comparison with existing competing algorithms.

Related papers

• SuperCarver: Texture-Consistent 3D Geometry Super-Resolution for High-Fidelity Surface Detail Generation [70.76810765911499]
  SuperCarver is a 3D geometry framework specifically tailored for adding texture-consistent surface details to given coarse meshes. To achieve geometric detail generation, we develop a deterministic prior-guided normal diffusion model fine-tuned on a dataset of paired low-poly and high-poly normal renderings. To optimize mesh structures from potentially imperfect normal map predictions, we design a simple yet effective noise-resistant inverse rendering scheme.
  arXiv  Detail & Related papers  (2025-03-12T14:38:45Z)
• Textured Mesh Saliency: Bridging Geometry and Texture for Human Perception in 3D Graphics [50.23625950905638]
  We present a new dataset for textured mesh saliency, created through an innovative eye-tracking experiment in a six degrees of freedom (6-DOF) VR environment. Our proposed model predicts saliency maps for textured mesh surfaces by treating each triangular face as an individual unit and assigning a saliency density value to reflect the importance of each local surface region.
  arXiv  Detail & Related papers  (2024-12-11T08:27:33Z)
• GausSurf: Geometry-Guided 3D Gaussian Splatting for Surface Reconstruction [79.42244344704154]
  GausSurf employs geometry guidance from multi-view consistency in texture-rich areas and normal priors in texture-less areas of a scene. Our method surpasses state-of-the-art methods in terms of reconstruction quality and computation time.
  arXiv  Detail & Related papers  (2024-11-29T03:54:54Z)
• Geometry Distributions [51.4061133324376]
  We propose a novel geometric data representation that models geometry as distributions. Our approach uses diffusion models with a novel network architecture to learn surface point distributions. We evaluate our representation qualitatively and quantitatively across various object types, demonstrating its effectiveness in achieving high geometric fidelity.
  arXiv  Detail & Related papers  (2024-11-25T04:06:48Z)
• Multi-task Geometric Estimation of Depth and Surface Normal from Monocular 360° Images [45.051325655043634]
  We introduce a novel multi-task learning (MTL) network that simultaneously estimates depth and surface normals from 360deg images. Experimental results demonstrate that our MTL architecture significantly outperforms state-of-the-art methods in both depth and surface normal estimation. Our model's effectiveness and generalizability, particularly in handling intricate surface textures, establish it as a new benchmark in 360deg image geometric estimation.
  arXiv  Detail & Related papers  (2024-11-04T02:20:22Z)
• GigaGS: Scaling up Planar-Based 3D Gaussians for Large Scene Surface Reconstruction [71.08607897266045]
  3D Gaussian Splatting (3DGS) has shown promising performance in novel view synthesis. We make the first attempt to tackle the challenging task of large-scale scene surface reconstruction. We propose GigaGS, the first work for high-quality surface reconstruction for large-scale scenes using 3DGS.
  arXiv  Detail & Related papers  (2024-09-10T17:51:39Z)
• Spurfies: Sparse Surface Reconstruction using Local Geometry Priors [8.260048622127913]
  We introduce Spurfies, a novel method for sparse-view surface reconstruction. It disentangles appearance and geometry information to utilize local geometry priors trained on synthetic data. We validate our method on the DTU dataset and demonstrate that it outperforms previous state of the art by 35% in surface quality.
  arXiv  Detail & Related papers  (2024-08-29T14:02:47Z)
• Normal-guided Detail-Preserving Neural Implicit Function for High-Fidelity 3D Surface Reconstruction [6.4279213810512665]
  This paper shows that training neural representations with first-order differential properties (surface normals) leads to highly accurate 3D surface reconstruction. Experiments demonstrate that our method achieves state-of-the-art reconstruction accuracy with a minimal number of views.
  arXiv  Detail & Related papers  (2024-06-07T11:48:47Z)
• Flatten Anything: Unsupervised Neural Surface Parameterization [76.4422287292541]
  We introduce the Flatten Anything Model (FAM), an unsupervised neural architecture to achieve global free-boundary surface parameterization. Compared with previous methods, our FAM directly operates on discrete surface points without utilizing connectivity information. Our FAM is fully-automated without the need for pre-cutting and can deal with highly-complex topologies.
  arXiv  Detail & Related papers  (2024-05-23T14:39:52Z)
• ActivationNet: Representation learning to predict contact quality of interacting 3-D surfaces in engineering designs [0.0]
  In machine learning applications, 3-D surfaces are most suitably represented with point clouds or meshes. This paper introduces a machine learning algorithm, ActivationNet, that can learn from point clouds or meshes of interacting 3-D surfaces and predict the quality of contact between these surfaces.
  arXiv  Detail & Related papers  (2021-03-21T02:30:36Z)
• Deep Active Surface Models [60.027353171412216]
  Active Surface Models have a long history of being useful to model complex 3D surfaces but only Active Contours have been used in conjunction with deep networks. We introduce layers that implement them that can be integrated seamlessly into Graph Convolutional Networks to enforce sophisticated smoothness priors.
  arXiv  Detail & Related papers  (2020-11-17T18:48:28Z)
• Pix2Surf: Learning Parametric 3D Surface Models of Objects from Images [64.53227129573293]
  We investigate the problem of learning to generate 3D parametric surface representations for novel object instances, as seen from one or more views. We design neural networks capable of generating high-quality parametric 3D surfaces which are consistent between views. Our method is supervised and trained on a public dataset of shapes from common object categories.
  arXiv  Detail & Related papers  (2020-08-18T06:33:40Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.