GeodesicPSIM: Predicting the Quality of Static Mesh with Texture Map via
Geodesic Patch Similarity
- URL: http://arxiv.org/abs/2308.04928v2
- Date: Thu, 24 Aug 2023 02:11:15 GMT
- Title: GeodesicPSIM: Predicting the Quality of Static Mesh with Texture Map via
Geodesic Patch Similarity
- Authors: Qi Yang, Joel Jung, Xiaozhong Xu, and Shan Liu
- Abstract summary: We propose Geodesic Patch Similarity (GeodesicPSIM) to accurately predict human perception quality for static meshes.
A two-step patch cropping algorithm and a texture mapping module refine the size of 1-hop geodesic patches.
GeodesicPSIM provides state-of-the-art performance in comparison with image-based, point-based, and video-based metrics.
- Score: 24.34820730382366
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Static meshes with texture maps have attracted considerable attention in both
industrial manufacturing and academic research, leading to an urgent
requirement for effective and robust objective quality evaluation. However,
current model-based static mesh quality metrics have obvious limitations: most
of them only consider geometry information, while color information is ignored,
and they have strict constraints for the meshes' geometrical topology. Other
metrics, such as image-based and point-based metrics, are easily influenced by
the prepossessing algorithms, e.g., projection and sampling, hampering their
ability to perform at their best. In this paper, we propose Geodesic Patch
Similarity (GeodesicPSIM), a novel model-based metric to accurately predict
human perception quality for static meshes. After selecting a group keypoints,
1-hop geodesic patches are constructed based on both the reference and
distorted meshes cleaned by an effective mesh cleaning algorithm. A two-step
patch cropping algorithm and a patch texture mapping module refine the size of
1-hop geodesic patches and build the relationship between the mesh geometry and
color information, resulting in the generation of 1-hop textured geodesic
patches. Three types of features are extracted to quantify the distortion:
patch color smoothness, patch discrete mean curvature, and patch pixel color
average and variance. To the best of our knowledge, GeodesicPSIM is the first
model-based metric especially designed for static meshes with texture maps.
GeodesicPSIM provides state-of-the-art performance in comparison with
image-based, point-based, and video-based metrics on a newly created and
challenging database. We also prove the robustness of GeodesicPSIM by
introducing different settings of hyperparameters. Ablation studies also
exhibit the effectiveness of three proposed features and the patch cropping
algorithm.
Related papers
- Coupled Laplacian Eigenmaps for Locally-Aware 3D Rigid Point Cloud Matching [0.0]
We propose a new technique, based on graph Laplacian eigenmaps, to match point clouds by taking into account fine local structures.
To deal with the order and sign ambiguity of Laplacian eigenmaps, we introduce a new operator, called Coupled Laplacian.
We show that the similarity between those aligned high-dimensional spaces provides a locally meaningful score to match shapes.
arXiv Detail & Related papers (2024-02-27T10:10:12Z) - Quadric Representations for LiDAR Odometry, Mapping and Localization [93.24140840537912]
Current LiDAR odometry, mapping and localization methods leverage point-wise representations of 3D scenes.
We propose a novel method of describing scenes using quadric surfaces, which are far more compact representations of 3D objects.
Our method maintains low latency and memory utility while achieving competitive, and even superior, accuracy.
arXiv Detail & Related papers (2023-04-27T13:52:01Z) - Flattening-Net: Deep Regular 2D Representation for 3D Point Cloud
Analysis [66.49788145564004]
We present an unsupervised deep neural architecture called Flattening-Net to represent irregular 3D point clouds of arbitrary geometry and topology.
Our methods perform favorably against the current state-of-the-art competitors.
arXiv Detail & Related papers (2022-12-17T15:05:25Z) - Texture image analysis based on joint of multi directions GLCM and local
ternary patterns [0.0]
Texture features can be used in many different applications in commuter vision or machine learning problems.
New approach is proposed based on combination of two texture descriptor, co-occurrence matrix and local ternary patterns.
Experimental results show that proposed approach provide higher classification rate in comparison with some state-of-the-art approaches.
arXiv Detail & Related papers (2022-09-05T09:53:00Z) - GraphFit: Learning Multi-scale Graph-Convolutional Representation for
Point Cloud Normal Estimation [31.40738037512243]
We propose a precise and efficient normal estimation method for unstructured 3D point clouds.
We learn graph convolutional feature representation for normal estimation, which emphasizes more local neighborhood geometry.
Our method outperforms competitors with the state-of-the-art accuracy on various benchmark datasets.
arXiv Detail & Related papers (2022-07-23T10:29:26Z) - CAMERAS: Enhanced Resolution And Sanity preserving Class Activation
Mapping for image saliency [61.40511574314069]
Backpropagation image saliency aims at explaining model predictions by estimating model-centric importance of individual pixels in the input.
We propose CAMERAS, a technique to compute high-fidelity backpropagation saliency maps without requiring any external priors.
arXiv Detail & Related papers (2021-06-20T08:20:56Z) - Self-supervised Geometric Perception [96.89966337518854]
Self-supervised geometric perception is a framework to learn a feature descriptor for correspondence matching without any ground-truth geometric model labels.
We show that SGP achieves state-of-the-art performance that is on-par or superior to the supervised oracles trained using ground-truth labels.
arXiv Detail & Related papers (2021-03-04T15:34:43Z) - Deep Geometric Texture Synthesis [83.9404865744028]
We propose a novel framework for synthesizing geometric textures.
It learns texture statistics from local neighborhoods of a single reference 3D model.
Our network displaces mesh vertices in any direction, enabling synthesis of geometric textures.
arXiv Detail & Related papers (2020-06-30T19:36:38Z) - Image Quality Assessment: Unifying Structure and Texture Similarity [38.05659069533254]
We develop the first full-reference image quality model with explicit tolerance to texture resampling.
Using a convolutional neural network, we construct an injective and differentiable function that transforms images to overcomplete representations.
arXiv Detail & Related papers (2020-04-16T16:11:46Z) - PUGeo-Net: A Geometry-centric Network for 3D Point Cloud Upsampling [103.09504572409449]
We propose a novel deep neural network based method, called PUGeo-Net, to generate uniform dense point clouds.
Thanks to its geometry-centric nature, PUGeo-Net works well for both CAD models with sharp features and scanned models with rich geometric details.
arXiv Detail & Related papers (2020-02-24T14:13:29Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.