TCDM: Transformational Complexity Based Distortion Metric for Perceptual
Point Cloud Quality Assessment
- URL: http://arxiv.org/abs/2210.04671v3
- Date: Wed, 29 Nov 2023 13:20:22 GMT
- Title: TCDM: Transformational Complexity Based Distortion Metric for Perceptual
Point Cloud Quality Assessment
- Authors: Yujie Zhang, Qi Yang, Yifei Zhou, Xiaozhong Xu, Le Yang, Yiling Xu
- Abstract summary: The goal of objective point cloud quality assessment (PCQA) research is to develop metrics that measure point cloud quality in a consistent manner.
We evaluate the point cloud quality by measuring the complexity of transforming the distorted point cloud back to its reference.
The effectiveness of the proposed transformational complexity based distortion metric (TCDM) is evaluated through extensive experiments conducted on five public point cloud quality assessment databases.
- Score: 24.936061591860838
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: The goal of objective point cloud quality assessment (PCQA) research is to
develop quantitative metrics that measure point cloud quality in a perceptually
consistent manner. Merging the research of cognitive science and intuition of
the human visual system (HVS), in this paper, we evaluate the point cloud
quality by measuring the complexity of transforming the distorted point cloud
back to its reference, which in practice can be approximated by the code length
of one point cloud when the other is given. For this purpose, we first make
space segmentation for the reference and distorted point clouds based on a 3D
Voronoi diagram to obtain a series of local patch pairs. Next, inspired by the
predictive coding theory, we utilize a space-aware vector autoregressive
(SA-VAR) model to encode the geometry and color channels of each reference
patch with and without the distorted patch, respectively. Assuming that the
residual errors follow the multi-variate Gaussian distributions, the
self-complexity of the reference and transformational complexity between the
reference and distorted samples are computed using covariance matrices.
Additionally, the prediction terms generated by SA-VAR are introduced as one
auxiliary feature to promote the final quality prediction. The effectiveness of
the proposed transformational complexity based distortion metric (TCDM) is
evaluated through extensive experiments conducted on five public point cloud
quality assessment databases. The results demonstrate that TCDM achieves
state-of-the-art (SOTA) performance, and further analysis confirms its
robustness in various scenarios. The code is publicly available at
https://github.com/zyj1318053/TCDM.
Related papers
- PseudoNeg-MAE: Self-Supervised Point Cloud Learning using Conditional Pseudo-Negative Embeddings [55.55445978692678]
PseudoNeg-MAE is a self-supervised learning framework that enhances global feature representation of point cloud mask autoencoders.
We show that PseudoNeg-MAE achieves state-of-the-art performance on the ModelNet40 and ScanObjectNN datasets.
arXiv Detail & Related papers (2024-09-24T07:57:21Z) - Bridging Domain Gap of Point Cloud Representations via Self-Supervised Geometric Augmentation [15.881442863961531]
We introduce a novel scheme for induced geometric invariance of point cloud representations across domains.
On one hand, a novel pretext task of predicting translation of distances of augmented samples is proposed to alleviate centroid shift of point clouds.
On the other hand, we pioneer an integration of the relational self-supervised learning on geometrically-augmented point clouds.
arXiv Detail & Related papers (2024-09-11T02:39:19Z) - Perception-Guided Quality Metric of 3D Point Clouds Using Hybrid Strategy [38.942691194229724]
Full-reference point cloud quality assessment (FR-PCQA) aims to infer the quality of distorted point clouds with available references.
Most of the existing FR-PCQA metrics ignore the fact that the human visual system (HVS) dynamically tackles visual information according to different distortion levels.
We propose a perception-guided hybrid metric (PHM) that adaptively leverages two visual strategies with respect to distortion degree to predict point cloud quality.
arXiv Detail & Related papers (2024-07-04T12:23:39Z) - Contrastive Pre-Training with Multi-View Fusion for No-Reference Point Cloud Quality Assessment [49.36799270585947]
No-reference point cloud quality assessment (NR-PCQA) aims to automatically evaluate the perceptual quality of distorted point clouds without available reference.
We propose a novel contrastive pre-training framework tailored for PCQA (CoPA)
Our method outperforms the state-of-the-art PCQA methods on popular benchmarks.
arXiv Detail & Related papers (2024-03-15T07:16:07Z) - Unleash the Potential of 3D Point Cloud Modeling with A Calibrated Local
Geometry-driven Distance Metric [62.365983810610985]
We propose a novel distance metric called Calibrated Local Geometry Distance (CLGD)
CLGD computes the difference between the underlying 3D surfaces calibrated and induced by a set of reference points.
As a generic metric, CLGD has the potential to advance 3D point cloud modeling.
arXiv Detail & Related papers (2023-06-01T11:16:20Z) - Reduced-Reference Quality Assessment of Point Clouds via
Content-Oriented Saliency Projection [17.983188216548005]
Many dense 3D point clouds have been exploited to represent visual objects instead of traditional images or videos.
We propose a novel and efficient Reduced-Reference quality metric for point clouds.
arXiv Detail & Related papers (2023-01-18T18:00:29Z) - GPA-Net:No-Reference Point Cloud Quality Assessment with Multi-task
Graph Convolutional Network [35.381247959766505]
We propose a novel no-reference PCQA metric named the Graph convolutional PCQA network (GPA-Net)
To extract effective features for PCQA, we propose a new graph convolution kernel, i.e., GPAConv, which attentively captures the perturbation of structure and texture.
Experimental results on two independent databases show that GPA-Net achieves the best performance compared to the state-of-the-art no-reference PCQA metrics.
arXiv Detail & Related papers (2022-10-29T03:06:55Z) - 3D Human Pose and Shape Regression with Pyramidal Mesh Alignment
Feedback Loop [128.07841893637337]
Regression-based methods have recently shown promising results in reconstructing human meshes from monocular images.
Minor deviation in parameters may lead to noticeable misalignment between the estimated meshes and image evidences.
We propose a Pyramidal Mesh Alignment Feedback (PyMAF) loop to leverage a feature pyramid and rectify the predicted parameters.
arXiv Detail & Related papers (2021-03-30T17:07:49Z) - Reduced Reference Perceptual Quality Model and Application to Rate
Control for 3D Point Cloud Compression [61.110938359555895]
In rate-distortion optimization, the encoder settings are determined by maximizing a reconstruction quality measure subject to a constraint on the bit rate.
We propose a linear perceptual quality model whose variables are the V-PCC geometry and color quantization parameters.
Subjective quality tests with 400 compressed 3D point clouds show that the proposed model correlates well with the mean opinion score.
We show that for the same target bit rate, ratedistortion optimization based on the proposed model offers higher perceptual quality than rate-distortion optimization based on exhaustive search with a point-to-point objective quality metric.
arXiv Detail & Related papers (2020-11-25T12:42:02Z) - Permutation Matters: Anisotropic Convolutional Layer for Learning on
Point Clouds [145.79324955896845]
We propose a permutable anisotropic convolutional operation (PAI-Conv) that calculates soft-permutation matrices for each point.
Experiments on point clouds demonstrate that PAI-Conv produces competitive results in classification and semantic segmentation tasks.
arXiv Detail & Related papers (2020-05-27T02:42:29Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.