A No-Reference Quality Assessment Method for Digital Human Head

• URL: http://arxiv.org/abs/2310.16732v1
• Date: Wed, 25 Oct 2023 16:01:05 GMT
• Title: A No-Reference Quality Assessment Method for Digital Human Head
• Authors: Yingjie Zhou, Zicheng Zhang, Wei Sun, Xiongkuo Min, Xianghe Ma, Guangtao Zhai
• Abstract summary: We develop a novel no-reference (NR) method based on Transformer to deal with digital human quality assessment (DHQA) Specifically, the front 2D projections of the digital humans are rendered as inputs and the vision transformer (ViT) is employed for the feature extraction. Then we design a multi-task module to jointly classify the distortion types and predict the perceptual quality levels of digital humans.
• Score: 56.17852258306602
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: In recent years, digital humans have been widely applied in augmented/virtual reality (A/VR), where viewers are allowed to freely observe and interact with the volumetric content. However, the digital humans may be degraded with various distortions during the procedure of generation and transmission. Moreover, little effort has been put into the perceptual quality assessment of digital humans. Therefore, it is urgent to carry out objective quality assessment methods to tackle the challenge of digital human quality assessment (DHQA). In this paper, we develop a novel no-reference (NR) method based on Transformer to deal with DHQA in a multi-task manner. Specifically, the front 2D projections of the digital humans are rendered as inputs and the vision transformer (ViT) is employed for the feature extraction. Then we design a multi-task module to jointly classify the distortion types and predict the perceptual quality levels of digital humans. The experimental results show that the proposed method well correlates with the subjective ratings and outperforms the state-of-the-art quality assessment methods.

Related papers

• Aligning Human Motion Generation with Human Perceptions [51.831338643012444]
  We propose a data-driven approach to bridge the gap by introducing a large-scale human perceptual evaluation dataset, MotionPercept, and a human motion critic model, MotionCritic. Our critic model offers a more accurate metric for assessing motion quality and could be readily integrated into the motion generation pipeline.
  arXiv  Detail & Related papers  (2024-07-02T14:01:59Z)
• THQA: A Perceptual Quality Assessment Database for Talking Heads [56.42738564463101]
  Speech-driven methods offer a novel avenue for manipulating the mouth shape and expressions of digital humans. Despite the proliferation of driving methods, the quality of many generated talking head (TH) videos remains a concern. This paper introduces the Talking Head Quality Assessment (THQA) database, featuring 800 TH videos generated through 8 diverse speech-driven methods.
  arXiv  Detail & Related papers  (2024-04-13T13:08:57Z)
• Geometry-Aware Video Quality Assessment for Dynamic Digital Human [56.17852258306602]
  We propose a novel no-reference (NR) geometry-aware video quality assessment method for DDH-QA challenge. The proposed method achieves state-of-the-art performance on the DDH-QA database.
  arXiv  Detail & Related papers  (2023-10-24T16:34:03Z)
• Advancing Zero-Shot Digital Human Quality Assessment through Text-Prompted Evaluation [60.873105678086404]
  SJTU-H3D is a subjective quality assessment database specifically designed for full-body digital humans. It comprises 40 high-quality reference digital humans and 1,120 labeled distorted counterparts generated with seven types of distortions.
  arXiv  Detail & Related papers  (2023-07-06T06:55:30Z)
• DDH-QA: A Dynamic Digital Humans Quality Assessment Database [55.69700918818879]
  We construct a large-scale dynamic digital human quality assessment database with diverse motion content as well as multiple distortions. Ten types of common motion are employed to drive the DDHs and a total of 800 DDHs are generated in the end.
  arXiv  Detail & Related papers  (2022-12-24T13:35:31Z)
• Perceptual Quality Assessment for Digital Human Heads [35.801468849447126]
  We propose the first large-scale quality assessment database for 3D scanned digital human heads (DHHs) The constructed database consists of 55 reference DHHs and 1,540 distorted DHHs along with the subjective perceptual ratings. The experimental results reveal that the proposed method exhibits state-of-the-art performance among the mainstream FR metrics.
  arXiv  Detail & Related papers  (2022-09-20T06:02:57Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.