NeutrEx: A 3D Quality Component Measure on Facial Expression Neutrality

• URL: http://arxiv.org/abs/2308.09963v1
• Date: Sat, 19 Aug 2023 09:38:39 GMT
• Title: NeutrEx: A 3D Quality Component Measure on Facial Expression Neutrality
• Authors: Marcel Grimmer, Christian Rathgeb, Raymond Veldhuis, Christoph Busch
• Abstract summary: We propose a quality measure based on the accumulated distances of a 3D face reconstruction to a neutral expression anchor. Our evaluations demonstrate the superiority of our proposed method compared to baseline approaches.
• Score: 7.736597471757526
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Accurate face recognition systems are increasingly important in sensitive applications like border control or migration management. Therefore, it becomes crucial to quantify the quality of facial images to ensure that low-quality images are not affecting recognition accuracy. In this context, the current draft of ISO/IEC 29794-5 introduces the concept of component quality to estimate how single factors of variation affect recognition outcomes. In this study, we propose a quality measure (NeutrEx) based on the accumulated distances of a 3D face reconstruction to a neutral expression anchor. Our evaluations demonstrate the superiority of our proposed method compared to baseline approaches obtained by training Support Vector Machines on face embeddings extracted from a pre-trained Convolutional Neural Network for facial expression classification. Furthermore, we highlight the explainable nature of our NeutrEx measures by computing per-vertex distances to unveil the most impactful face regions and allow operators to give actionable feedback to subjects.

Related papers

• Rank-based No-reference Quality Assessment for Face Swapping [88.53827937914038]
  The metric of measuring the quality in most face swapping methods relies on several distances between the manipulated images and the source image. We present a novel no-reference image quality assessment (NR-IQA) method specifically designed for face swapping.
  arXiv  Detail & Related papers  (2024-06-04T01:36:29Z)
• Boosting Cross-Quality Face Verification using Blind Face Restoration [0.13654846342364302]
  It is crucial for the task of face verification to enhance the perceptual quality of the low quality images. In this paper, we investigate the impact of applying three state-of-the-art blind face restoration techniques on the performance of face verification system.
  arXiv  Detail & Related papers  (2023-08-15T18:05:19Z)
• Pose Impact Estimation on Face Recognition using 3D-Aware Synthetic Data with Application to Quality Assessment [8.695160236142456]
  In light of advances in 3D-aware generative adversarial networks, we propose a novel dataset, Syn-YawPitch. We demonstrate that pitch angles beyond 30 degrees have a significant impact on the biometric performance of current face recognition systems.
  arXiv  Detail & Related papers  (2023-03-01T13:26:39Z)
• Progressive Spatio-Temporal Bilinear Network with Monte Carlo Dropout for Landmark-based Facial Expression Recognition with Uncertainty Estimation [93.73198973454944]
  The performance of our method is evaluated on three widely used datasets. It is comparable to that of video-based state-of-the-art methods while it has much less complexity.
  arXiv  Detail & Related papers  (2021-06-08T13:40:30Z)
• Facial Expressions as a Vulnerability in Face Recognition [73.85525896663371]
  This work explores facial expression bias as a security vulnerability of face recognition systems. We present a comprehensive analysis of how facial expression bias impacts the performance of face recognition technologies.
  arXiv  Detail & Related papers  (2020-11-17T18:12:41Z)
• Face Anti-Spoofing Via Disentangled Representation Learning [90.90512800361742]
  Face anti-spoofing is crucial to security of face recognition systems. We propose a novel perspective of face anti-spoofing that disentangles the liveness features and content features from images.
  arXiv  Detail & Related papers  (2020-08-19T03:54:23Z)
• Deep Face Super-Resolution with Iterative Collaboration between Attentive Recovery and Landmark Estimation [92.86123832948809]
  We propose a deep face super-resolution (FSR) method with iterative collaboration between two recurrent networks. In each recurrent step, the recovery branch utilizes the prior knowledge of landmarks to yield higher-quality images. A new attentive fusion module is designed to strengthen the guidance of landmark maps.
  arXiv  Detail & Related papers  (2020-03-29T16:04:48Z)
• SER-FIQ: Unsupervised Estimation of Face Image Quality Based on Stochastic Embedding Robustness [15.431761867166]
  We propose a novel concept to measure face quality based on an arbitrary face recognition model. We compare our proposed solution on two face embeddings against six state-of-the-art approaches from academia and industry.
  arXiv  Detail & Related papers  (2020-03-20T16:50:30Z)
• Verifying Deep Learning-based Decisions for Facial Expression Recognition [0.8137198664755597]
  We classify facial expressions with a neural network and create pixel-based explanations. We quantify these visual explanations based on a bounding-box method with respect to facial regions. Although our results show that the neural network achieves state-of-the-art results, the evaluation of the visual explanations reveals that relevant facial regions may not be considered.
  arXiv  Detail & Related papers  (2020-02-14T15:59:32Z)
• Exploiting Semantics for Face Image Deblurring [121.44928934662063]
  We propose an effective and efficient face deblurring algorithm by exploiting semantic cues via deep convolutional neural networks. We incorporate face semantic labels as input priors and propose an adaptive structural loss to regularize facial local structures. The proposed method restores sharp images with more accurate facial features and details.
  arXiv  Detail & Related papers  (2020-01-19T13:06:27Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.