Pose Impact Estimation on Face Recognition using 3D-Aware Synthetic Data with Application to Quality Assessment

• URL: http://arxiv.org/abs/2303.00491v2
• Date: Wed, 6 Dec 2023 10:54:57 GMT
• Title: Pose Impact Estimation on Face Recognition using 3D-Aware Synthetic Data with Application to Quality Assessment
• Authors: Marcel Grimmer, Christian Rathgeb, Christoph Busch
• Abstract summary: In light of advances in 3D-aware generative adversarial networks, we propose a novel dataset, Syn-YawPitch. We demonstrate that pitch angles beyond 30 degrees have a significant impact on the biometric performance of current face recognition systems.
• Score: 8.695160236142456
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Evaluating the quality of facial images is essential for operating face recognition systems with sufficient accuracy. The recent advances in face quality standardisation (ISO/IEC CD3 29794-5) recommend the usage of component quality measures for breaking down face quality into its individual factors, hence providing valuable feedback for operators to re-capture low-quality images. In light of recent advances in 3D-aware generative adversarial networks, we propose a novel dataset, Syn-YawPitch, comprising 1000 identities with varying yaw-pitch angle combinations. Utilizing this dataset, we demonstrate that pitch angles beyond 30 degrees have a significant impact on the biometric performance of current face recognition systems. Furthermore, we propose a lightweight and explainable pose quality predictor that adheres to the draft international standard of ISO/IEC CD3 29794-5 and benchmark it against state-of-the-art face image quality assessment algorithms

Related papers

• Rank-based No-reference Quality Assessment for Face Swapping [88.53827937914038]
  The metric of measuring the quality in most face swapping methods relies on several distances between the manipulated images and the source image. We present a novel no-reference image quality assessment (NR-IQA) method specifically designed for face swapping.
  arXiv  Detail & Related papers  (2024-06-04T01:36:29Z)
• Dual-Branch Network for Portrait Image Quality Assessment [76.27716058987251]
  We introduce a dual-branch network for portrait image quality assessment (PIQA) We utilize two backbone networks (textiti.e., Swin Transformer-B) to extract the quality-aware features from the entire portrait image and the facial image cropped from it. We leverage LIQE, an image scene classification and quality assessment model, to capture the quality-aware and scene-specific features as the auxiliary features.
  arXiv  Detail & Related papers  (2024-05-14T12:43:43Z)
• NeutrEx: A 3D Quality Component Measure on Facial Expression Neutrality [7.736597471757526]
  We propose a quality measure based on the accumulated distances of a 3D face reconstruction to a neutral expression anchor. Our evaluations demonstrate the superiority of our proposed method compared to baseline approaches.
  arXiv  Detail & Related papers  (2023-08-19T09:38:39Z)
• Surveillance Face Anti-spoofing [81.50018853811895]
  Face Anti-spoofing (FAS) is essential to secure face recognition systems from various physical attacks. We propose a Contrastive Quality-Invariance Learning (CQIL) network to alleviate the performance degradation caused by image quality. A large number of experiments verify the quality of the SuHiFiMask dataset and the superiority of the proposed CQIL.
  arXiv  Detail & Related papers  (2023-01-03T07:09:57Z)
• Conformer and Blind Noisy Students for Improved Image Quality Assessment [80.57006406834466]
  Learning-based approaches for perceptual image quality assessment (IQA) usually require both the distorted and reference image for measuring the perceptual quality accurately. In this work, we explore the performance of transformer-based full-reference IQA models. We also propose a method for IQA based on semi-supervised knowledge distillation from full-reference teacher models into blind student models.
  arXiv  Detail & Related papers  (2022-04-27T10:21:08Z)
• FaceQvec: Vector Quality Assessment for Face Biometrics based on ISO Compliance [15.913755899679733]
  FaceQvec is a software component for estimating the conformity of facial images with each of the points contemplated in the ISO/IEC 19794-5. This quality standard defines general quality guidelines for face images that would make them acceptable or unacceptable for use in official documents such as passports or ID cards.
  arXiv  Detail & Related papers  (2021-11-03T09:07:41Z)
• A Deep Insight into Measuring Face Image Utility with General and Face-specific Image Quality Metrics [5.770286315818393]
  General image quality metrics can be used on the global image and relate to human perceptions. Our results reveal a clear correlation between learned image metrics to face image utility even without being specifically trained as a face utility measure.
  arXiv  Detail & Related papers  (2021-10-21T12:56:38Z)
• Identity-Aware CycleGAN for Face Photo-Sketch Synthesis and Recognition [61.87842307164351]
  We first propose an Identity-Aware CycleGAN (IACycleGAN) model that applies a new perceptual loss to supervise the image generation network. It improves CycleGAN on photo-sketch synthesis by paying more attention to the synthesis of key facial regions, such as eyes and nose. We develop a mutual optimization procedure between the synthesis model and the recognition model, which iteratively synthesizes better images by IACycleGAN.
  arXiv  Detail & Related papers  (2021-03-30T01:30:08Z)
• Inducing Predictive Uncertainty Estimation for Face Recognition [102.58180557181643]
  We propose a method for generating image quality training data automatically from'mated-pairs' of face images. We use the generated data to train a lightweight Predictive Confidence Network, termed as PCNet, for estimating the confidence score of a face image.
  arXiv  Detail & Related papers  (2020-09-01T17:52:00Z)
• SER-FIQ: Unsupervised Estimation of Face Image Quality Based on Stochastic Embedding Robustness [15.431761867166]
  We propose a novel concept to measure face quality based on an arbitrary face recognition model. We compare our proposed solution on two face embeddings against six state-of-the-art approaches from academia and industry.
  arXiv  Detail & Related papers  (2020-03-20T16:50:30Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.