FaceQgen: Semi-Supervised Deep Learning for Face Image Quality Assessment

• URL: http://arxiv.org/abs/2201.00770v1
• Date: Mon, 3 Jan 2022 17:22:38 GMT
• Title: FaceQgen: Semi-Supervised Deep Learning for Face Image Quality Assessment
• Authors: Javier Hernandez-Ortega, Julian Fierrez, Ignacio Serna, Aythami Morales
• Abstract summary: FaceQgen is a No-Reference Quality Assessment approach for face images. It generates a scalar quality measure related with the face recognition accuracy. It is trained from scratch using the SCface database.
• Score: 19.928262020265965
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In this paper we develop FaceQgen, a No-Reference Quality Assessment approach for face images based on a Generative Adversarial Network that generates a scalar quality measure related with the face recognition accuracy. FaceQgen does not require labelled quality measures for training. It is trained from scratch using the SCface database. FaceQgen applies image restoration to a face image of unknown quality, transforming it into a canonical high quality image, i.e., frontal pose, homogeneous background, etc. The quality estimation is built as the similarity between the original and the restored images, since low quality images experience bigger changes due to restoration. We compare three different numerical quality measures: a) the MSE between the original and the restored images, b) their SSIM, and c) the output score of the Discriminator of the GAN. The results demonstrate that FaceQgen's quality measures are good estimators of face recognition accuracy. Our experiments include a comparison with other quality assessment methods designed for faces and for general images, in order to position FaceQgen in the state of the art. This comparison shows that, even though FaceQgen does not surpass the best existing face quality assessment methods in terms of face recognition accuracy prediction, it achieves good enough results to demonstrate the potential of semi-supervised learning approaches for quality estimation (in particular, data-driven learning based on a single high quality image per subject), having the capacity to improve its performance in the future with adequate refinement of the model and the significant advantage over competing methods of not needing quality labels for its development. This makes FaceQgen flexible and scalable without expensive data curation.

Related papers

• Rank-based No-reference Quality Assessment for Face Swapping [88.53827937914038]
  The metric of measuring the quality in most face swapping methods relies on several distances between the manipulated images and the source image. We present a novel no-reference image quality assessment (NR-IQA) method specifically designed for face swapping.
  arXiv  Detail & Related papers  (2024-06-04T01:36:29Z)
• Dual-Branch Network for Portrait Image Quality Assessment [76.27716058987251]
  We introduce a dual-branch network for portrait image quality assessment (PIQA) We utilize two backbone networks (textiti.e., Swin Transformer-B) to extract the quality-aware features from the entire portrait image and the facial image cropped from it. We leverage LIQE, an image scene classification and quality assessment model, to capture the quality-aware and scene-specific features as the auxiliary features.
  arXiv  Detail & Related papers  (2024-05-14T12:43:43Z)
• FaceQAN: Face Image Quality Assessment Through Adversarial Noise Exploration [1.217503190366097]
  We propose a novel approach to face image quality assessment, called FaceQAN, that is based on adversarial examples. As such, the proposed approach is the first to link image quality to adversarial attacks. Experimental results show that FaceQAN achieves competitive results, while exhibiting several desirable characteristics.
  arXiv  Detail & Related papers  (2022-12-05T09:37:32Z)
• Conformer and Blind Noisy Students for Improved Image Quality Assessment [80.57006406834466]
  Learning-based approaches for perceptual image quality assessment (IQA) usually require both the distorted and reference image for measuring the perceptual quality accurately. In this work, we explore the performance of transformer-based full-reference IQA models. We also propose a method for IQA based on semi-supervised knowledge distillation from full-reference teacher models into blind student models.
  arXiv  Detail & Related papers  (2022-04-27T10:21:08Z)
• AdaFace: Quality Adaptive Margin for Face Recognition [56.99208144386127]
  We introduce another aspect of adaptiveness in the loss function, namely the image quality. We propose a new loss function that emphasizes samples of different difficulties based on their image quality. Our method, AdaFace, improves the face recognition performance over the state-of-the-art (SoTA) on four datasets.
  arXiv  Detail & Related papers  (2022-04-03T01:23:41Z)
• CR-FIQA: Face Image Quality Assessment by Learning Sample Relative Classifiability [2.3624125155742055]
  We propose a novel learning paradigm that learns internal network observations during the training process. Our proposed CR-FIQA uses this paradigm to estimate the face image quality of a sample by predicting its relative classifiability. We demonstrate the superiority of our proposed CR-FIQA over state-of-the-art (SOTA) FIQA algorithms.
  arXiv  Detail & Related papers  (2021-12-13T12:18:43Z)
• QMagFace: Simple and Accurate Quality-Aware Face Recognition [5.5284501467256515]
  We propose a simple and effective face recognition solution (QMag-Face) that combines a quality-aware comparison score with a recognition model based on a magnitude-aware angular margin loss. The experiments conducted on several face recognition databases and benchmarks demonstrate that the introduced quality-awareness leads to consistent improvements in the recognition performance.
  arXiv  Detail & Related papers  (2021-11-26T12:44:54Z)
• FaceQvec: Vector Quality Assessment for Face Biometrics based on ISO Compliance [15.913755899679733]
  FaceQvec is a software component for estimating the conformity of facial images with each of the points contemplated in the ISO/IEC 19794-5. This quality standard defines general quality guidelines for face images that would make them acceptable or unacceptable for use in official documents such as passports or ID cards.
  arXiv  Detail & Related papers  (2021-11-03T09:07:41Z)
• Inducing Predictive Uncertainty Estimation for Face Recognition [102.58180557181643]
  We propose a method for generating image quality training data automatically from'mated-pairs' of face images. We use the generated data to train a lightweight Predictive Confidence Network, termed as PCNet, for estimating the confidence score of a face image.
  arXiv  Detail & Related papers  (2020-09-01T17:52:00Z)
• Uncertainty-Aware Blind Image Quality Assessment in the Laboratory and Wild [98.48284827503409]
  We develop a textitunified BIQA model and an approach of training it for both synthetic and realistic distortions. We employ the fidelity loss to optimize a deep neural network for BIQA over a large number of such image pairs. Experiments on six IQA databases show the promise of the learned method in blindly assessing image quality in the laboratory and wild.
  arXiv  Detail & Related papers  (2020-05-28T13:35:23Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.