A Deep Insight into Measuring Face Image Utility with General and Face-specific Image Quality Metrics

• URL: http://arxiv.org/abs/2110.11111v2
• Date: Fri, 22 Oct 2021 12:01:38 GMT
• Title: A Deep Insight into Measuring Face Image Utility with General and Face-specific Image Quality Metrics
• Authors: Biying Fu, Cong Chen, Olaf Henniger, and Naser Damer
• Abstract summary: General image quality metrics can be used on the global image and relate to human perceptions. Our results reveal a clear correlation between learned image metrics to face image utility even without being specifically trained as a face utility measure.
• Score: 5.770286315818393
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Quality scores provide a measure to evaluate the utility of biometric samples for biometric recognition. Biometric recognition systems require high-quality samples to achieve optimal performance. This paper focuses on face images and the measurement of face image utility with general and face-specific image quality metrics. While face-specific metrics rely on features of aligned face images, general image quality metrics can be used on the global image and relate to human perceptions. In this paper, we analyze the gap between the general image quality metrics and the face image quality metrics. Our contribution lies in a thorough examination of how different the image quality assessment algorithms relate to the utility for the face recognition task. The results of image quality assessment algorithms are further compared with those of dedicated face image quality assessment algorithms. In total, 25 different quality metrics are evaluated on three face image databases, BioSecure, LFW, and VGGFace2 using three open-source face recognition solutions, SphereFace, ArcFace, and FaceNet. Our results reveal a clear correlation between learned image metrics to face image utility even without being specifically trained as a face utility measure. Individual handcrafted features lack general stability and perform significantly worse than general face-specific quality metrics. We additionally provide a visual insight into the image areas contributing to the quality score of a selected set of quality assessment methods.

Related papers

• Rank-based No-reference Quality Assessment for Face Swapping [88.53827937914038]
  The metric of measuring the quality in most face swapping methods relies on several distances between the manipulated images and the source image. We present a novel no-reference image quality assessment (NR-IQA) method specifically designed for face swapping.
  arXiv  Detail & Related papers  (2024-06-04T01:36:29Z)
• AdaFace: Quality Adaptive Margin for Face Recognition [56.99208144386127]
  We introduce another aspect of adaptiveness in the loss function, namely the image quality. We propose a new loss function that emphasizes samples of different difficulties based on their image quality. Our method, AdaFace, improves the face recognition performance over the state-of-the-art (SoTA) on four datasets.
  arXiv  Detail & Related papers  (2022-04-03T01:23:41Z)
• Pixel-Level Face Image Quality Assessment for Explainable Face Recognition [5.858033242850427]
  We introduce the concept of pixel-level face image quality that determines the utility of pixels in a face image for recognition. Given an arbitrary face recognition network, in this work, we propose a training-free approach to assess the pixel-level qualities of a face image.
  arXiv  Detail & Related papers  (2021-10-21T09:12:17Z)
• Network Architecture Search for Face Enhancement [82.25775020564654]
  We present a multi-task face restoration network, called Network Architecture Search for Face Enhancement (NASFE) NASFE can enhance poor quality face images containing a single degradation (i.e. noise or blur) or multiple degradations (noise+blur+low-light)
  arXiv  Detail & Related papers  (2021-05-13T19:46:05Z)
• Facial Expressions as a Vulnerability in Face Recognition [73.85525896663371]
  This work explores facial expression bias as a security vulnerability of face recognition systems. We present a comprehensive analysis of how facial expression bias impacts the performance of face recognition technologies.
  arXiv  Detail & Related papers  (2020-11-17T18:12:41Z)
• The Elements of End-to-end Deep Face Recognition: A Survey of Recent Advances [56.432660252331495]
  Face recognition is one of the most popular and long-standing topics in computer vision. Deep face recognition has made remarkable progress and been widely used in many real-world applications. In this survey article, we present a comprehensive review about the recent advance of each element.
  arXiv  Detail & Related papers  (2020-09-28T13:02:17Z)
• Face Image Quality Assessment: A Literature Survey [16.647739693192236]
  This survey provides an overview of the face image quality assessment literature, which predominantly focuses on visible wavelength face image input. A trend towards deep learning based methods is observed, including notable conceptual differences among the recent approaches.
  arXiv  Detail & Related papers  (2020-09-02T14:26:12Z)
• Inducing Predictive Uncertainty Estimation for Face Recognition [102.58180557181643]
  We propose a method for generating image quality training data automatically from'mated-pairs' of face images. We use the generated data to train a lightweight Predictive Confidence Network, termed as PCNet, for estimating the confidence score of a face image.
  arXiv  Detail & Related papers  (2020-09-01T17:52:00Z)
• Biometric Quality: Review and Application to Face Recognition with FaceQnet [16.791628175513637]
  Quality is the number one factor responsible for the good or bad performance of automated biometric systems. Some of the most used and deployed biometric characteristics are lacking behind in the development of these methods. FaceQnet is a novel open-source face quality assessment tool, inspired and powered by deep learning technology.
  arXiv  Detail & Related papers  (2020-06-05T08:33:22Z)
• SER-FIQ: Unsupervised Estimation of Face Image Quality Based on Stochastic Embedding Robustness [15.431761867166]
  We propose a novel concept to measure face quality based on an arbitrary face recognition model. We compare our proposed solution on two face embeddings against six state-of-the-art approaches from academia and industry.
  arXiv  Detail & Related papers  (2020-03-20T16:50:30Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.