Face Quality Estimation and Its Correlation to Demographic and Non-Demographic Bias in Face Recognition

• URL: http://arxiv.org/abs/2004.01019v3
• Date: Fri, 10 Jul 2020 11:24:37 GMT
• Title: Face Quality Estimation and Its Correlation to Demographic and Non-Demographic Bias in Face Recognition
• Authors: Philipp Terh\"orst, Jan Niklas Kolf, Naser Damer, Florian Kirchbuchner, Arjan Kuijper
• Abstract summary: Face quality assessment aims at estimating the utility of a face image for the purpose of recognition. Currently, the high performance of these face recognition systems come with the cost of a strong bias against demographic and non-demographic sub-groups. Recent work has shown that face quality assessment algorithms should adapt to the deployed face recognition system, in order to achieve highly accurate and robust quality estimations.
• Score: 15.431761867166
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Face quality assessment aims at estimating the utility of a face image for the purpose of recognition. It is a key factor to achieve high face recognition performances. Currently, the high performance of these face recognition systems come with the cost of a strong bias against demographic and non-demographic sub-groups. Recent work has shown that face quality assessment algorithms should adapt to the deployed face recognition system, in order to achieve highly accurate and robust quality estimations. However, this could lead to a bias transfer towards the face quality assessment leading to discriminatory effects e.g. during enrolment. In this work, we present an in-depth analysis of the correlation between bias in face recognition and face quality assessment. Experiments were conducted on two publicly available datasets captured under controlled and uncontrolled circumstances with two popular face embeddings. We evaluated four state-of-the-art solutions for face quality assessment towards biases to pose, ethnicity, and age. The experiments showed that the face quality assessment solutions assign significantly lower quality values towards subgroups affected by the recognition bias demonstrating that these approaches are biased as well. This raises ethical questions towards fairness and discrimination which future works have to address.

Related papers

• Rank-based No-reference Quality Assessment for Face Swapping [88.53827937914038]
  The metric of measuring the quality in most face swapping methods relies on several distances between the manipulated images and the source image. We present a novel no-reference image quality assessment (NR-IQA) method specifically designed for face swapping.
  arXiv  Detail & Related papers  (2024-06-04T01:36:29Z)
• Recognizability Embedding Enhancement for Very Low-Resolution Face Recognition and Quality Estimation [21.423956631978186]
  We study principled approaches to elevate the recognizability of a face in the embedding space instead of the visual quality. We first formulate a robust learning-based face recognizability measure, namely recognizability index (RI) We then devise an index diversion loss to push the hard-to-recognize face embedding with low RI away from unrecognizable faces cluster to boost the RI, which reflects better recognizability.
  arXiv  Detail & Related papers  (2023-04-20T03:18:03Z)
• Assessing Bias in Face Image Quality Assessment [0.0]
  Face image quality assessment (FIQA) attempts to improve face recognition (FR) performance by providing additional information about sample quality. It is reasonable to assume that these methods are heavily influenced by the underlying face recognition system. Although modern face recognition systems are known to perform well, several studies have found that such systems often exhibit problems with demographic bias.
  arXiv  Detail & Related papers  (2022-11-28T12:41:59Z)
• IFQA: Interpretable Face Quality Assessment [23.34924105158927]
  This paper proposes a novel face-centric metric based on an adversarial framework where a generator simulates face restoration and a discriminator assesses image quality. Our metric consistently surpasses existing general or facial image quality assessment metrics by impressive margins.
  arXiv  Detail & Related papers  (2022-11-14T03:04:38Z)
• Comparing Human and Machine Bias in Face Recognition [46.170389064229354]
  We release improvements to the LFW and CelebA datasets which will enable future researchers to obtain measurements of algorithmic bias. We also use these new data to develop a series of challenging facial identification and verification questions. We find that both computer models and human survey participants perform significantly better at the verification task.
  arXiv  Detail & Related papers  (2021-10-15T22:26:20Z)
• Unravelling the Effect of Image Distortions for Biased Prediction of Pre-trained Face Recognition Models [86.79402670904338]
  We evaluate the performance of four state-of-the-art deep face recognition models in the presence of image distortions. We have observed that image distortions have a relationship with the performance gap of the model across different subgroups.
  arXiv  Detail & Related papers  (2021-08-14T16:49:05Z)
• Facial Expressions as a Vulnerability in Face Recognition [73.85525896663371]
  This work explores facial expression bias as a security vulnerability of face recognition systems. We present a comprehensive analysis of how facial expression bias impacts the performance of face recognition technologies.
  arXiv  Detail & Related papers  (2020-11-17T18:12:41Z)
• Face Image Quality Assessment: A Literature Survey [16.647739693192236]
  This survey provides an overview of the face image quality assessment literature, which predominantly focuses on visible wavelength face image input. A trend towards deep learning based methods is observed, including notable conceptual differences among the recent approaches.
  arXiv  Detail & Related papers  (2020-09-02T14:26:12Z)
• Inducing Predictive Uncertainty Estimation for Face Recognition [102.58180557181643]
  We propose a method for generating image quality training data automatically from'mated-pairs' of face images. We use the generated data to train a lightweight Predictive Confidence Network, termed as PCNet, for estimating the confidence score of a face image.
  arXiv  Detail & Related papers  (2020-09-01T17:52:00Z)
• SER-FIQ: Unsupervised Estimation of Face Image Quality Based on Stochastic Embedding Robustness [15.431761867166]
  We propose a novel concept to measure face quality based on an arbitrary face recognition model. We compare our proposed solution on two face embeddings against six state-of-the-art approaches from academia and industry.
  arXiv  Detail & Related papers  (2020-03-20T16:50:30Z)
• On the Robustness of Face Recognition Algorithms Against Attacks and Bias [78.68458616687634]
  Face recognition algorithms have demonstrated very high recognition performance, suggesting suitability for real world applications. Despite the enhanced accuracies, robustness of these algorithms against attacks and bias has been challenged. This paper summarizes different ways in which the robustness of a face recognition algorithm is challenged.
  arXiv  Detail & Related papers  (2020-02-07T18:21:59Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.