Racial Bias within Face Recognition: A Survey

• URL: http://arxiv.org/abs/2305.00817v1
• Date: Mon, 1 May 2023 13:33:12 GMT
• Title: Racial Bias within Face Recognition: A Survey
• Authors: Seyma Yucer, Furkan Tektas, Noura Al Moubayed, Toby P. Breckon
• Abstract summary: We discuss the problem definition of racial bias, starting with race definition, grouping strategies, and the societal implications of using race or race-related groupings. We divide the common face recognition processing pipeline into four stages: image acquisition, face localisation, face representation, face verification and identification. The overall aim is to provide comprehensive coverage of the racial bias problem with respect to each and every stage of the face recognition processing pipeline.
• Score: 15.924281804465252
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Facial recognition is one of the most academically studied and industrially developed areas within computer vision where we readily find associated applications deployed globally. This widespread adoption has uncovered significant performance variation across subjects of different racial profiles leading to focused research attention on racial bias within face recognition spanning both current causation and future potential solutions. In support, this study provides an extensive taxonomic review of research on racial bias within face recognition exploring every aspect and stage of the face recognition processing pipeline. Firstly, we discuss the problem definition of racial bias, starting with race definition, grouping strategies, and the societal implications of using race or race-related groupings. Secondly, we divide the common face recognition processing pipeline into four stages: image acquisition, face localisation, face representation, face verification and identification, and review the relevant corresponding literature associated with each stage. The overall aim is to provide comprehensive coverage of the racial bias problem with respect to each and every stage of the face recognition processing pipeline whilst also highlighting the potential pitfalls and limitations of contemporary mitigation strategies that need to be considered within future research endeavours or commercial applications alike.

Related papers

• Towards Fair Face Verification: An In-depth Analysis of Demographic Biases [11.191375513738361]
  Deep learning-based person identification and verification systems have remarkably improved in terms of accuracy in recent years. However, such systems have been found to exhibit significant biases related to race, age, and gender. This paper presents an in-depth analysis, with a particular emphasis on the intersectionality of these demographic factors.
  arXiv  Detail & Related papers  (2023-07-19T14:49:14Z)
• Human-Machine Comparison for Cross-Race Face Verification: Race Bias at the Upper Limits of Performance? [0.7036032466145111]
  Face recognition algorithms perform more accurately than humans in some cases, though humans and machines both show race-based accuracy differences. We constructed a challenging test of 'cross-race' face verification and used it to compare humans and two state-of-the-art face recognition systems. We conclude that state-of-the-art systems for identity verification between two frontal face images of Black and White individuals can surpass the general population.
  arXiv  Detail & Related papers  (2023-05-25T19:41:13Z)
• Robustness Disparities in Face Detection [64.71318433419636]
  We present the first of its kind detailed benchmark of face detection systems, specifically examining the robustness to noise of commercial and academic models. Across all the datasets and systems, we generally find that photos of individuals who are $textitmasculine presenting$, of $textitolder$, of $textitdarker skin type$, or have $textitdim lighting$ are more susceptible to errors than their counterparts in other identities.
  arXiv  Detail & Related papers  (2022-11-29T05:22:47Z)
• The Impact of Racial Distribution in Training Data on Face Recognition Bias: A Closer Look [0.0]
  We study the effect of racial distribution in the training data on the performance of face recognition models. We analyze these trained models using accuracy metrics, clustering metrics, UMAP projections, face quality, and decision thresholds.
  arXiv  Detail & Related papers  (2022-11-26T07:03:24Z)
• Anatomizing Bias in Facial Analysis [86.79402670904338]
  Existing facial analysis systems have been shown to yield biased results against certain demographic subgroups. It has become imperative to ensure that these systems do not discriminate based on gender, identity, or skin tone of individuals. This has led to research in the identification and mitigation of bias in AI systems.
  arXiv  Detail & Related papers  (2021-12-13T09:51:13Z)
• Measuring Hidden Bias within Face Recognition via Racial Phenotypes [21.74534280021516]
  This study introduces an alternative racial bias analysis methodology via facial phenotype attributes for face recognition. We propose categorical test cases to investigate the individual influence of those attributes on bias within face recognition tasks.
  arXiv  Detail & Related papers  (2021-10-19T10:46:59Z)
• Learning Fair Face Representation With Progressive Cross Transformer [79.73754444296213]
  We propose a progressive cross transformer (PCT) method for fair face recognition. We show that PCT is capable of mitigating bias in face recognition while achieving state-of-the-art FR performance.
  arXiv  Detail & Related papers  (2021-08-11T01:31:14Z)
• Facial Expressions as a Vulnerability in Face Recognition [73.85525896663371]
  This work explores facial expression bias as a security vulnerability of face recognition systems. We present a comprehensive analysis of how facial expression bias impacts the performance of face recognition technologies.
  arXiv  Detail & Related papers  (2020-11-17T18:12:41Z)
• Mitigating Face Recognition Bias via Group Adaptive Classifier [53.15616844833305]
  This work aims to learn a fair face representation, where faces of every group could be more equally represented. Our work is able to mitigate face recognition bias across demographic groups while maintaining the competitive accuracy.
  arXiv  Detail & Related papers  (2020-06-13T06:43:37Z)
• Exploring Racial Bias within Face Recognition via per-subject Adversarially-Enabled Data Augmentation [15.924281804465252]
  We propose a novel adversarial derived data augmentation methodology that aims to enable dataset balance at a per-subject level. Our aim is to automatically construct a synthesised dataset by transforming facial images across varying racial domains. In a side-by-side comparison, we show the positive impact our proposed technique can have on the recognition performance for (racial) minority groups.
  arXiv  Detail & Related papers  (2020-04-19T19:46:32Z)
• On the Robustness of Face Recognition Algorithms Against Attacks and Bias [78.68458616687634]
  Face recognition algorithms have demonstrated very high recognition performance, suggesting suitability for real world applications. Despite the enhanced accuracies, robustness of these algorithms against attacks and bias has been challenged. This paper summarizes different ways in which the robustness of a face recognition algorithm is challenged.
  arXiv  Detail & Related papers  (2020-02-07T18:21:59Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.