Face Recognition Accuracy Across Demographics: Shining a Light Into the Problem

• URL: http://arxiv.org/abs/2206.01881v2
• Date: Sun, 16 Apr 2023 14:43:00 GMT
• Title: Face Recognition Accuracy Across Demographics: Shining a Light Into the Problem
• Authors: Haiyu Wu, V\'itor Albiero, K. S. Krishnapriya, Michael C. King, Kevin W. Bowyer
• Abstract summary: We explore varying face recognition accuracy across demographic groups as a phenomenon partly caused by differences in face illumination. We show that impostor image pairs with both faces under-exposed, or both overexposed, have an increased false match rate (FMR) We propose a brightness information metric to measure variation in brightness in the face and show that face brightness that is too low or too high has reduced information in the face region.
• Score: 8.02620277513497
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We explore varying face recognition accuracy across demographic groups as a phenomenon partly caused by differences in face illumination. We observe that for a common operational scenario with controlled image acquisition, there is a large difference in face region brightness between African-American and Caucasian, and also a smaller difference between male and female. We show that impostor image pairs with both faces under-exposed, or both overexposed, have an increased false match rate (FMR). Conversely, image pairs with strongly different face brightness have a decreased similarity measure. We propose a brightness information metric to measure variation in brightness in the face and show that face brightness that is too low or too high has reduced information in the face region, providing a cause for the lower accuracy. Based on this, for operational scenarios with controlled image acquisition, illumination should be adjusted for each individual to obtain appropriate face image brightness. This is the first work that we are aware of to explore how the level of brightness of the skin region in a pair of face images (rather than a single image) impacts face recognition accuracy, and to evaluate this as a systematic factor causing unequal accuracy across demographics. The code is at https://github.com/HaiyuWu/FaceBrightness.

Related papers

• Self-Supervised Facial Representation Learning with Facial Region Awareness [13.06996608324306]
  Self-supervised pre-training has been proven to be effective in learning transferable representations that benefit various visual tasks. Recent efforts toward this goal are limited to treating each face image as a whole. We propose a novel self-supervised facial representation learning framework to learn consistent global and local facial representations.
  arXiv  Detail & Related papers  (2024-03-04T15:48:56Z)
• Human-Machine Comparison for Cross-Race Face Verification: Race Bias at the Upper Limits of Performance? [0.7036032466145111]
  Face recognition algorithms perform more accurately than humans in some cases, though humans and machines both show race-based accuracy differences. We constructed a challenging test of 'cross-race' face verification and used it to compare humans and two state-of-the-art face recognition systems. We conclude that state-of-the-art systems for identity verification between two frontal face images of Black and White individuals can surpass the general population.
  arXiv  Detail & Related papers  (2023-05-25T19:41:13Z)
• Exploring Causes of Demographic Variations In Face Recognition Accuracy [10.534382915377025]
  We consider accuracy differences as represented by variations in non-mated (impostor) and / or mated (genuine) distributions for 1-to-1 face matching. Possible causes explored include differences in skin tone, face size and shape, imbalance in number of identities and images in the training data, and amount of face visible in the test data.
  arXiv  Detail & Related papers  (2023-04-14T14:50:59Z)
• Towards Racially Unbiased Skin Tone Estimation via Scene Disambiguation [48.632358823108326]
  Virtual facial avatars will play an increasingly important role in immersive communication, games and the metaverse. Virtual facial avatars will play an increasingly important role in immersive communication, games and the metaverse. This requires accurate recovery of the appearance, represented by albedo, regardless of age, sex, or ethnicity.
  arXiv  Detail & Related papers  (2022-05-08T22:01:30Z)
• AdaFace: Quality Adaptive Margin for Face Recognition [56.99208144386127]
  We introduce another aspect of adaptiveness in the loss function, namely the image quality. We propose a new loss function that emphasizes samples of different difficulties based on their image quality. Our method, AdaFace, improves the face recognition performance over the state-of-the-art (SoTA) on four datasets.
  arXiv  Detail & Related papers  (2022-04-03T01:23:41Z)
• I Only Have Eyes for You: The Impact of Masks On Convolutional-Based Facial Expression Recognition [78.07239208222599]
  We evaluate how the recently proposed FaceChannel adapts towards recognizing facial expressions from persons with masks. We also perform specific feature-level visualization to demonstrate how the inherent capabilities of the FaceChannel to learn and combine facial features change when in a constrained social interaction scenario.
  arXiv  Detail & Related papers  (2021-04-16T20:03:30Z)
• Facial Manipulation Detection Based on the Color Distribution Analysis in Edge Region [0.5735035463793008]
  We present a generalized and robust facial manipulation detection method based on color distribution analysis of the vertical region of edge in a manipulated image. Our extensive experiments show that our method outperforms other existing face manipulation detection methods on detecting synthesized face image in various datasets regardless of whether it has participated in training.
  arXiv  Detail & Related papers  (2021-02-02T08:19:35Z)
• Facial Expressions as a Vulnerability in Face Recognition [73.85525896663371]
  This work explores facial expression bias as a security vulnerability of face recognition systems. We present a comprehensive analysis of how facial expression bias impacts the performance of face recognition technologies.
  arXiv  Detail & Related papers  (2020-11-17T18:12:41Z)
• Age Gap Reducer-GAN for Recognizing Age-Separated Faces [72.26969872180841]
  We propose a novel algorithm for matching faces with temporal variations caused due to age progression. The proposed generative adversarial network algorithm is a unified framework that combines facial age estimation and age-separated face verification.
  arXiv  Detail & Related papers  (2020-11-11T16:43:32Z)
• Dual-Attention GAN for Large-Pose Face Frontalization [59.689836951934694]
  We present a novel Dual-Attention Generative Adversarial Network (DA-GAN) for photo-realistic face frontalization. Specifically, a self-attention-based generator is introduced to integrate local features with their long-range dependencies. A novel face-attention-based discriminator is applied to emphasize local features of face regions.
  arXiv  Detail & Related papers  (2020-02-17T20:00:56Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.