Exploring Causes of Demographic Variations In Face Recognition Accuracy

• URL: http://arxiv.org/abs/2304.07175v1
• Date: Fri, 14 Apr 2023 14:50:59 GMT
• Title: Exploring Causes of Demographic Variations In Face Recognition Accuracy
• Authors: Gabriella Pangelinan, K.S. Krishnapriya, Vitor Albiero, Grace Bezold, Kai Zhang, Kushal Vangara, Michael C. King, Kevin W. Bowyer
• Abstract summary: We consider accuracy differences as represented by variations in non-mated (impostor) and / or mated (genuine) distributions for 1-to-1 face matching. Possible causes explored include differences in skin tone, face size and shape, imbalance in number of identities and images in the training data, and amount of face visible in the test data.
• Score: 10.534382915377025
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In recent years, media reports have called out bias and racism in face recognition technology. We review experimental results exploring several speculated causes for asymmetric cross-demographic performance. We consider accuracy differences as represented by variations in non-mated (impostor) and / or mated (genuine) distributions for 1-to-1 face matching. Possible causes explored include differences in skin tone, face size and shape, imbalance in number of identities and images in the training data, and amount of face visible in the test data ("face pixels"). We find that demographic differences in face pixel information of the test images appear to most directly impact the resultant differences in face recognition accuracy.

Related papers

• Impact of Blur and Resolution on Demographic Disparities in 1-to-Many Facial Identification [6.818318933838661]
  This paper analyzes the accuracy of 1-to-many facial identification across demographic groups. We show that increased blur in the probe image, or reduced resolution of the face in the probe image, can significantly increase the false positive identification rate.
  arXiv  Detail & Related papers  (2023-09-08T17:13:22Z)
• Are Face Detection Models Biased? [69.68854430664399]
  We investigate possible bias in the domain of face detection through facial region localization. Most existing face detection datasets lack suitable annotation for such analysis. We observe a high disparity in detection accuracies across gender and skin-tone, and interplay of confounding factors beyond demography.
  arXiv  Detail & Related papers  (2022-11-07T14:27:55Z)
• Towards Intrinsic Common Discriminative Features Learning for Face Forgery Detection using Adversarial Learning [59.548960057358435]
  We propose a novel method which utilizes adversarial learning to eliminate the negative effect of different forgery methods and facial identities. Our face forgery detection model learns to extract common discriminative features through eliminating the effect of forgery methods and facial identities.
  arXiv  Detail & Related papers  (2022-07-08T09:23:59Z)
• Face Recognition Accuracy Across Demographics: Shining a Light Into the Problem [8.02620277513497]
  We explore varying face recognition accuracy across demographic groups as a phenomenon partly caused by differences in face illumination. We show that impostor image pairs with both faces under-exposed, or both overexposed, have an increased false match rate (FMR) We propose a brightness information metric to measure variation in brightness in the face and show that face brightness that is too low or too high has reduced information in the face region.
  arXiv  Detail & Related papers  (2022-06-04T02:36:35Z)
• Evaluation of Human and Machine Face Detection using a Novel Distinctive Human Appearance Dataset [0.76146285961466]
  We evaluate current state-of-the-art face-detection models in their ability to detect faces in images. The evaluation results show that face-detection algorithms do not generalize well to diverse appearances.
  arXiv  Detail & Related papers  (2021-11-01T02:20:40Z)
• SynFace: Face Recognition with Synthetic Data [83.15838126703719]
  We devise the SynFace with identity mixup (IM) and domain mixup (DM) to mitigate the performance gap. We also perform a systematically empirical analysis on synthetic face images to provide some insights on how to effectively utilize synthetic data for face recognition.
  arXiv  Detail & Related papers  (2021-08-18T03:41:54Z)
• Unravelling the Effect of Image Distortions for Biased Prediction of Pre-trained Face Recognition Models [86.79402670904338]
  We evaluate the performance of four state-of-the-art deep face recognition models in the presence of image distortions. We have observed that image distortions have a relationship with the performance gap of the model across different subgroups.
  arXiv  Detail & Related papers  (2021-08-14T16:49:05Z)
• Demographic Fairness in Face Identification: The Watchlist Imbalance Effect [18.151605318786437]
  "Watchlist imbalance effect" is referred to as "watchlist imbalance effect" It is shown that the database composition has a huge impact on performance differentials in biometric identification systems.
  arXiv  Detail & Related papers  (2021-06-15T11:09:06Z)
• Facial Manipulation Detection Based on the Color Distribution Analysis in Edge Region [0.5735035463793008]
  We present a generalized and robust facial manipulation detection method based on color distribution analysis of the vertical region of edge in a manipulated image. Our extensive experiments show that our method outperforms other existing face manipulation detection methods on detecting synthesized face image in various datasets regardless of whether it has participated in training.
  arXiv  Detail & Related papers  (2021-02-02T08:19:35Z)
• Facial Expressions as a Vulnerability in Face Recognition [73.85525896663371]
  This work explores facial expression bias as a security vulnerability of face recognition systems. We present a comprehensive analysis of how facial expression bias impacts the performance of face recognition technologies.
  arXiv  Detail & Related papers  (2020-11-17T18:12:41Z)
• Investigating the Impact of Inclusion in Face Recognition Training Data on Individual Face Identification [93.5538147928669]
  We audit ArcFace, a state-of-the-art, open source face recognition system, in a large-scale face identification experiment with more than one million distractor images. We find a Rank-1 face identification accuracy of 79.71% for individuals present in the model's training data and an accuracy of 75.73% for those not present.
  arXiv  Detail & Related papers  (2020-01-09T15:50:28Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.