Explaining Bias in Deep Face Recognition via Image Characteristics

• URL: http://arxiv.org/abs/2208.11099v1
• Date: Tue, 23 Aug 2022 17:18:23 GMT
• Title: Explaining Bias in Deep Face Recognition via Image Characteristics
• Authors: Andrea Atzori, Gianni Fenu, Mirko Marras
• Abstract summary: We evaluate ten state-of-the-art face recognition models, comparing their fairness in terms of security and usability on two data sets. We then analyze the impact of image characteristics on models performance.
• Score: 9.569575076277523
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In this paper, we propose a novel explanatory framework aimed to provide a better understanding of how face recognition models perform as the underlying data characteristics (protected attributes: gender, ethnicity, age; non-protected attributes: facial hair, makeup, accessories, face orientation and occlusion, image distortion, emotions) on which they are tested change. With our framework, we evaluate ten state-of-the-art face recognition models, comparing their fairness in terms of security and usability on two data sets, involving six groups based on gender and ethnicity. We then analyze the impact of image characteristics on models performance. Our results show that trends appearing in a single-attribute analysis disappear or reverse when multi-attribute groups are considered, and that performance disparities are also related to non-protected attributes. Source code: https://cutt.ly/2XwRLiA.

Related papers

• Bias and Diversity in Synthetic-based Face Recognition [12.408456748469426]
  We investigate how the diversity of synthetic face recognition datasets compares to authentic datasets. We look at the distribution of gender, ethnicity, age, and head position. With regard to bias, it can be seen that the synthetic-based models share a similar bias behavior with the authentic-based models.
  arXiv  Detail & Related papers  (2023-11-07T13:12:34Z)
• Improving Fairness using Vision-Language Driven Image Augmentation [60.428157003498995]
  Fairness is crucial when training a deep-learning discriminative model, especially in the facial domain. Models tend to correlate specific characteristics (such as age and skin color) with unrelated attributes (downstream tasks) This paper proposes a method to mitigate these correlations to improve fairness.
  arXiv  Detail & Related papers  (2023-11-02T19:51:10Z)
• FACET: Fairness in Computer Vision Evaluation Benchmark [21.862644380063756]
  Computer vision models have known performance disparities across attributes such as gender and skin tone. We present a new benchmark named FACET (FAirness in Computer Vision EvaluaTion) FACET is a large, publicly available evaluation set of 32k images for some of the most common vision tasks.
  arXiv  Detail & Related papers  (2023-08-31T17:59:48Z)
• CIAO! A Contrastive Adaptation Mechanism for Non-Universal Facial Expression Recognition [80.07590100872548]
  We propose Contrastive Inhibitory Adaptati On (CIAO), a mechanism that adapts the last layer of facial encoders to depict specific affective characteristics on different datasets. CIAO presents an improvement in facial expression recognition performance over six different datasets with very unique affective representations.
  arXiv  Detail & Related papers  (2022-08-10T15:46:05Z)
• TransFA: Transformer-based Representation for Face Attribute Evaluation [87.09529826340304]
  We propose a novel textbftransformer-based representation for textbfattribute evaluation method (textbfTransFA) The proposed TransFA achieves superior performances compared with state-of-the-art methods.
  arXiv  Detail & Related papers  (2022-07-12T10:58:06Z)
• Are Commercial Face Detection Models as Biased as Academic Models? [64.71318433419636]
  We compare academic and commercial face detection systems, specifically examining robustness to noise. We find that state-of-the-art academic face detection models exhibit demographic disparities in their noise robustness. We conclude that commercial models are always as biased or more biased than an academic model.
  arXiv  Detail & Related papers  (2022-01-25T02:21:42Z)
• Measuring Hidden Bias within Face Recognition via Racial Phenotypes [21.74534280021516]
  This study introduces an alternative racial bias analysis methodology via facial phenotype attributes for face recognition. We propose categorical test cases to investigate the individual influence of those attributes on bias within face recognition tasks.
  arXiv  Detail & Related papers  (2021-10-19T10:46:59Z)
• SynFace: Face Recognition with Synthetic Data [83.15838126703719]
  We devise the SynFace with identity mixup (IM) and domain mixup (DM) to mitigate the performance gap. We also perform a systematically empirical analysis on synthetic face images to provide some insights on how to effectively utilize synthetic data for face recognition.
  arXiv  Detail & Related papers  (2021-08-18T03:41:54Z)
• Unravelling the Effect of Image Distortions for Biased Prediction of Pre-trained Face Recognition Models [86.79402670904338]
  We evaluate the performance of four state-of-the-art deep face recognition models in the presence of image distortions. We have observed that image distortions have a relationship with the performance gap of the model across different subgroups.
  arXiv  Detail & Related papers  (2021-08-14T16:49:05Z)
• Faces in the Wild: Efficient Gender Recognition in Surveillance Conditions [0.0]
  We present frontal and wild face versions of three well-known surveillance datasets. We propose a model that effectively and dynamically combines facial and body information, which makes it suitable for gender recognition in wild conditions. Our model combines facial and body information through a learnable fusion matrix and a channel-attention sub-network, focusing on the most influential body parts according to the specific image/subject features.
  arXiv  Detail & Related papers  (2021-07-14T17:02:23Z)
• Face Age Progression With Attribute Manipulation [11.859913430860335]
  We propose a novel holistic model in this regard viz., Face Age progression With Attribute Manipulation (FAWAM)" We address the task in a bottom-up manner, as two submodules i.e. face age progression and face attribute manipulation. For face aging, we use an attribute-conscious face aging model with a pyramidal generative adversarial network that can model age-specific facial changes.
  arXiv  Detail & Related papers  (2021-06-14T18:26:48Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.