Exploring Racial Bias within Face Recognition via per-subject Adversarially-Enabled Data Augmentation

• URL: http://arxiv.org/abs/2004.08945v1
• Date: Sun, 19 Apr 2020 19:46:32 GMT
• Title: Exploring Racial Bias within Face Recognition via per-subject Adversarially-Enabled Data Augmentation
• Authors: Seyma Yucer, Samet Ak\c{c}ay, Noura Al-Moubayed, Toby P. Breckon
• Abstract summary: We propose a novel adversarial derived data augmentation methodology that aims to enable dataset balance at a per-subject level. Our aim is to automatically construct a synthesised dataset by transforming facial images across varying racial domains. In a side-by-side comparison, we show the positive impact our proposed technique can have on the recognition performance for (racial) minority groups.
• Score: 15.924281804465252
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Whilst face recognition applications are becoming increasingly prevalent within our daily lives, leading approaches in the field still suffer from performance bias to the detriment of some racial profiles within society. In this study, we propose a novel adversarial derived data augmentation methodology that aims to enable dataset balance at a per-subject level via the use of image-to-image transformation for the transfer of sensitive racial characteristic facial features. Our aim is to automatically construct a synthesised dataset by transforming facial images across varying racial domains, while still preserving identity-related features, such that racially dependant features subsequently become irrelevant within the determination of subject identity. We construct our experiments on three significant face recognition variants: Softmax, CosFace and ArcFace loss over a common convolutional neural network backbone. In a side-by-side comparison, we show the positive impact our proposed technique can have on the recognition performance for (racial) minority groups within an originally imbalanced training dataset by reducing the pre-race variance in performance.

Related papers

• Toward Fairer Face Recognition Datasets [69.04239222633795]
  Face recognition and verification are computer vision tasks whose performance has progressed with the introduction of deep representations. Ethical, legal, and technical challenges due to the sensitive character of face data and biases in real training datasets hinder their development. We promote fairness by introducing a demographic attributes balancing mechanism in generated training datasets.
  arXiv  Detail & Related papers  (2024-06-24T12:33:21Z)
• Towards Inclusive Face Recognition Through Synthetic Ethnicity Alteration [11.451395489475647]
  We explore ethnicity alteration and skin tone modification using synthetic face image generation methods to increase the diversity of datasets. We conduct a detailed analysis by first constructing a balanced face image dataset representing three ethnicities: Asian, Black, and Indian. We then make use of existing Generative Adversarial Network-based (GAN) image-to-image translation and manifold learning models to alter the ethnicity from one to another.
  arXiv  Detail & Related papers  (2024-05-02T13:31:09Z)
• Racial Bias within Face Recognition: A Survey [15.924281804465252]
  We discuss the problem definition of racial bias, starting with race definition, grouping strategies, and the societal implications of using race or race-related groupings. We divide the common face recognition processing pipeline into four stages: image acquisition, face localisation, face representation, face verification and identification. The overall aim is to provide comprehensive coverage of the racial bias problem with respect to each and every stage of the face recognition processing pipeline.
  arXiv  Detail & Related papers  (2023-05-01T13:33:12Z)
• The Impact of Racial Distribution in Training Data on Face Recognition Bias: A Closer Look [0.0]
  We study the effect of racial distribution in the training data on the performance of face recognition models. We analyze these trained models using accuracy metrics, clustering metrics, UMAP projections, face quality, and decision thresholds.
  arXiv  Detail & Related papers  (2022-11-26T07:03:24Z)
• CIAO! A Contrastive Adaptation Mechanism for Non-Universal Facial Expression Recognition [80.07590100872548]
  We propose Contrastive Inhibitory Adaptati On (CIAO), a mechanism that adapts the last layer of facial encoders to depict specific affective characteristics on different datasets. CIAO presents an improvement in facial expression recognition performance over six different datasets with very unique affective representations.
  arXiv  Detail & Related papers  (2022-08-10T15:46:05Z)
• Towards Intrinsic Common Discriminative Features Learning for Face Forgery Detection using Adversarial Learning [59.548960057358435]
  We propose a novel method which utilizes adversarial learning to eliminate the negative effect of different forgery methods and facial identities. Our face forgery detection model learns to extract common discriminative features through eliminating the effect of forgery methods and facial identities.
  arXiv  Detail & Related papers  (2022-07-08T09:23:59Z)
• Meta Balanced Network for Fair Face Recognition [51.813457201437195]
  We systematically and scientifically study bias from both data and algorithm aspects. We propose a novel meta-learning algorithm, called Meta Balanced Network (MBN), which learns adaptive margins in large margin loss. Extensive experiments show that MBN successfully mitigates bias and learns more balanced performance for people with different skin tones in face recognition.
  arXiv  Detail & Related papers  (2022-05-13T10:25:44Z)
• Learning Fair Face Representation With Progressive Cross Transformer [79.73754444296213]
  We propose a progressive cross transformer (PCT) method for fair face recognition. We show that PCT is capable of mitigating bias in face recognition while achieving state-of-the-art FR performance.
  arXiv  Detail & Related papers  (2021-08-11T01:31:14Z)
• Enhancing Facial Data Diversity with Style-based Face Aging [59.984134070735934]
  In particular, face datasets are typically biased in terms of attributes such as gender, age, and race. We propose a novel, generative style-based architecture for data augmentation that captures fine-grained aging patterns. We show that the proposed method outperforms state-of-the-art algorithms for age transfer.
  arXiv  Detail & Related papers  (2020-06-06T21:53:44Z)
• Asymmetric Rejection Loss for Fairer Face Recognition [1.52292571922932]
  Research has shown differences in face recognition performance across different ethnic groups due to the racial imbalance in the training datasets. This is actually symptomatic of the under-representation of non-Caucasian ethnic groups in the celebdom from which face datasets are usually gathered. We propose an Asymmetric Rejection Loss, which aims at making full use of unlabeled images of those under-represented groups.
  arXiv  Detail & Related papers  (2020-02-09T04:01:03Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.