Meta Balanced Network for Fair Face Recognition

• URL: http://arxiv.org/abs/2205.06548v1
• Date: Fri, 13 May 2022 10:25:44 GMT
• Title: Meta Balanced Network for Fair Face Recognition
• Authors: Mei Wang, Yaobin Zhang, Weihong Deng
• Abstract summary: We systematically and scientifically study bias from both data and algorithm aspects. We propose a novel meta-learning algorithm, called Meta Balanced Network (MBN), which learns adaptive margins in large margin loss. Extensive experiments show that MBN successfully mitigates bias and learns more balanced performance for people with different skin tones in face recognition.
• Score: 51.813457201437195
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Although deep face recognition has achieved impressive progress in recent years, controversy has arisen regarding discrimination based on skin tone, questioning their deployment into real-world scenarios. In this paper, we aim to systematically and scientifically study this bias from both data and algorithm aspects. First, using the dermatologist approved Fitzpatrick Skin Type classification system and Individual Typology Angle, we contribute a benchmark called Identity Shades (IDS) database, which effectively quantifies the degree of the bias with respect to skin tone in existing face recognition algorithms and commercial APIs. Further, we provide two skin-tone aware training datasets, called BUPT-Globalface dataset and BUPT-Balancedface dataset, to remove bias in training data. Finally, to mitigate the algorithmic bias, we propose a novel meta-learning algorithm, called Meta Balanced Network (MBN), which learns adaptive margins in large margin loss such that the model optimized by this loss can perform fairly across people with different skin tones. To determine the margins, our method optimizes a meta skewness loss on a clean and unbiased meta set and utilizes backward-on-backward automatic differentiation to perform a second order gradient descent step on the current margins. Extensive experiments show that MBN successfully mitigates bias and learns more balanced performance for people with different skin tones in face recognition. The proposed datasets are available at http://www.whdeng.cn/RFW/index.html.

Related papers

• FineFACE: Fair Facial Attribute Classification Leveraging Fine-grained Features [3.9440964696313485]
  Research highlights the presence of demographic bias in automated facial attribute classification algorithms. Existing bias mitigation techniques typically require demographic annotations and often obtain a trade-off between fairness and accuracy. This paper proposes a novel approach to fair facial attribute classification by framing it as a fine-grained classification problem.
  arXiv  Detail & Related papers  (2024-08-29T20:08:22Z)
• Marginal Debiased Network for Fair Visual Recognition [59.05212866862219]
  We propose a novel marginal debiased network (MDN) to learn debiased representations. Our MDN can achieve a remarkable performance on under-represented samples.
  arXiv  Detail & Related papers  (2024-01-04T08:57:09Z)
• Adaptive Face Recognition Using Adversarial Information Network [57.29464116557734]
  Face recognition models often degenerate when training data are different from testing data. We propose a novel adversarial information network (AIN) to address it.
  arXiv  Detail & Related papers  (2023-05-23T02:14:11Z)
• Rethinking Bias Mitigation: Fairer Architectures Make for Fairer Face Recognition [107.58227666024791]
  Face recognition systems are widely deployed in safety-critical applications, including law enforcement. They exhibit bias across a range of socio-demographic dimensions, such as gender and race. Previous works on bias mitigation largely focused on pre-processing the training data.
  arXiv  Detail & Related papers  (2022-10-18T15:46:05Z)
• BoundaryFace: A mining framework with noise label self-correction for Face Recognition [9.383955886871743]
  We propose a novel mining framework that focuses on the relationship between a sample's ground truth class center and its nearest negative class center. The proposed method consistently outperforms SOTA methods in various face recognition benchmarks.
  arXiv  Detail & Related papers  (2022-10-10T11:12:24Z)
• Balancing Biases and Preserving Privacy on Balanced Faces in the Wild [50.915684171879036]
  There are demographic biases present in current facial recognition (FR) models. We introduce our Balanced Faces in the Wild dataset to measure these biases across different ethnic and gender subgroups. We find that relying on a single score threshold to differentiate between genuine and imposters sample pairs leads to suboptimal results. We propose a novel domain adaptation learning scheme that uses facial features extracted from state-of-the-art neural networks.
  arXiv  Detail & Related papers  (2021-03-16T15:05:49Z)
• 3D Dense Geometry-Guided Facial Expression Synthesis by Adversarial Learning [54.24887282693925]
  We propose a novel framework to exploit 3D dense (depth and surface normals) information for expression manipulation. We use an off-the-shelf state-of-the-art 3D reconstruction model to estimate the depth and create a large-scale RGB-Depth dataset. Our experiments demonstrate that the proposed method outperforms the competitive baseline and existing arts by a large margin.
  arXiv  Detail & Related papers  (2020-09-30T17:12:35Z)
• SensitiveLoss: Improving Accuracy and Fairness of Face Representations with Discrimination-Aware Deep Learning [17.088716485755917]
  We propose a discrimination-aware learning method to improve accuracy and fairness of biased face recognition algorithms. We experimentally show that learning processes based on the most used face databases have led to popular pre-trained deep face models that present a strong algorithmic discrimination. Our approach works as an add-on to pre-trained networks and is used to improve their performance in terms of average accuracy and fairness.
  arXiv  Detail & Related papers  (2020-04-22T10:32:16Z)
• Real-time Segmentation and Facial Skin Tones Grading [6.222979369834314]
  We propose an efficient segmentation method based on deep convolutional neural networks (DCNNs) for the task of hair and facial skin segmentation. We achieve 90.73% Pixel Accuracy on Figaro1k dataset at over 16 FPS in the case of CPU environment. We further use masked color moment for skin tones grade evaluation and approximate 80% classification accuracy demonstrate the feasibility of the proposed scheme.
  arXiv  Detail & Related papers  (2019-12-30T11:35:36Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.