Addressing Racial Bias in Facial Emotion Recognition

• URL: http://arxiv.org/abs/2308.04674v1
• Date: Wed, 9 Aug 2023 03:03:35 GMT
• Title: Addressing Racial Bias in Facial Emotion Recognition
• Authors: Alex Fan, Xingshuo Xiao, Peter Washington
• Abstract summary: This study focuses on analyzing racial bias by sub-sampling training sets with varied racial distributions. Our findings indicate that smaller datasets with posed faces improve on both fairness and performance metrics as the simulations approach racial balance. In larger datasets with greater facial variation, fairness metrics generally remain constant, suggesting that racial balance by itself is insufficient to achieve parity in test performance across different racial groups.
• Score: 1.4896509623302834
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Fairness in deep learning models trained with high-dimensional inputs and subjective labels remains a complex and understudied area. Facial emotion recognition, a domain where datasets are often racially imbalanced, can lead to models that yield disparate outcomes across racial groups. This study focuses on analyzing racial bias by sub-sampling training sets with varied racial distributions and assessing test performance across these simulations. Our findings indicate that smaller datasets with posed faces improve on both fairness and performance metrics as the simulations approach racial balance. Notably, the F1-score increases by $27.2\%$ points, and demographic parity increases by $15.7\%$ points on average across the simulations. However, in larger datasets with greater facial variation, fairness metrics generally remain constant, suggesting that racial balance by itself is insufficient to achieve parity in test performance across different racial groups.

Related papers

• Towards Fair Face Verification: An In-depth Analysis of Demographic Biases [11.191375513738361]
  Deep learning-based person identification and verification systems have remarkably improved in terms of accuracy in recent years. However, such systems have been found to exhibit significant biases related to race, age, and gender. This paper presents an in-depth analysis, with a particular emphasis on the intersectionality of these demographic factors.
  arXiv  Detail & Related papers  (2023-07-19T14:49:14Z)
• The Impact of Racial Distribution in Training Data on Face Recognition Bias: A Closer Look [0.0]
  We study the effect of racial distribution in the training data on the performance of face recognition models. We analyze these trained models using accuracy metrics, clustering metrics, UMAP projections, face quality, and decision thresholds.
  arXiv  Detail & Related papers  (2022-11-26T07:03:24Z)
• Studying Bias in GANs through the Lens of Race [91.95264864405493]
  We study how the performance and evaluation of generative image models are impacted by the racial composition of their training datasets. Our results show that the racial compositions of generated images successfully preserve that of the training data. However, we observe that truncation, a technique used to generate higher quality images during inference, exacerbates racial imbalances in the data.
  arXiv  Detail & Related papers  (2022-09-06T22:25:56Z)
• A Deep Dive into Dataset Imbalance and Bias in Face Identification [49.210042420757894]
  Media portrayals often center imbalance as the main source of bias in automated face recognition systems. Previous studies of data imbalance in FR have focused exclusively on the face verification setting. This work thoroughly explores the effects of each kind of imbalance possible in face identification, and discuss other factors which may impact bias in this setting.
  arXiv  Detail & Related papers  (2022-03-15T20:23:13Z)
• Balancing out Bias: Achieving Fairness Through Training Reweighting [58.201275105195485]
  Bias in natural language processing arises from models learning characteristics of the author such as gender and race. Existing methods for mitigating and measuring bias do not directly account for correlations between author demographics and linguistic variables. This paper introduces a very simple but highly effective method for countering bias using instance reweighting.
  arXiv  Detail & Related papers  (2021-09-16T23:40:28Z)
• Unravelling the Effect of Image Distortions for Biased Prediction of Pre-trained Face Recognition Models [86.79402670904338]
  We evaluate the performance of four state-of-the-art deep face recognition models in the presence of image distortions. We have observed that image distortions have a relationship with the performance gap of the model across different subgroups.
  arXiv  Detail & Related papers  (2021-08-14T16:49:05Z)
• Fairness in Cardiac MR Image Analysis: An Investigation of Bias Due to Data Imbalance in Deep Learning Based Segmentation [1.6386696247541932]
  "Fairness" in AI refers to assessing algorithms for potential bias based on demographic characteristics such as race and gender. Deep learning (DL) in cardiac MR segmentation has led to impressive results in recent years, but no work has yet investigated the fairness of such models. We find statistically significant differences in Dice performance between different racial groups.
  arXiv  Detail & Related papers  (2021-06-23T13:27:35Z)
• One Label, One Billion Faces: Usage and Consistency of Racial Categories in Computer Vision [75.82110684355979]
  We study the racial system encoded by computer vision datasets supplying categorical race labels for face images. We find that each dataset encodes a substantially unique racial system, despite nominally equivalent racial categories. We find evidence that racial categories encode stereotypes, and exclude ethnic groups from categories on the basis of nonconformity to stereotypes.
  arXiv  Detail & Related papers  (2021-02-03T22:50:04Z)
• Enhancing Facial Data Diversity with Style-based Face Aging [59.984134070735934]
  In particular, face datasets are typically biased in terms of attributes such as gender, age, and race. We propose a novel, generative style-based architecture for data augmentation that captures fine-grained aging patterns. We show that the proposed method outperforms state-of-the-art algorithms for age transfer.
  arXiv  Detail & Related papers  (2020-06-06T21:53:44Z)
• Exploring Racial Bias within Face Recognition via per-subject Adversarially-Enabled Data Augmentation [15.924281804465252]
  We propose a novel adversarial derived data augmentation methodology that aims to enable dataset balance at a per-subject level. Our aim is to automatically construct a synthesised dataset by transforming facial images across varying racial domains. In a side-by-side comparison, we show the positive impact our proposed technique can have on the recognition performance for (racial) minority groups.
  arXiv  Detail & Related papers  (2020-04-19T19:46:32Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.