Bridging the gap in FER: addressing age bias in deep learning

• URL: http://arxiv.org/abs/2507.07638v1
• Date: Thu, 10 Jul 2025 11:07:13 GMT
• Title: Bridging the gap in FER: addressing age bias in deep learning
• Authors: F. Xavier Gaya-Morey, Julia Sanchez-Perez, Cristina Manresa-Yee, Jose M. Buades-Rubio,
• Abstract summary: We study age-related bias in deep FER models, with a particular focus on the elderly population.<n>Using Explainable AI (XAI) techniques, we identify systematic disparities in expression recognition and attention patterns.<n>Results show consistent improvements in recognition accuracy for elderly individuals.
• Score: 0.562479170374811
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Facial Expression Recognition (FER) systems based on deep learning have achieved impressive performance in recent years. However, these models often exhibit demographic biases, particularly with respect to age, which can compromise their fairness and reliability. In this work, we present a comprehensive study of age-related bias in deep FER models, with a particular focus on the elderly population. We first investigate whether recognition performance varies across age groups, which expressions are most affected, and whether model attention differs depending on age. Using Explainable AI (XAI) techniques, we identify systematic disparities in expression recognition and attention patterns, especially for "neutral", "sadness", and "anger" in elderly individuals. Based on these findings, we propose and evaluate three bias mitigation strategies: Multi-task Learning, Multi-modal Input, and Age-weighted Loss. Our models are trained on a large-scale dataset, AffectNet, with automatically estimated age labels and validated on balanced benchmark datasets that include underrepresented age groups. Results show consistent improvements in recognition accuracy for elderly individuals, particularly for the most error-prone expressions. Saliency heatmap analysis reveals that models trained with age-aware strategies attend to more relevant facial regions for each age group, helping to explain the observed improvements. These findings suggest that age-related bias in FER can be effectively mitigated using simple training modifications, and that even approximate demographic labels can be valuable for promoting fairness in large-scale affective computing systems.

Related papers

• Deep Learning-Based Age Estimation and Gender Deep Learning-Based Age Estimation and Gender Classification for Targeted Advertisement [3.376269351435396]
  This paper presents a novel deep learning-based approach for simultaneous age and gender classification from facial images.<n>We propose a custom Convolutional Neural Network (CNN) architecture, optimized for both tasks.<n>Our experimental results demonstrate a significant improvement in gender classification accuracy, achieving 95%, and a competitive mean absolute error of 5.77 years for age estimation.
  arXiv  Detail & Related papers  (2025-07-24T16:41:26Z)
• Mitigating Subgroup Disparities in Multi-Label Speech Emotion Recognition: A Pseudo-Labeling and Unsupervised Learning Approach [53.824673312331626]
  Implicit Demography Inference (IDI) module uses k-means clustering to mitigate bias in Speech Emotion Recognition (SER)<n>Experiments show that pseudo-labeling IDI reduces subgroup disparities, improving fairness metrics by over 28%.<n>Unsupervised IDI yields more than a 4.6% improvement in fairness metrics with a drop of less than 3.6% in SER performance.
  arXiv  Detail & Related papers  (2025-05-20T14:50:44Z)
• Deep Learning-Based Facial Expression Recognition for the Elderly: A Systematic Review [0.5242869847419834]
  The rapid aging of the global population has highlighted the need for technologies to support elderly.<n>Facial expression recognition (FER) systems offer a non-invasive means of monitoring emotional states.<n>This study presents a systematic review of deep learning-based FER systems, focusing on their applications for the elderly population.
  arXiv  Detail & Related papers  (2025-02-04T11:05:24Z)
• Balancing the Scales: Enhancing Fairness in Facial Expression Recognition with Latent Alignment [5.784550537553534]
  This workleverages representation learning based on latent spaces to mitigate bias in facial expression recognition systems. It also enhances a deep learning model's fairness and overall accuracy.
  arXiv  Detail & Related papers  (2024-10-25T10:03:10Z)
• A Demographic Attribute Guided Approach to Age Estimation [4.215251065887862]
  This research makes use of auxiliary information of face attributes and proposes a new age estimation approach with an attribute guidance module. Experimental results on three public datasets of UTKFace, LAP2016 and Morph show that our proposed approach achieves superior performance compared to other state-of-the-art methods.
  arXiv  Detail & Related papers  (2022-05-20T15:34:47Z)
• LAE : Long-tailed Age Estimation [52.5745217752147]
  We first formulate a simple standard baseline and build a much strong one by collecting the tricks in pre-training, data augmentation, model architecture, and so on. Compared with the standard baseline, the proposed one significantly decreases the estimation errors. We propose a two-stage training method named Long-tailed Age Estimation (LAE), which decouples the learning procedure into representation learning and classification.
  arXiv  Detail & Related papers  (2021-10-25T09:05:44Z)
• Domain Generalisation for Apparent Emotional Facial Expression Recognition across Age-Groups [55.56174840049614]
  We study the effect of using different age-groups for training apparent emotional facial expression recognition models. We show that an increase in the number of training age-groups tends to increase the apparent emotional facial expression recognition performance on unseen age-groups.
  arXiv  Detail & Related papers  (2021-10-18T10:35:40Z)
• FP-Age: Leveraging Face Parsing Attention for Facial Age Estimation in the Wild [50.8865921538953]
  We propose a method to explicitly incorporate facial semantics into age estimation. We design a face parsing-based network to learn semantic information at different scales. We show that our method consistently outperforms all existing age estimation methods.
  arXiv  Detail & Related papers  (2021-06-21T14:31:32Z)
• Fair and accurate age prediction using distribution aware data curation and augmentation [42.98202989683421]
  Age prediction is an especially difficult application with the issue of fairness remaining an open research problem. One of the main causes of unfair behavior in age prediction methods lies in the distribution and diversity of the training data. We present two novel approaches for dataset curation and data augmentation in order to increase fairness.
  arXiv  Detail & Related papers  (2020-09-11T08:32:36Z)
• Enhancing Facial Data Diversity with Style-based Face Aging [59.984134070735934]
  In particular, face datasets are typically biased in terms of attributes such as gender, age, and race. We propose a novel, generative style-based architecture for data augmentation that captures fine-grained aging patterns. We show that the proposed method outperforms state-of-the-art algorithms for age transfer.
  arXiv  Detail & Related papers  (2020-06-06T21:53:44Z)
• Investigating Bias in Deep Face Analysis: The KANFace Dataset and Empirical Study [67.3961439193994]
  We introduce the most comprehensive, large-scale dataset of facial images and videos to date. The data are manually annotated in terms of identity, exact age, gender and kinship. A method to debias network embeddings is introduced and tested on the proposed benchmarks.
  arXiv  Detail & Related papers  (2020-05-15T00:14:39Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.