Deep Adaptation of Adult-Child Facial Expressions by Fusing Landmark Features

• URL: http://arxiv.org/abs/2209.08614v2
• Date: Tue, 12 Mar 2024 20:31:49 GMT
• Title: Deep Adaptation of Adult-Child Facial Expressions by Fusing Landmark Features
• Authors: Megan A. Witherow, Manar D. Samad, Norou Diawara, Haim Y. Bar, Khan M. Iftekharuddin,
• Abstract summary: Deep convolutional neural networks show promising results in classifying facial expressions of adults. We propose deep adaptive FACial Expressions fusing BEtaMix SElected Landmark Features (FACE-BE-SELF) for adult-child expression classification.
• Score: 0.6219950137166257
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Imaging of facial affects may be used to measure psychophysiological attributes of children through their adulthood for applications in education, healthcare, and entertainment, among others. Deep convolutional neural networks show promising results in classifying facial expressions of adults. However, classifier models trained with adult benchmark data are unsuitable for learning child expressions due to discrepancies in psychophysical development. Similarly, models trained with child data perform poorly in adult expression classification. We propose domain adaptation to concurrently align distributions of adult and child expressions in a shared latent space for robust classification of either domain. Furthermore, age variations in facial images are studied in age-invariant face recognition yet remain unleveraged in adult-child expression classification. We take inspiration from multiple fields and propose deep adaptive FACial Expressions fusing BEtaMix SElected Landmark Features (FACE-BE-SELF) for adult-child expression classification. For the first time in the literature, a mixture of Beta distributions is used to decompose and select facial features based on correlations with expression, domain, and identity factors. We evaluate FACE-BE-SELF using 5-fold cross validation for two pairs of adult-child data sets. Our proposed FACE-BE-SELF approach outperforms transfer learning and other baseline domain adaptation methods in aligning latent representations of adult and child expressions.

Related papers

• Child Face Recognition at Scale: Synthetic Data Generation and Performance Benchmark [3.4110993541168853]
  HDA-SynChildFaces consists of 1,652 subjects and a total of 188,832 images, each subject being present at various ages and with many different intra-subject variations. We evaluate the performance of various facial recognition systems on the generated database and compare the results of adults and children at different ages.
  arXiv  Detail & Related papers  (2023-04-23T15:29:26Z)
• Multi-Domain Norm-referenced Encoding Enables Data Efficient Transfer Learning of Facial Expression Recognition [62.997667081978825]
  We propose a biologically-inspired mechanism for transfer learning in facial expression recognition. Our proposed architecture provides an explanation for how the human brain might innately recognize facial expressions on varying head shapes. Our model achieves a classification accuracy of 92.15% on the FERG dataset with extreme data efficiency.
  arXiv  Detail & Related papers  (2023-04-05T09:06:30Z)
• CIAO! A Contrastive Adaptation Mechanism for Non-Universal Facial Expression Recognition [80.07590100872548]
  We propose Contrastive Inhibitory Adaptati On (CIAO), a mechanism that adapts the last layer of facial encoders to depict specific affective characteristics on different datasets. CIAO presents an improvement in facial expression recognition performance over six different datasets with very unique affective representations.
  arXiv  Detail & Related papers  (2022-08-10T15:46:05Z)
• Improving Face Recognition with Large Age Gaps by Learning to Distinguish Children [18.035138944233367]
  We propose a novel loss function called the Inter-Prototype loss which minimizes the similarity between child images. Our experiments and in-depth analyses show that our approach outperforms existing baselines in face recognition with child-adult pairs.
  arXiv  Detail & Related papers  (2021-10-22T07:31:14Z)
• Domain Generalisation for Apparent Emotional Facial Expression Recognition across Age-Groups [55.56174840049614]
  We study the effect of using different age-groups for training apparent emotional facial expression recognition models. We show that an increase in the number of training age-groups tends to increase the apparent emotional facial expression recognition performance on unseen age-groups.
  arXiv  Detail & Related papers  (2021-10-18T10:35:40Z)
• InfAnFace: Bridging the infant-adult domain gap in facial landmark estimation in the wild [0.2786153781225931]
  InfAnFace is a richly-annotated dataset of infant faces. We benchmark the performance of existing facial landmark estimation algorithms trained on adult faces. We put forward the next potential steps to bridge that gap.
  arXiv  Detail & Related papers  (2021-10-17T22:12:16Z)
• Multi-modal Affect Analysis using standardized data within subjects in the Wild [8.05417723395965]
  We introduce the affective recognition method focusing on facial expression (EXP) and valence-arousal calculation. Our proposed framework can improve estimation accuracy and robustness effectively.
  arXiv  Detail & Related papers  (2021-07-07T04:18:28Z)
• FP-Age: Leveraging Face Parsing Attention for Facial Age Estimation in the Wild [50.8865921538953]
  We propose a method to explicitly incorporate facial semantics into age estimation. We design a face parsing-based network to learn semantic information at different scales. We show that our method consistently outperforms all existing age estimation methods.
  arXiv  Detail & Related papers  (2021-06-21T14:31:32Z)
• Adversarial Semantic Data Augmentation for Human Pose Estimation [96.75411357541438]
  We propose Semantic Data Augmentation (SDA), a method that augments images by pasting segmented body parts with various semantic granularity. We also propose Adversarial Semantic Data Augmentation (ASDA), which exploits a generative network to dynamiclly predict tailored pasting configuration. State-of-the-art results are achieved on challenging benchmarks.
  arXiv  Detail & Related papers  (2020-08-03T07:56:04Z)
• Enhancing Facial Data Diversity with Style-based Face Aging [59.984134070735934]
  In particular, face datasets are typically biased in terms of attributes such as gender, age, and race. We propose a novel, generative style-based architecture for data augmentation that captures fine-grained aging patterns. We show that the proposed method outperforms state-of-the-art algorithms for age transfer.
  arXiv  Detail & Related papers  (2020-06-06T21:53:44Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.