Uncertain Label Correction via Auxiliary Action Unit Graphs for Facial Expression Recognition

• URL: http://arxiv.org/abs/2204.11053v1
• Date: Sat, 23 Apr 2022 11:09:43 GMT
• Title: Uncertain Label Correction via Auxiliary Action Unit Graphs for Facial Expression Recognition
• Authors: Yang Liu, Xingming Zhang, Janne Kauttonen, Guoying Zhao
• Abstract summary: We achieve uncertain label correction of facial expressions using auxiliary action unit (AU) graphs, called ULC-AG. Experiments show that our ULC-AG achieves 89.31% and 61.57% accuracy on RAF-DB and AffectNet datasets, respectively.
• Score: 46.99756911719854
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: High-quality annotated images are significant to deep facial expression recognition (FER) methods. However, uncertain labels, mostly existing in large-scale public datasets, often mislead the training process. In this paper, we achieve uncertain label correction of facial expressions using auxiliary action unit (AU) graphs, called ULC-AG. Specifically, a weighted regularization module is introduced to highlight valid samples and suppress category imbalance in every batch. Based on the latent dependency between emotions and AUs, an auxiliary branch using graph convolutional layers is added to extract the semantic information from graph topologies. Finally, a re-labeling strategy corrects the ambiguous annotations by comparing their feature similarities with semantic templates. Experiments show that our ULC-AG achieves 89.31% and 61.57% accuracy on RAF-DB and AffectNet datasets, respectively, outperforming the baseline and state-of-the-art methods.

Related papers

• Spatial Action Unit Cues for Interpretable Deep Facial Expression Recognition [55.97779732051921]
  State-of-the-art classifiers for facial expression recognition (FER) lack interpretability, an important feature for end-users. A new learning strategy is proposed to explicitly incorporate AU cues into classifier training, allowing to train deep interpretable models. Our new strategy is generic, and can be applied to any deep CNN- or transformer-based classifier without requiring any architectural change or significant additional training time.
  arXiv  Detail & Related papers  (2024-10-01T10:42:55Z)
• Multi-Level Label Correction by Distilling Proximate Patterns for Semi-supervised Semantic Segmentation [16.75278876840937]
  We propose an algorithm called Multi-Level Label Correction (MLLC) to rectify erroneous pseudo-labels. MLLC can significantly improve supervised baselines and outperforms state-of-the-art approaches in different scenarios on Cityscapes and PASCAL VOC 2012 datasets.
  arXiv  Detail & Related papers  (2024-04-02T16:06:20Z)
• UIA-ViT: Unsupervised Inconsistency-Aware Method based on Vision Transformer for Face Forgery Detection [52.91782218300844]
  We propose a novel Unsupervised Inconsistency-Aware method based on Vision Transformer, called UIA-ViT. Due to the self-attention mechanism, the attention map among patch embeddings naturally represents the consistency relation, making the vision Transformer suitable for the consistency representation learning.
  arXiv  Detail & Related papers  (2022-10-23T15:24:47Z)
• Adaptive Graph-Based Feature Normalization for Facial Expression Recognition [1.2246649738388389]
  We propose an Adaptive Graph-based Feature Normalization (AGFN) method to protect Facial Expression Recognition models from data uncertainties. Our method outperforms state-of-the-art works with accuracies of 91.84% and 91.11% on benchmark datasets.
  arXiv  Detail & Related papers  (2022-07-22T14:57:56Z)
• Active Learning by Feature Mixing [52.16150629234465]
  We propose a novel method for batch active learning called ALFA-Mix. We identify unlabelled instances with sufficiently-distinct features by seeking inconsistencies in predictions. We show that inconsistencies in these predictions help discovering features that the model is unable to recognise in the unlabelled instances.
  arXiv  Detail & Related papers  (2022-03-14T12:20:54Z)
• Pseudo Pixel-level Labeling for Images with Evolving Content [5.573543601558405]
  We propose a pseudo-pixel-level label generation technique to reduce the amount of effort for manual annotation of images. We train two semantic segmentation models with VGG and ResNet backbones on images labeled using our pseudo labeling method and those of a state-of-the-art method. The results indicate that using our pseudo-labels instead of those generated using the state-of-the-art method in the training process improves the mean-IoU and the frequency-weighted-IoU of the VGG and ResNet-based semantic segmentation models by 3.36%, 2.58%, 10
  arXiv  Detail & Related papers  (2021-05-20T18:14:19Z)
• GRACE: Gradient Harmonized and Cascaded Labeling for Aspect-based Sentiment Analysis [90.43089622630258]
  We propose a GRadient hArmonized and CascadEd labeling model (GRACE) to solve these problems. The proposed model achieves consistency improvement on multiple benchmark datasets and generates state-of-the-art results.
  arXiv  Detail & Related papers  (2020-09-22T13:55:34Z)
• Learning Image Labels On-the-fly for Training Robust Classification Models [13.669654965671604]
  We show how noisy annotations (e.g., from different algorithm-based labelers) can be utilized together and mutually benefit the learning of classification tasks. A meta-training based label-sampling module is designed to attend the labels that benefit the model learning the most through additional back-propagation processes.
  arXiv  Detail & Related papers  (2020-09-22T05:38:44Z)
• Instance-Aware Graph Convolutional Network for Multi-Label Classification [55.131166957803345]
  Graph convolutional neural network (GCN) has effectively boosted the multi-label image recognition task. We propose an instance-aware graph convolutional neural network (IA-GCN) framework for multi-label classification.
  arXiv  Detail & Related papers  (2020-08-19T12:49:28Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.