Verifying Deep Learning-based Decisions for Facial Expression Recognition

• URL: http://arxiv.org/abs/2003.00828v1
• Date: Fri, 14 Feb 2020 15:59:32 GMT
• Title: Verifying Deep Learning-based Decisions for Facial Expression Recognition
• Authors: Ines Rieger, Rene Kollmann, Bettina Finzel, Dominik Seuss, Ute Schmid
• Abstract summary: We classify facial expressions with a neural network and create pixel-based explanations. We quantify these visual explanations based on a bounding-box method with respect to facial regions. Although our results show that the neural network achieves state-of-the-art results, the evaluation of the visual explanations reveals that relevant facial regions may not be considered.
• Score: 0.8137198664755597
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Neural networks with high performance can still be biased towards non-relevant features. However, reliability and robustness is especially important for high-risk fields such as clinical pain treatment. We therefore propose a verification pipeline, which consists of three steps. First, we classify facial expressions with a neural network. Next, we apply layer-wise relevance propagation to create pixel-based explanations. Finally, we quantify these visual explanations based on a bounding-box method with respect to facial regions. Although our results show that the neural network achieves state-of-the-art results, the evaluation of the visual explanations reveals that relevant facial regions may not be considered.

Related papers

• NeutrEx: A 3D Quality Component Measure on Facial Expression Neutrality [7.736597471757526]
  We propose a quality measure based on the accumulated distances of a 3D face reconstruction to a neutral expression anchor. Our evaluations demonstrate the superiority of our proposed method compared to baseline approaches.
  arXiv  Detail & Related papers  (2023-08-19T09:38:39Z)
• Discriminative Deep Feature Visualization for Explainable Face Recognition [9.105950041800225]
  This paper contributes to the problem of explainable face recognition by first conceiving a face reconstruction-based explanation module. To further interpret the decision of an FR model, a novel visual saliency explanation algorithm has been proposed.
  arXiv  Detail & Related papers  (2023-06-01T07:06:43Z)
• An explainability framework for cortical surface-based deep learning [110.83289076967895]
  We develop a framework for cortical surface-based deep learning. First, we adapted a perturbation-based approach for use with surface data. We show that our explainability framework is not only able to identify important features and their spatial location but that it is also reliable and valid.
  arXiv  Detail & Related papers  (2022-03-15T23:16:49Z)
• Progressive Spatio-Temporal Bilinear Network with Monte Carlo Dropout for Landmark-based Facial Expression Recognition with Uncertainty Estimation [93.73198973454944]
  The performance of our method is evaluated on three widely used datasets. It is comparable to that of video-based state-of-the-art methods while it has much less complexity.
  arXiv  Detail & Related papers  (2021-06-08T13:40:30Z)
• Do Deep Neural Networks Forget Facial Action Units? -- Exploring the Effects of Transfer Learning in Health Related Facial Expression Recognition [1.940353665249968]
  We present a process to investigate the effects of transfer learning for automatic facial expression recognition from emotions to pain. We first train a VGG16 convolutional neural network to automatically discern between eight categorical emotions. We then fine-tune larger parts of this network to learn suitable representations for the task of automatic pain recognition.
  arXiv  Detail & Related papers  (2021-04-15T11:37:19Z)
• The FaceChannel: A Fast & Furious Deep Neural Network for Facial Expression Recognition [71.24825724518847]
  Current state-of-the-art models for automatic Facial Expression Recognition (FER) are based on very deep neural networks that are effective but rather expensive to train. We formalize the FaceChannel, a light-weight neural network that has much fewer parameters than common deep neural networks. We demonstrate how our model achieves a comparable, if not better, performance to the current state-of-the-art in FER.
  arXiv  Detail & Related papers  (2020-09-15T09:25:37Z)
• Face Anti-Spoofing Via Disentangled Representation Learning [90.90512800361742]
  Face anti-spoofing is crucial to security of face recognition systems. We propose a novel perspective of face anti-spoofing that disentangles the liveness features and content features from images.
  arXiv  Detail & Related papers  (2020-08-19T03:54:23Z)
• Occlusion-Adaptive Deep Network for Robust Facial Expression Recognition [56.11054589916299]
  We propose a landmark-guided attention branch to find and discard corrupted features from occluded regions. An attention map is first generated to indicate if a specific facial part is occluded and guide our model to attend to non-occluded regions. This results in more diverse and discriminative features, enabling the expression recognition system to recover even though the face is partially occluded.
  arXiv  Detail & Related papers  (2020-05-12T20:42:55Z)
• Exploiting Semantics for Face Image Deblurring [121.44928934662063]
  We propose an effective and efficient face deblurring algorithm by exploiting semantic cues via deep convolutional neural networks. We incorporate face semantic labels as input priors and propose an adaptive structural loss to regularize facial local structures. The proposed method restores sharp images with more accurate facial features and details.
  arXiv  Detail & Related papers  (2020-01-19T13:06:27Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.