Facial Emotion Recognition using Deep Residual Networks in Real-World Environments

• URL: http://arxiv.org/abs/2111.02717v1
• Date: Thu, 4 Nov 2021 10:08:22 GMT
• Title: Facial Emotion Recognition using Deep Residual Networks in Real-World Environments
• Authors: Panagiotis Tzirakis, D\'enes Boros, Elnar Hajiyev, Bj\"orn W. Schuller
• Abstract summary: We propose a facial feature extractor model trained on an in-the-wild and massively collected video dataset. The dataset consists of a million labelled frames and 2,616 thousand subjects. As temporal information is important to the emotion recognition domain, we utilise LSTM cells to capture the temporal dynamics in the data.
• Score: 5.834678345946704
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Automatic affect recognition using visual cues is an important task towards a complete interaction between humans and machines. Applications can be found in tutoring systems and human computer interaction. A critical step towards that direction is facial feature extraction. In this paper, we propose a facial feature extractor model trained on an in-the-wild and massively collected video dataset provided by the RealEyes company. The dataset consists of a million labelled frames and 2,616 thousand subjects. As temporal information is important to the emotion recognition domain, we utilise LSTM cells to capture the temporal dynamics in the data. To show the favourable properties of our pre-trained model on modelling facial affect, we use the RECOLA database, and compare with the current state-of-the-art approach. Our model provides the best results in terms of concordance correlation coefficient.

Related papers

Err

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.