Facial Affective Behavior Analysis Method for 5th ABAW Competition

• URL: http://arxiv.org/abs/2303.09145v1
• Date: Thu, 16 Mar 2023 08:21:10 GMT
• Title: Facial Affective Behavior Analysis Method for 5th ABAW Competition
• Authors: Shangfei Wang, Yanan Chang, Yi Wu, Xiangyu Miao, Jiaqiang Wu, Zhouan Zhu, Jiahe Wang, Yufei Xiao
• Abstract summary: 5th ABAW competition includes three challenges from Aff-Wild2 database. We construct three different models to solve the corresponding problems to improve the results. For the experiments of three challenges, we train the models on the provided training data and validate the models on the validation data.
• Score: 20.54725479855494
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Facial affective behavior analysis is important for human-computer interaction. 5th ABAW competition includes three challenges from Aff-Wild2 database. Three common facial affective analysis tasks are involved, i.e. valence-arousal estimation, expression classification, action unit recognition. For the three challenges, we construct three different models to solve the corresponding problems to improve the results, such as data unbalance and data noise. For the experiments of three challenges, we train the models on the provided training data and validate the models on the validation data.

Related papers

• Self-Training with Pseudo-Label Scorer for Aspect Sentiment Quad Prediction [54.23208041792073]
  Aspect Sentiment Quad Prediction (ASQP) aims to predict all quads (aspect term, aspect category, opinion term, sentiment polarity) for a given review. A key challenge in the ASQP task is the scarcity of labeled data, which limits the performance of existing methods. We propose a self-training framework with a pseudo-label scorer, wherein a scorer assesses the match between reviews and their pseudo-labels.
  arXiv  Detail & Related papers  (2024-06-26T05:30:21Z)
• Facial Affective Behavior Analysis with Instruction Tuning [58.332959295770614]
  Facial affective behavior analysis (FABA) is crucial for understanding human mental states from images. Traditional approaches primarily deploy models to discriminate among discrete emotion categories, and lack the fine granularity and reasoning capability for complex facial behaviors. We introduce an instruction-following dataset for two FABA tasks, emotion and action unit recognition, and a benchmark FABA-Bench with a new metric considering both recognition and generation ability. We also introduce a facial prior expert module with face structure knowledge and a low-rank adaptation module into pre-trained MLLM.
  arXiv  Detail & Related papers  (2024-04-07T19:23:28Z)
• The 6th Affective Behavior Analysis in-the-wild (ABAW) Competition [53.718777420180395]
  This paper describes the 6th Affective Behavior Analysis in-the-wild (ABAW) Competition. The 6th ABAW Competition addresses contemporary challenges in understanding human emotions and behaviors.
  arXiv  Detail & Related papers  (2024-02-29T16:49:38Z)
• Few-shot learning for COVID-19 Chest X-Ray Classification with Imbalanced Data: An Inter vs. Intra Domain Study [49.5374512525016]
  Medical image datasets are essential for training models used in computer-aided diagnosis, treatment planning, and medical research. Some challenges are associated with these datasets, including variability in data distribution, data scarcity, and transfer learning issues when using models pre-trained from generic images. We propose a methodology based on Siamese neural networks in which a series of techniques are integrated to mitigate the effects of data scarcity and distribution imbalance.
  arXiv  Detail & Related papers  (2024-01-18T16:59:27Z)
• Spatial-temporal Transformer for Affective Behavior Analysis [11.10521339384583]
  We propose a Transformer with Multi-Head Attention framework to learn the distribution of both the spatial and temporal features. The results fully demonstrate the effectiveness of our proposed model based on the Aff-Wild2 dataset.
  arXiv  Detail & Related papers  (2023-03-19T04:34:17Z)
• Multi-task Cross Attention Network in Facial Behavior Analysis [7.910908058662372]
  We present our solution for the Multi-Task Learning challenge of the Affective Behavior Analysis in-the-wild competition. The challenge is a combination of three tasks: action unit detection, facial expression recognition and valance-arousal estimation. We introduce a cross-attentive module to improve multi-task learning performance.
  arXiv  Detail & Related papers  (2022-07-21T04:07:07Z)
• Facial Affect Analysis: Learning from Synthetic Data & Multi-Task Learning Challenges [23.649517834303502]
  We present novel frameworks to handle the two challenges in the 4th Affective Behavior Analysis In-The-Wild (ABAW) competition. For MTL challenge, we adopt the SMM-EmotionNet with a better ensemble strategy of feature vectors. For LSD challenge, we propose respective methods to combat the problems of single labels, imbalanced distribution, fine-tuning limitations, and choice of model architectures.
  arXiv  Detail & Related papers  (2022-07-20T08:46:18Z)
• Multi-Task Learning for Emotion Descriptors Estimation at the fourth ABAW Challenge [24.529527087437202]
  We introduce multi-task learning framework to enhance the performance of three related tasks in the wild. We conduct experiments on the provided training and validating data.
  arXiv  Detail & Related papers  (2022-07-20T07:39:12Z)
• FairIF: Boosting Fairness in Deep Learning via Influence Functions with Validation Set Sensitive Attributes [51.02407217197623]
  We propose a two-stage training algorithm named FAIRIF. It minimizes the loss over the reweighted data set where the sample weights are computed. We show that FAIRIF yields models with better fairness-utility trade-offs against various types of bias.
  arXiv  Detail & Related papers  (2022-01-15T05:14:48Z)
• Affective Expression Analysis in-the-wild using Multi-Task Temporal Statistical Deep Learning Model [6.024865915538501]
  We present an affective expression analysis model that deals with the above challenges. We experimented on Aff-Wild2 dataset, a large-scale dataset for ABAW Challenge.
  arXiv  Detail & Related papers  (2020-02-21T04:06:03Z)
• Analysing Affective Behavior in the First ABAW 2020 Competition [49.90617840789334]
  The Affective Behavior Analysis in-the-wild (ABAW) 2020 Competition is the first Competition aiming at automatic analysis of the three main behavior tasks. We describe this Competition, to be held in conjunction with the IEEE Conference on Face and Gesture Recognition, May 2020, in Buenos Aires, Argentina. We outline the evaluation metrics, present both the baseline system and the top-3 performing teams' methodologies per Challenge and finally present their obtained results.
  arXiv  Detail & Related papers  (2020-01-30T15:41:14Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.