Adversarial-based neural networks for affect estimations in the wild

• URL: http://arxiv.org/abs/2002.00883v3
• Date: Sun, 9 Feb 2020 23:00:05 GMT
• Title: Adversarial-based neural networks for affect estimations in the wild
• Authors: Decky Aspandi, Adria Mallol-Ragolta, Bj\"orn Schuller, Xavier Binefa
• Abstract summary: In this work, we explore the use of latent features through our proposed adversarial-based networks for recognition in the wild. Specifically, our models operate by aggregating several modalities to our discriminator, which is further conditioned to the extracted latent features by the generator. Our experiments on the recently released SEWA dataset suggest the progressive improvements of our results.
• Score: 3.3335236123901995
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: There is a growing interest in affective computing research nowadays given its crucial role in bridging humans with computers. This progress has been recently accelerated due to the emergence of bigger data. One recent advance in this field is the use of adversarial learning to improve model learning through augmented samples. However, the use of latent features, which is feasible through adversarial learning, is not largely explored, yet. This technique may also improve the performance of affective models, as analogously demonstrated in related fields, such as computer vision. To expand this analysis, in this work, we explore the use of latent features through our proposed adversarial-based networks for valence and arousal recognition in the wild. Specifically, our models operate by aggregating several modalities to our discriminator, which is further conditioned to the extracted latent features by the generator. Our experiments on the recently released SEWA dataset suggest the progressive improvements of our results. Finally, we show our competitive results on the Affective Behavior Analysis in-the-Wild (ABAW) challenge dataset

Related papers

• Enhancing Visual Perception in Novel Environments via Incremental Data Augmentation Based on Style Transfer [2.516855334706386]
  "unknown unknowns" challenge autonomous agent deployment in real-world scenarios. Our approach enhances visual perception by leveraging the Variational Prototyping (VPE) to adeptly identify and handle novel inputs. Our findings suggest the potential benefits of incorporating generative models for domain-specific augmentation strategies.
  arXiv  Detail & Related papers  (2023-09-16T03:06:31Z)
• Learning Objective-Specific Active Learning Strategies with Attentive Neural Processes [72.75421975804132]
  Learning Active Learning (LAL) suggests to learn the active learning strategy itself, allowing it to adapt to the given setting. We propose a novel LAL method for classification that exploits symmetry and independence properties of the active learning problem. Our approach is based on learning from a myopic oracle, which gives our model the ability to adapt to non-standard objectives.
  arXiv  Detail & Related papers  (2023-09-11T14:16:37Z)
• Non-adversarial Robustness of Deep Learning Methods for Computer Vision [0.0]
  Non-adversarial robustness, also known as natural robustness, is a property of deep learning models. We present a brief overview of the most recent techniques for improving the robustness of computer vision methods.
  arXiv  Detail & Related papers  (2023-05-24T10:21:31Z)
• ASPEST: Bridging the Gap Between Active Learning and Selective Prediction [56.001808843574395]
  Selective prediction aims to learn a reliable model that abstains from making predictions when uncertain. Active learning aims to lower the overall labeling effort, and hence human dependence, by querying the most informative examples. In this work, we introduce a new learning paradigm, active selective prediction, which aims to query more informative samples from the shifted target domain.
  arXiv  Detail & Related papers  (2023-04-07T23:51:07Z)
• Spatial-temporal Transformer for Affective Behavior Analysis [11.10521339384583]
  We propose a Transformer with Multi-Head Attention framework to learn the distribution of both the spatial and temporal features. The results fully demonstrate the effectiveness of our proposed model based on the Aff-Wild2 dataset.
  arXiv  Detail & Related papers  (2023-03-19T04:34:17Z)
• Improving Multi-Interest Network with Stable Learning [13.514488368734776]
  We propose a novel multi-interest network, named DEep Stable Multi-Interest Learning (DESMIL) DESMIL tries to eliminate the influence of subtle dependencies among captured interests via learning weights for training samples. We conduct extensive experiments on public recommendation datasets, a large-scale industrial dataset and the synthetic datasets.
  arXiv  Detail & Related papers  (2022-07-14T07:49:28Z)
• Neural Latents Benchmark '21: Evaluating latent variable models of neural population activity [10.356290614426818]
  We introduce a benchmark suite for latent variable modeling of neural population activity. We curate four datasets of neural spiking activity from cognitive, sensory, and motor areas. We identify unsupervised evaluation as a common framework for evaluating models across datasets.
  arXiv  Detail & Related papers  (2021-09-09T17:58:35Z)
• Towards Unbiased Visual Emotion Recognition via Causal Intervention [63.74095927462]
  We propose a novel Emotion Recognition Network (IERN) to alleviate the negative effects brought by the dataset bias. A series of designed tests validate the effectiveness of IERN, and experiments on three emotion benchmarks demonstrate that IERN outperforms other state-of-the-art approaches.
  arXiv  Detail & Related papers  (2021-07-26T10:40:59Z)
• Explainable Adversarial Attacks in Deep Neural Networks Using Activation Profiles [69.9674326582747]
  This paper presents a visual framework to investigate neural network models subjected to adversarial examples. We show how observing these elements can quickly pinpoint exploited areas in a model.
  arXiv  Detail & Related papers  (2021-03-18T13:04:21Z)
• Negative Data Augmentation [127.28042046152954]
  We show that negative data augmentation samples provide information on the support of the data distribution. We introduce a new GAN training objective where we use NDA as an additional source of synthetic data for the discriminator. Empirically, models trained with our method achieve improved conditional/unconditional image generation along with improved anomaly detection capabilities.
  arXiv  Detail & Related papers  (2021-02-09T20:28:35Z)
• Human Trajectory Forecasting in Crowds: A Deep Learning Perspective [89.4600982169]
  We present an in-depth analysis of existing deep learning-based methods for modelling social interactions. We propose two knowledge-based data-driven methods to effectively capture these social interactions. We develop a large scale interaction-centric benchmark TrajNet++, a significant yet missing component in the field of human trajectory forecasting.
  arXiv  Detail & Related papers  (2020-07-07T17:19:56Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.