The Power of Properties: Uncovering the Influential Factors in Emotion Classification

• URL: http://arxiv.org/abs/2404.07867v1
• Date: Thu, 11 Apr 2024 16:01:00 GMT
• Title: The Power of Properties: Uncovering the Influential Factors in Emotion Classification
• Authors: Tim Büchner, Niklas Penzel, Orlando Guntinas-Lichius, Joachim Denzler,
• Abstract summary: State-of-the-art classification performance is only reached by end-to-end trained neural networks. We introduce a workflow to evaluate explicit properties and their impact.
• Score: 7.562215603730798
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Facial expression-based human emotion recognition is a critical research area in psychology and medicine. State-of-the-art classification performance is only reached by end-to-end trained neural networks. Nevertheless, such black-box models lack transparency in their decision-making processes, prompting efforts to ascertain the rules that underlie classifiers' decisions. Analyzing single inputs alone fails to expose systematic learned biases. These biases can be characterized as facial properties summarizing abstract information like age or medical conditions. Therefore, understanding a model's prediction behavior requires an analysis rooted in causality along such selected properties. We demonstrate that up to 91.25% of classifier output behavior changes are statistically significant concerning basic properties. Among those are age, gender, and facial symmetry. Furthermore, the medical usage of surface electromyography significantly influences emotion prediction. We introduce a workflow to evaluate explicit properties and their impact. These insights might help medical professionals select and apply classifiers regarding their specialized data and properties.

Related papers

• The Personality Illusion: Revealing Dissociation Between Self-Reports & Behavior in LLMs [60.15472325639723]
  Personality traits have long been studied as predictors of human behavior.<n>Recent advances in Large Language Models (LLMs) suggest similar patterns may emerge in artificial systems.
  arXiv  Detail & Related papers  (2025-09-03T21:27:10Z)
• Reading Smiles: Proxy Bias in Foundation Models for Facial Emotion Recognition [10.842056584680071]
  Foundation Models (FMs) are rapidly transforming Affective Computing (AC), with Vision Language Models (VLMs) now capable of recognising emotions in zero shot settings.<n>This paper probes a critical but underexplored question: what visual cues do these models rely on to infer affect, and are these cues psychologically grounded or superficially learnt?<n>We benchmark varying scale VLMs on a teeth annotated subset of AffectNet dataset and find consistent performance shifts depending on the presence of visible teeth.
  arXiv  Detail & Related papers  (2025-06-23T19:56:30Z)
• Fair Diagnosis: Leveraging Causal Modeling to Mitigate Medical Bias [14.848344916632024]
  In medical image analysis, model predictions can be affected by sensitive attributes, such as race and gender. We present a causal modeling framework, which aims to reduce the impact of sensitive attributes on diagnostic predictions.
  arXiv  Detail & Related papers  (2024-12-06T02:59:36Z)
• Achieve Fairness without Demographics for Dermatological Disease Diagnosis [17.792332189055223]
  We propose a method enabling fair predictions for sensitive attributes during the testing phase without using such information during training. Inspired by prior work highlighting the impact of feature entanglement on fairness, we enhance the model features by capturing the features related to the sensitive and target attributes. This ensures that the model can only classify based on the features related to the target attribute without relying on features associated with sensitive attributes.
  arXiv  Detail & Related papers  (2024-01-16T02:49:52Z)
• Decoding Susceptibility: Modeling Misbelief to Misinformation Through a Computational Approach [61.04606493712002]
  Susceptibility to misinformation describes the degree of belief in unverifiable claims that is not observable. Existing susceptibility studies heavily rely on self-reported beliefs. We propose a computational approach to model users' latent susceptibility levels.
  arXiv  Detail & Related papers  (2023-11-16T07:22:56Z)
• Detection and Evaluation of bias-inducing Features in Machine learning [14.045499740240823]
  In the context of machine learning (ML), one can use cause-to-effect analysis to understand the reason for the biased behavior of the system. We propose an approach for systematically identifying all bias-inducing features of a model to help support the decision-making of domain experts.
  arXiv  Detail & Related papers  (2023-10-19T15:01:16Z)
• Sensitivity, Performance, Robustness: Deconstructing the Effect of Sociodemographic Prompting [64.80538055623842]
  sociodemographic prompting is a technique that steers the output of prompt-based models towards answers that humans with specific sociodemographic profiles would give. We show that sociodemographic information affects model predictions and can be beneficial for improving zero-shot learning in subjective NLP tasks.
  arXiv  Detail & Related papers  (2023-09-13T15:42:06Z)
• Towards Procedural Fairness: Uncovering Biases in How a Toxic Language Classifier Uses Sentiment Information [7.022948483613112]
  This work is a step towards evaluating procedural fairness, where unfair processes lead to unfair outcomes. The produced knowledge can guide debiasing techniques to ensure that important concepts besides identity terms are well-represented in training datasets.
  arXiv  Detail & Related papers  (2022-10-19T16:03:25Z)
• Towards Intrinsic Common Discriminative Features Learning for Face Forgery Detection using Adversarial Learning [59.548960057358435]
  We propose a novel method which utilizes adversarial learning to eliminate the negative effect of different forgery methods and facial identities. Our face forgery detection model learns to extract common discriminative features through eliminating the effect of forgery methods and facial identities.
  arXiv  Detail & Related papers  (2022-07-08T09:23:59Z)
• Benchmarking Heterogeneous Treatment Effect Models through the Lens of Interpretability [82.29775890542967]
  Estimating personalized effects of treatments is a complex, yet pervasive problem. Recent developments in the machine learning literature on heterogeneous treatment effect estimation gave rise to many sophisticated, but opaque, tools. We use post-hoc feature importance methods to identify features that influence the model's predictions.
  arXiv  Detail & Related papers  (2022-06-16T17:59:05Z)
• Revisiting the Shape-Bias of Deep Learning for Dermoscopic Skin Lesion Classification [4.414962444402826]
  It is generally believed that the human visual system is biased towards the recognition of shapes rather than textures. In this paper, we revisit the significance of shape-biases for the classification of skin lesion images.
  arXiv  Detail & Related papers  (2022-06-13T20:59:06Z)
• What Do You See in this Patient? Behavioral Testing of Clinical NLP Models [69.09570726777817]
  We introduce an extendable testing framework that evaluates the behavior of clinical outcome models regarding changes of the input. We show that model behavior varies drastically even when fine-tuned on the same data and that allegedly best-performing models have not always learned the most medically plausible patterns.
  arXiv  Detail & Related papers  (2021-11-30T15:52:04Z)
• What Image Features Boost Housing Market Predictions? [81.32205133298254]
  We propose a set of techniques for the extraction of visual features for efficient numerical inclusion in predictive algorithms. We discuss techniques such as Shannon's entropy, calculating the center of gravity, employing image segmentation, and using Convolutional Neural Networks. The set of 40 image features selected here carries a significant amount of predictive power and outperforms some of the strongest metadata predictors.
  arXiv  Detail & Related papers  (2021-07-15T06:32:10Z)
• Classifying Eye-Tracking Data Using Saliency Maps [8.524684315458245]
  This paper proposes a visual saliency based novel feature extraction method for automatic and quantitative classification of eye-tracking data. Comparing the saliency amplitudes, similarity and dissimilarity of saliency maps with the corresponding eye fixations maps gives an extra dimension of information which is effectively utilized to generate discriminative features to classify the eye-tracking data.
  arXiv  Detail & Related papers  (2020-10-24T15:18:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.