Context-Aware Mixture of Domain Experts for Bodily Expression of Emotion in the Wild

• URL: http://arxiv.org/abs/2608.02331v1
• Date: Mon, 03 Aug 2026 14:52:08 GMT
• Title: Context-Aware Mixture of Domain Experts for Bodily Expression of Emotion in the Wild
• Abstract summary: We introduce the Context-Aware Mixture of Domain Experts (CA-MoDE) for bodily emotion recognition.<n>CA-MoDE incorporates dedicated scene and object experts to generate soft distributions over emotion categories conditioned on their respective domains.<n>Our gating strategy mitigates the signal dilution that typically occurs when conflicting or uninformative context distributions are averaged.
• Score: 3.52359746858894
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: The same body posture can convey entirely different emotions depending on its surrounding context, yet most methods for recognising bodily emotions treat scene and object cues as auxiliary feature augmentations rather than as structured priors over the plausibility of emotions. We introduce the Context-Aware Mixture of Domain Experts (CA-MoDE) for bodily emotion recognition. CA-MoDE incorporates dedicated scene and object experts to generate soft distributions over emotion categories conditioned on their respective domains. These domain-conditioned soft predictions serve as structured contextual priors that modulate the body expert's predictions at the distributional level rather than at the feature level. To fuse these multi-domain signals, we propose a task-tailored max-endorsement gating strategy that selects the strongest contextual signal across experts for each emotion dimension. Our gating strategy mitigates the signal dilution that typically occurs when conflicting or uninformative context distributions are averaged. CA-MoDE achieves an Emotion Recognition Score of 0.3269 on the Body Language Database. By outperforming existing temporal models using only single still images, our framework demonstrates that explicitly modelling structured spatial context can serve as a complementary discriminative proxy for the behavioural dynamics typically captured by video.

Related papers

• Multimodal Adaptive Expert Selection with Text Routing and Ordinal Prototype Optimization for Sentiment Analysis [2.3500677765052296]
  Multimodal Sentiment Analysis (MSA) aims to decipher complex emotional states by integrating verbal content with non-verbal cues.<n>Recent disentanglement-based approaches have advanced the field, but their potential is hindered by two methodological challenges.<n>We introduce Multimodal Adaptive Expert Selection with Text Routing and Ordinal prototype optimization (MAESTRO)<n>Unlike static fusion, this module utilizes linguistic context as a routing signal to dynamically activate specific audio-visual experts.
  arXiv  Detail & Related papers  (2026-08-31T12:59:37Z)
• Primitive-Driven Compositional Forensic Visual Prompting for Open-World Face Anti-Spoofing [59.765442274924595]
  We propose a compositional visual prompt learning framework that operates entirely in the visual feature space.<n>The framework employs patch-aware attention to refine a shared set of learnable micro-forensic primitives into localized forensic evidence units.<n>Experiments on nine open-world protocols demonstrate state-of-the-art performance, strong cross-domain generalization, and robust adaptation to unseen attacks.
  arXiv  Detail & Related papers  (2026-08-18T04:18:08Z)
• Navigating the Emotion Tree: Hierarchical Hyperbolic RAG for Multimodal Emotion Recognition [56.650820426231284]
  Multimodal emotion recognition aims to integrate text, audio, and video sources to understand human affective states.<n>Although large language models excel at multimodal reasoning, they typically treat emotion categories as independent labels.<n>We propose bftextHyperEmo-RAG, a retrieval-augmented generation framework that leverages a structured emotional knowledge base.
  arXiv  Detail & Related papers  (2026-05-16T10:04:48Z)
• Beyond Sentiment Classification: A Generative Framework for Emotion Intensity Evaluation in Text [0.0]
  We introduce a novel approach to emotion modeling that shifts the focus from identification to evaluation.<n>We demonstrate a more expressive, generalizable framework for sentiment and emotion analysis.
  arXiv  Detail & Related papers  (2026-05-15T20:32:29Z)
• FACE-net: Factual Calibration and Emotion Augmentation for Retrieval-enhanced Emotional Video Captioning [81.33341786837974]
  Emotional Video Captioning (EVC) is an emerging task, which aims to describe factual content with the intrinsic emotions expressed in videos.<n>We propose a retrieval-enhanced framework with FActual and Emotion augmentation (FACE-net)<n>FACE-net collaboratively mines factual-emotional semantics and provides adaptive and accurate guidance for generation.
  arXiv  Detail & Related papers  (2026-03-18T07:53:15Z)
• Emotion is Not Just a Label: Latent Emotional Factors in LLM Processing [4.733799057798266]
  We study emotion as a latent factor that shapes how models attend to and reason over text.<n>We analyze how emotional tone systematically alters attention geometry in transformer models.<n>We propose an emotional regularization framework that constrains emotion-conditioned representational drift during training.
  arXiv  Detail & Related papers  (2026-03-10T05:23:18Z)
• EmoVerse: A MLLMs-Driven Emotion Representation Dataset for Interpretable Visual Emotion Analysis [61.87711517626139]
  EmoVerse is a large-scale open-source dataset that enables interpretable visual emotion analysis.<n>With over 219k images, the dataset further includes dual annotations in Categorical Emotion States (CES) and Dimensional Emotion Space (DES)
  arXiv  Detail & Related papers  (2025-11-16T11:16:50Z)
• Text-guided Weakly Supervised Framework for Dynamic Facial Expression Recognition [49.41688891301643]
  Dynamic facial expression recognition aims to identify emotional states by modeling the temporal changes in facial movements across video sequences.<n>A key challenge in DFER is the many-to-one labeling problem, where a video composed of numerous frames is assigned a single emotion label.<n>We propose TG-DFER, a text-guided weakly supervised framework that enhances MIL-based DFER by incorporating semantic guidance and coherent temporal modeling.
  arXiv  Detail & Related papers  (2025-11-14T04:49:58Z)
• Incorporating Scene Context and Semantic Labels for Enhanced Group-level Emotion Recognition [39.138182195807424]
  Group-level emotion recognition (GER) aims to identify holistic emotions within a scene involving multiple individuals.<n>Current existed methods underestimate the importance of visual scene contextual information in modeling individual relationships.<n>We propose a novel framework that incorporates visual scene context and label-guided semantic information to improve GER performance.
  arXiv  Detail & Related papers  (2025-09-26T01:25:39Z)
• KEVER^2: Knowledge-Enhanced Visual Emotion Reasoning and Retrieval [35.77379981826482]
  We propose textbfK-EVERtextsuperscript2, a knowledge-enhanced framework for emotion reasoning and retrieval.<n>Our approach introduces a semantically structured formulation of visual emotion cues and integrates external affective knowledge through multimodal alignment.<n>We validate our framework on three representative benchmarks, Emotion6, EmoSet, and M-Disaster, covering social media imagery, human-centric scenes, and disaster contexts.
  arXiv  Detail & Related papers  (2025-05-30T08:33:32Z)
• Two in One Go: Single-stage Emotion Recognition with Decoupled Subject-context Transformer [78.35816158511523]
  We present a single-stage emotion recognition approach, employing a Decoupled Subject-Context Transformer (DSCT) for simultaneous subject localization and emotion classification. We evaluate our single-stage framework on two widely used context-aware emotion recognition datasets, CAER-S and EMOTIC.
  arXiv  Detail & Related papers  (2024-04-26T07:30:32Z)
• Leveraging Semantic Scene Characteristics and Multi-Stream Convolutional Architectures in a Contextual Approach for Video-Based Visual Emotion Recognition in the Wild [31.40575057347465]
  We tackle the task of video-based visual emotion recognition in the wild. Standard methodologies that rely solely on the extraction of bodily and facial features often fall short of accurate emotion prediction. We aspire to alleviate this problem by leveraging visual context in the form of scene characteristics and attributes.
  arXiv  Detail & Related papers  (2021-05-16T17:31:59Z)
• Modality-Transferable Emotion Embeddings for Low-Resource Multimodal Emotion Recognition [55.44502358463217]
  We propose a modality-transferable model with emotion embeddings to tackle the aforementioned issues. Our model achieves state-of-the-art performance on most of the emotion categories. Our model also outperforms existing baselines in the zero-shot and few-shot scenarios for unseen emotions.
  arXiv  Detail & Related papers  (2020-09-21T06:10:39Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.