Emotion Collider: Dual Hyperbolic Mirror Manifolds for Sentiment Recovery via Anti Emotion Reflection
- URL: http://arxiv.org/abs/2602.16161v1
- Date: Wed, 18 Feb 2026 03:19:05 GMT
- Title: Emotion Collider: Dual Hyperbolic Mirror Manifolds for Sentiment Recovery via Anti Emotion Reflection
- Abstract summary: Emotion Collider (EC-Net) is a hyperbolic hypergraph framework for multimodal emotion and sentiment modeling.<n>EC-Net represents hierarchies using Poincare-ball embeddings and performs fusion through a hypergraph mechanism.<n> Empirical results show that EC-Net produces robust, semantically coherent representations and consistently improves accuracy.
- Score: 19.83275015213163
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Emotional expression underpins natural communication and effective human-computer interaction. We present Emotion Collider (EC-Net), a hyperbolic hypergraph framework for multimodal emotion and sentiment modeling. EC-Net represents modality hierarchies using Poincare-ball embeddings and performs fusion through a hypergraph mechanism that passes messages bidirectionally between nodes and hyperedges. To sharpen class separation, contrastive learning is formulated in hyperbolic space with decoupled radial and angular objectives. High-order semantic relations across time steps and modalities are preserved via adaptive hyperedge construction. Empirical results on standard multimodal emotion benchmarks show that EC-Net produces robust, semantically coherent representations and consistently improves accuracy, particularly when modalities are partially available or contaminated by noise. These findings indicate that explicit hierarchical geometry combined with hypergraph fusion is effective for resilient multimodal affect understanding.
Related papers
- Inter-X++: A Comprehensive Benchmark for Multimodal Human-Human Interaction Analysis [55.78822230833247]
We present Inter-X++, a comprehensive and large-scale benchmark designed to empower versatile HHI analysis.<n>Inter-X++ provides 11,388 high-fidelity interaction sequences and over 8.1M frames, featuring precise whole-body movements and detailed finger articulations.<n>We propose OpenHHI, a single and unified HHI representation and modeling framework that jointly optimize interaction reconstruction and semantic understanding.
arXiv Detail & Related papers (2026-08-20T17:51:48Z) - Navigating the Emotion Tree: Hierarchical Hyperbolic RAG for Multimodal Emotion Recognition [56.650820426231284]
Multimodal emotion recognition aims to integrate text, audio, and video sources to understand human affective states.<n>Although large language models excel at multimodal reasoning, they typically treat emotion categories as independent labels.<n>We propose bftextHyperEmo-RAG, a retrieval-augmented generation framework that leverages a structured emotional knowledge base.
arXiv Detail & Related papers (2026-05-16T10:04:48Z) - Emotion-Cause Pair Extraction in Conversations via Semantic Decoupling and Graph Alignment [8.345559401830291]
ECPEC aims to identify the set of causal relations between emotion utterances and their triggering causes within a dialogue.<n>We seek to disentangle emotion-oriented semantics from cause-oriented semantics, mapping them into two complementary representation spaces.<n>We propose a unified framework that instantiates the above semantic decoupling and alignment principle within a shared conversational structure.
arXiv Detail & Related papers (2026-04-21T15:05:48Z) - Disentangled Dual-Branch Graph Learning for Conversational Emotion Recognition [37.30058027224552]
Multimodal emotion recognition in conversations aims to infer utterance-level emotions by jointly modeling textual, acoustic, and visual cues within context.<n>We propose a framework that combines dual-space feature disentanglement with dual-branch graph learning.<n> Experiments on IEMOCAP and MELD demonstrate that the proposed method achieves superior performance over strong baselines.
arXiv Detail & Related papers (2026-04-03T14:47:26Z) - Emotion-Coherent Reasoning for Multimodal LLMs via Emotional Rationale Verifier [53.55996102181836]
We propose the Emotional Rationale Verifier (ERV) and an Explanation Reward.<n>Our method guides the model to produce reasoning that is explicitly consistent with the target emotion.<n>We show that our approach not only enhances alignment between explanation and prediction but also empowers MLLMs to deliver emotionally coherent, trustworthy interactions.
arXiv Detail & Related papers (2025-10-27T16:40:17Z) - SoftHGNN: Soft Hypergraph Neural Networks for General Visual Recognition [19.88933136559363]
Hypergraphs extend conventional graphs by modeling high-order interactions.<n>Existing hypergraph neural networks typically rely on static and hard hyperedge assignments.<n>We present Soft Hypergraph Neural Networks (SoftHGNNs), which extend the methodology of hypergraph computation.
arXiv Detail & Related papers (2025-05-21T10:01:30Z) - VAEmo: Efficient Representation Learning for Visual-Audio Emotion with Knowledge Injection [50.57849622045192]
We propose VAEmo, an efficient framework for emotion-centric joint VA representation learning with external knowledge injection.<n>VAEmo achieves state-of-the-art performance with a compact design, highlighting the benefit of unified cross-modal encoding and emotion-aware semantic guidance.
arXiv Detail & Related papers (2025-05-05T03:00:51Z) - PiercingEye: Dual-Space Video Violence Detection with Hyperbolic Vision-Language Guidance [39.38656685766509]
Existing weakly supervised video violence detection methods rely on Euclidean representation learning.<n>We propose PiercingEye, a novel dual-space learning framework that synergizes Euclidean and hyperbolic geometries.<n>Experiments on XD-Violence and UCF-Crime benchmarks demonstrate that PiercingEye achieves state-of-the-art performance.
arXiv Detail & Related papers (2025-04-26T09:29:10Z) - GatedxLSTM: A Multimodal Affective Computing Approach for Emotion Recognition in Conversations [35.63053777817013]
GatedxLSTM is a novel multimodal Emotion Recognition in Conversation (ERC) model.<n>It considers voice and transcripts of both the speaker and their conversational partner to identify the most influential sentences driving emotional shifts.<n>It achieves state-of-the-art (SOTA) performance among open-source methods in four-class emotion classification.
arXiv Detail & Related papers (2025-03-26T18:46:18Z) - Machine Unlearning in Hyperbolic vs. Euclidean Multimodal Contrastive Learning: Adapting Alignment Calibration to MERU [50.9588132578029]
This paper investigates machine unlearning in hyperbolic contrastive learning.<n>We adapt Alignment to MERU, a model that embeds images and text in hyperbolic space to better capture semantic hierarchies.<n>Our approach introduces hyperbolic-specific components including entailment calibration and norm regularization that leverage the unique properties of hyperbolic space.
arXiv Detail & Related papers (2025-03-19T12:47:37Z) - Effective Context Modeling Framework for Emotion Recognition in Conversations [2.7175580940471913]
Emotion Recognition in Conversations (ERC) facilitates a deeper understanding of the emotions conveyed by speakers in each utterance within a conversation.<n>Recent Graph Neural Networks (GNNs) have demonstrated their strengths in capturing data relationships.<n>We propose ConxGNN, a novel GNN-based framework designed to capture contextual information in conversations.
arXiv Detail & Related papers (2024-12-21T02:22:06Z) - When Words Smile: Generating Diverse Emotional Facial Expressions from Text [77.1867389815291]
We introduce an end-to-end text-to-expression model that explicitly focuses on emotional dynamics.<n>Our model learns expressive facial variations in a continuous latent space and generates expressions that are diverse, fluid, and emotionally coherent.
arXiv Detail & Related papers (2024-12-03T15:39:05Z) - Multimodal Emotion Recognition using Transfer Learning from Speaker
Recognition and BERT-based models [53.31917090073727]
We propose a neural network-based emotion recognition framework that uses a late fusion of transfer-learned and fine-tuned models from speech and text modalities.
We evaluate the effectiveness of our proposed multimodal approach on the interactive emotional dyadic motion capture dataset.
arXiv Detail & Related papers (2022-02-16T00:23:42Z) - Fusion with Hierarchical Graphs for Mulitmodal Emotion Recognition [7.147235324895931]
This paper proposes a novel hierarchical graph network (HFGCN) model that learns more informative multimodal representations.
Specifically, the proposed model fuses multimodality inputs using a two-stage graph construction approach and encodes the modality dependencies into the conversation representation.
Experiments showed the effectiveness of our proposed model for more accurate AER, which yielded state-of-the-art results on two public datasets.
arXiv Detail & Related papers (2021-09-15T08:21:01Z) - Target Guided Emotion Aware Chat Machine [58.8346820846765]
The consistency of a response to a given post at semantic-level and emotional-level is essential for a dialogue system to deliver human-like interactions.
This article proposes a unifed end-to-end neural architecture, which is capable of simultaneously encoding the semantics and the emotions in a post.
arXiv Detail & Related papers (2020-11-15T01:55:37Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.