Modeling Intention, Emotion and External World in Dialogue Systems
- URL: http://arxiv.org/abs/2202.06476v1
- Date: Mon, 14 Feb 2022 04:10:34 GMT
- Title: Modeling Intention, Emotion and External World in Dialogue Systems
- Authors: Wei Peng, Yue Hu, Luxi Xing, Yuqiang Xie, Xingsheng Zhang, Yajing Sun
- Abstract summary: We propose a RelAtion Interaction Network (RAIN) to jointly model mutual relationships and explicitly integrate historical intention information.
The experiments on the dataset show that our model can take full advantage of the intention, emotion and action between individuals.
- Score: 14.724751780218297
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Intention, emotion and action are important elements in human activities.
Modeling the interaction process between individuals by analyzing the
relationships between these elements is a challenging task. However, previous
work mainly focused on modeling intention and emotion independently, and
neglected of exploring the mutual relationships between intention and emotion.
In this paper, we propose a RelAtion Interaction Network (RAIN), consisting of
Intention Relation Module and Emotion Relation Module, to jointly model mutual
relationships and explicitly integrate historical intention information. The
experiments on the dataset show that our model can take full advantage of the
intention, emotion and action between individuals and achieve a remarkable
improvement over BERT-style baselines. Qualitative analysis verifies the
importance of the mutual interaction between the intention and emotion.
Related papers
- Visual-Geometric Collaborative Guidance for Affordance Learning [63.038406948791454]
We propose a visual-geometric collaborative guided affordance learning network that incorporates visual and geometric cues.
Our method outperforms the representative models regarding objective metrics and visual quality.
arXiv Detail & Related papers (2024-10-15T07:35:51Z) - THOR: Text to Human-Object Interaction Diffusion via Relation Intervention [51.02435289160616]
We propose a novel Text-guided Human-Object Interaction diffusion model with Relation Intervention (THOR)
In each diffusion step, we initiate text-guided human and object motion and then leverage human-object relations to intervene in object motion.
We construct Text-BEHAVE, a Text2HOI dataset that seamlessly integrates textual descriptions with the currently largest publicly available 3D HOI dataset.
arXiv Detail & Related papers (2024-03-17T13:17:25Z) - LEMON: Learning 3D Human-Object Interaction Relation from 2D Images [56.6123961391372]
Learning 3D human-object interaction relation is pivotal to embodied AI and interaction modeling.
Most existing methods approach the goal by learning to predict isolated interaction elements.
We present LEMON, a unified model that mines interaction intentions of the counterparts and employs curvatures to guide the extraction of geometric correlations.
arXiv Detail & Related papers (2023-12-14T14:10:57Z) - Dynamic Causal Disentanglement Model for Dialogue Emotion Detection [77.96255121683011]
We propose a Dynamic Causal Disentanglement Model based on hidden variable separation.
This model effectively decomposes the content of dialogues and investigates the temporal accumulation of emotions.
Specifically, we propose a dynamic temporal disentanglement model to infer the propagation of utterances and hidden variables.
arXiv Detail & Related papers (2023-09-13T12:58:09Z) - HIINT: Historical, Intra- and Inter- personal Dynamics Modeling with
Cross-person Memory Transformer [38.92436852096451]
Cross-person memory Transformer (CPM-T) framework is able to explicitly model affective dynamics.
CPM-T framework maintains memory modules to store and update the contexts within the conversation window.
We evaluate the effectiveness and generalizability of our approach on three publicly available datasets for joint engagement, rapport, and human beliefs prediction tasks.
arXiv Detail & Related papers (2023-05-21T06:43:35Z) - COMMA: Modeling Relationship among Motivations, Emotions and Actions in
Language-based Human Activities [12.206523349060179]
Motivations, emotions, and actions are inter-related essential factors in human activities.
We present the first study that investigates the viability of modeling motivations, emotions, and actions in language-based human activities.
arXiv Detail & Related papers (2022-09-14T07:54:20Z) - CogIntAc: Modeling the Relationships between Intention, Emotion and
Action in Interactive Process from Cognitive Perspective [15.797390372732973]
We propose a novel cognitive framework of individual interaction.
The core of the framework is that individuals achieve interaction through external action driven by their inner intention.
arXiv Detail & Related papers (2022-05-07T03:54:51Z) - TSAM: A Two-Stream Attention Model for Causal Emotion Entailment [50.07800752967995]
Causal Emotion Entailment (CEE) aims to discover the potential causes behind an emotion in a conversational utterance.
We classify multiple utterances synchronously to capture the correlations between utterances in a global view.
We propose a Two-Stream Attention Model (TSAM) to effectively model the speaker's emotional influences in the conversational history.
arXiv Detail & Related papers (2022-03-02T02:11:41Z) - Dynamic Modeling of Hand-Object Interactions via Tactile Sensing [133.52375730875696]
In this work, we employ a high-resolution tactile glove to perform four different interactive activities on a diversified set of objects.
We build our model on a cross-modal learning framework and generate the labels using a visual processing pipeline to supervise the tactile model.
This work takes a step on dynamics modeling in hand-object interactions from dense tactile sensing.
arXiv Detail & Related papers (2021-09-09T16:04:14Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.