Modeling Protagonist Emotions for Emotion-Aware Storytelling

• URL: http://arxiv.org/abs/2010.06822v2
• Date: Tue, 20 Oct 2020 19:23:52 GMT
• Title: Modeling Protagonist Emotions for Emotion-Aware Storytelling
• Authors: Faeze Brahman, Snigdha Chaturvedi
• Abstract summary: We present the first study on modeling the emotional trajectory of the protagonist in neural storytelling. Our models include Emotion Supervision (EmoSup) and two Emotion-Reinforced (EmoRL) models.
• Score: 16.09732485225391
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Emotions and their evolution play a central role in creating a captivating story. In this paper, we present the first study on modeling the emotional trajectory of the protagonist in neural storytelling. We design methods that generate stories that adhere to given story titles and desired emotion arcs for the protagonist. Our models include Emotion Supervision (EmoSup) and two Emotion-Reinforced (EmoRL) models. The EmoRL models use special rewards designed to regularize the story generation process through reinforcement learning. Our automatic and manual evaluations demonstrate that these models are significantly better at generating stories that follow the desired emotion arcs compared to baseline methods, without sacrificing story quality.

Related papers

• Generating Visual Stories with Grounded and Coreferent Characters [63.07511918366848]
  We present the first model capable of predicting visual stories with consistently grounded and coreferent character mentions. Our model is finetuned on a new dataset which we build on top of the widely used VIST benchmark. We also propose new evaluation metrics to measure the richness of characters and coreference in stories.
  arXiv  Detail & Related papers  (2024-09-20T14:56:33Z)
• The Emotion Dynamics of Literary Novels [33.974558021764395]
  We use character dialogue to distinguish between the emotion arcs of the narration and the various characters. Our findings show that the narration and the dialogue largely express disparate emotions through the course of a novel.
  arXiv  Detail & Related papers  (2024-03-04T20:39:21Z)
• Emotion Rendering for Conversational Speech Synthesis with Heterogeneous Graph-Based Context Modeling [50.99252242917458]
  Conversational Speech Synthesis (CSS) aims to accurately express an utterance with the appropriate prosody and emotional inflection within a conversational setting. To address the issue of data scarcity, we meticulously create emotional labels in terms of category and intensity. Our model outperforms the baseline models in understanding and rendering emotions.
  arXiv  Detail & Related papers  (2023-12-19T08:47:50Z)
• Language Models (Mostly) Do Not Consider Emotion Triggers When Predicting Emotion [87.18073195745914]
  We investigate how well human-annotated emotion triggers correlate with features deemed salient in their prediction of emotions. Using EmoTrigger, we evaluate the ability of large language models to identify emotion triggers. Our analysis reveals that emotion triggers are largely not considered salient features for emotion prediction models, instead there is intricate interplay between various features and the task of emotion detection.
  arXiv  Detail & Related papers  (2023-11-16T06:20:13Z)
• CHAE: Fine-Grained Controllable Story Generation with Characters, Actions and Emotions [10.694612203803146]
  This paper proposes a model for fine-grained control on the story. It allows the generation of customized stories with characters, corresponding actions and emotions arbitrarily assigned. It has strong controllability to generate stories according to the fine-grained personalized guidance.
  arXiv  Detail & Related papers  (2022-10-11T07:37:50Z)
• ViNTER: Image Narrative Generation with Emotion-Arc-Aware Transformer [59.05857591535986]
  We propose a model called ViNTER to generate image narratives that focus on time series representing varying emotions as "emotion arcs" We present experimental results of both manual and automatic evaluations.
  arXiv  Detail & Related papers  (2022-02-15T10:53:08Z)
• Enhancing Cognitive Models of Emotions with Representation Learning [58.2386408470585]
  We present a novel deep learning-based framework to generate embedding representations of fine-grained emotions. Our framework integrates a contextualized embedding encoder with a multi-head probing model. Our model is evaluated on the Empathetic Dialogue dataset and shows the state-of-the-art result for classifying 32 emotions.
  arXiv  Detail & Related papers  (2021-04-20T16:55:15Z)
• Controllable Multi-Character Psychology-Oriented Story Generation [28.054245616281023]
  We present a novel model-based attention mechanism that we call SoCP (Storytelling of multi-Character Psychology) We show that the proposed model can generate stories considering the changes in the psychological state of different characters. Experiments show that with SoCP, the generated stories follow the psychological state for each character according to both automatic and human evaluations.
  arXiv  Detail & Related papers  (2020-10-11T12:05:00Z)
• Modality-Transferable Emotion Embeddings for Low-Resource Multimodal Emotion Recognition [55.44502358463217]
  We propose a modality-transferable model with emotion embeddings to tackle the aforementioned issues. Our model achieves state-of-the-art performance on most of the emotion categories. Our model also outperforms existing baselines in the zero-shot and few-shot scenarios for unseen emotions.
  arXiv  Detail & Related papers  (2020-09-21T06:10:39Z)
• Visual Simplified Characters' Emotion Emulator Implementing OCC Model [0.9868246135032442]
  This paper is based on a simplified view of the cognitive structure of emotions proposed by Ortony, Clore and Collins (OCC Model) The goal of this paper is to provide a visual platform that allows us to observe changes in the characters different emotions. This tool was tested on stories with a contrasting variety of emotional and affective environments: Othello, Twilight, and Harry Potter, behaving sensibly and in keeping the atmosphere in which the characters were immersed.
  arXiv  Detail & Related papers  (2020-01-17T08:41:46Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.