PVG at WASSA 2021: A Multi-Input, Multi-Task, Transformer-Based
Architecture for Empathy and Distress Prediction
- URL: http://arxiv.org/abs/2103.03296v1
- Date: Thu, 4 Mar 2021 20:12:25 GMT
- Title: PVG at WASSA 2021: A Multi-Input, Multi-Task, Transformer-Based
Architecture for Empathy and Distress Prediction
- Authors: Atharva Kulkarni, Sunanda Somwase, Shivam Rajput, and Manisha Marathe
- Abstract summary: We propose a multi-input, multi-task framework for the task of empathy score prediction.
For the distress score prediction task, the system is boosted by the addition of lexical features.
Our submission ranked 1$st$ based on the average correlation (0.545) as well as the distress correlation (0.574), and 2$nd$ for the empathy Pearson correlation (0.517)
- Score: 0.0
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: Active research pertaining to the affective phenomenon of empathy and
distress is invaluable for improving human-machine interaction. Predicting
intensities of such complex emotions from textual data is difficult, as these
constructs are deeply rooted in the psychological theory. Consequently, for
better prediction, it becomes imperative to take into account ancillary factors
such as the psychological test scores, demographic features, underlying latent
primitive emotions, along with the text's undertone and its psychological
complexity. This paper proffers team PVG's solution to the WASSA 2021 Shared
Task on Predicting Empathy and Emotion in Reaction to News Stories. Leveraging
the textual data, demographic features, psychological test score, and the
intrinsic interdependencies of primitive emotions and empathy, we propose a
multi-input, multi-task framework for the task of empathy score prediction.
Here, the empathy score prediction is considered the primary task, while
emotion and empathy classification are considered secondary auxiliary tasks.
For the distress score prediction task, the system is further boosted by the
addition of lexical features. Our submission ranked 1$^{st}$ based on the
average correlation (0.545) as well as the distress correlation (0.574), and
2$^{nd}$ for the empathy Pearson correlation (0.517).
Related papers
- APTNESS: Incorporating Appraisal Theory and Emotion Support Strategies for Empathetic Response Generation [71.26755736617478]
Empathetic response generation is designed to comprehend the emotions of others.
We develop a framework that combines retrieval augmentation and emotional support strategy integration.
Our framework can enhance the empathy ability of LLMs from both cognitive and affective empathy perspectives.
arXiv Detail & Related papers (2024-07-23T02:23:37Z) - ConText at WASSA 2024 Empathy and Personality Shared Task: History-Dependent Embedding Utterance Representations for Empathy and Emotion Prediction in Conversations [0.8602553195689513]
The WASSA shared task on empathy and emotion prediction in interactions presents an opportunity to benchmark approaches to these tasks.
We model empathy, emotion polarity and emotion intensity of each utterance in a conversation by feeding the utterance to be classified together with its conversational context.
We also model perceived counterparty empathy of each interlocutor by feeding all utterances from the conversation and a token identifying the interlocutor for which we are predicting the empathy.
arXiv Detail & Related papers (2024-07-04T10:44:59Z) - Personality-affected Emotion Generation in Dialog Systems [67.40609683389947]
We propose a new task, Personality-affected Emotion Generation, to generate emotion based on the personality given to the dialog system.
We analyze the challenges in this task, i.e., (1) heterogeneously integrating personality and emotional factors and (2) extracting multi-granularity emotional information in the dialog context.
Results suggest that by adopting our method, the emotion generation performance is improved by 13% in macro-F1 and 5% in weighted-F1 from the BERT-base model.
arXiv Detail & Related papers (2024-04-03T08:48:50Z) - Empathy and Distress Detection using Ensembles of Transformer Models [0.0]
This paper presents our approach for the WASSA 2023 Empathy, Emotion and Personality Shared Task.
Empathy and distress detection are crucial challenges in Natural Language Processing.
Our final submission has a Pearson's r score of 0.346, placing us third in the empathy and distress detection subtask.
arXiv Detail & Related papers (2023-12-05T08:50:34Z) - Accurate Emotion Strength Assessment for Seen and Unseen Speech Based on
Data-Driven Deep Learning [70.30713251031052]
We propose a data-driven deep learning model, i.e. StrengthNet, to improve the generalization of emotion strength assessment for seen and unseen speech.
Experiments show that the predicted emotion strength of the proposed StrengthNet is highly correlated with ground truth scores for both seen and unseen speech.
arXiv Detail & Related papers (2022-06-15T01:25:32Z) - EmpBot: A T5-based Empathetic Chatbot focusing on Sentiments [75.11753644302385]
Empathetic conversational agents should not only understand what is being discussed, but also acknowledge the implied feelings of the conversation partner.
We propose a method based on a transformer pretrained language model (T5)
We evaluate our model on the EmpatheticDialogues dataset using both automated metrics and human evaluation.
arXiv Detail & Related papers (2021-10-30T19:04:48Z) - Exemplars-guided Empathetic Response Generation Controlled by the
Elements of Human Communication [88.52901763928045]
We propose an approach that relies on exemplars to cue the generative model on fine stylistic properties that signal empathy to the interlocutor.
We empirically show that these approaches yield significant improvements in empathetic response quality in terms of both automated and human-evaluated metrics.
arXiv Detail & Related papers (2021-06-22T14:02:33Z) - WASSA@IITK at WASSA 2021: Multi-task Learning and Transformer Finetuning
for Emotion Classification and Empathy Prediction [0.0]
This paper describes our contribution to the WASSA 2021 shared task on Empathy Prediction and Emotion Classification.
The broad goal of this task was to model an empathy score, a distress score and the overall level of emotion of an essay written in response to a newspaper article associated with harm to someone.
We have used the ELECTRA model abundantly and also advanced deep learning approaches like multi-task learning.
arXiv Detail & Related papers (2021-04-20T08:24:10Z) - A Computational Approach to Understanding Empathy Expressed in
Text-Based Mental Health Support [11.736179504987712]
We present a computational approach to understanding how empathy is expressed in online mental health platforms.
We develop a novel unifying theoretically-grounded framework for characterizing the communication of empathy in text-based conversations.
arXiv Detail & Related papers (2020-09-17T17:47:00Z) - Towards Persona-Based Empathetic Conversational Models [58.65492299237112]
Empathetic conversational models have been shown to improve user satisfaction and task outcomes in numerous domains.
In Psychology, persona has been shown to be highly correlated to personality, which in turn influences empathy.
We propose a new task towards persona-based empathetic conversations and present the first empirical study on the impact of persona on empathetic responding.
arXiv Detail & Related papers (2020-04-26T08:51:01Z) - SensAI+Expanse Emotional Valence Prediction Studies with Cognition and
Memory Integration [0.0]
This work contributes with an artificial intelligent agent able to assist on cognitive science studies.
The developed artificial agent system (SensAI+Expanse) includes machine learning algorithms, empathetic algorithms, and memory.
Results of the present study show evidence of significant emotional behaviour differences between some age ranges and gender combinations.
arXiv Detail & Related papers (2020-01-03T18:17:57Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.