Empathy and Distress Detection using Ensembles of Transformer Models
- URL: http://arxiv.org/abs/2312.02578v1
- Date: Tue, 5 Dec 2023 08:50:34 GMT
- Title: Empathy and Distress Detection using Ensembles of Transformer Models
- Authors: Tanmay Chavan, Kshitij Deshpande and Sheetal Sonawane
- Abstract summary: This paper presents our approach for the WASSA 2023 Empathy, Emotion and Personality Shared Task.
Empathy and distress detection are crucial challenges in Natural Language Processing.
Our final submission has a Pearson's r score of 0.346, placing us third in the empathy and distress detection subtask.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: This paper presents our approach for the WASSA 2023 Empathy, Emotion and
Personality Shared Task. Empathy and distress are human feelings that are
implicitly expressed in natural discourses. Empathy and distress detection are
crucial challenges in Natural Language Processing that can aid our
understanding of conversations. The provided dataset consists of several
long-text examples in the English language, with each example associated with a
numeric score for empathy and distress. We experiment with several BERT-based
models as a part of our approach. We also try various ensemble methods. Our
final submission has a Pearson's r score of 0.346, placing us third in the
empathy and distress detection subtask.
Related papers
- Towards More Accurate Prediction of Human Empathy and Emotion in Text and Multi-turn Conversations by Combining Advanced NLP, Transformers-based Networks, and Linguistic Methodologies [0.0]
We predict the level of empathic concern and personal distress displayed in essays.
Based on the WASSA 2022 Shared Task on Empathy Detection and Emotion Classification, we implement a Feed-Forward Neural Network.
As part of the final stage, these approaches have been adapted to the WASSA 2023 Shared Task on Empathy Emotion and Personality Detection in Interactions.
arXiv Detail & Related papers (2024-07-26T04:01:27Z) - ConText at WASSA 2024 Empathy and Personality Shared Task: History-Dependent Embedding Utterance Representations for Empathy and Emotion Prediction in Conversations [0.8602553195689513]
The WASSA shared task on empathy and emotion prediction in interactions presents an opportunity to benchmark approaches to these tasks.
We model empathy, emotion polarity and emotion intensity of each utterance in a conversation by feeding the utterance to be classified together with its conversational context.
We also model perceived counterparty empathy of each interlocutor by feeding all utterances from the conversation and a token identifying the interlocutor for which we are predicting the empathy.
arXiv Detail & Related papers (2024-07-04T10:44:59Z) - SemEval-2024 Task 3: Multimodal Emotion Cause Analysis in Conversations [53.60993109543582]
SemEval-2024 Task 3, named Multimodal Emotion Cause Analysis in Conversations, aims at extracting all pairs of emotions and their corresponding causes from conversations.
Under different modality settings, it consists of two subtasks: Textual Emotion-Cause Pair Extraction in Conversations (TECPE) and Multimodal Emotion-Cause Pair Extraction in Conversations (MECPE)
In this paper, we introduce the task, dataset and evaluation settings, summarize the systems of the top teams, and discuss the findings of the participants.
arXiv Detail & Related papers (2024-05-19T09:59:00Z) - Leveraging the power of transformers for guilt detection in text [50.65526700061155]
This research explores the applicability of three transformer-based language models for detecting guilt in text.
Our proposed model outformed BERT and RoBERTa models by two and one points respectively.
arXiv Detail & Related papers (2024-01-15T01:40:39Z) - Empathy Detection from Text, Audiovisual, Audio or Physiological Signals: Task Formulations and Machine Learning Methods [5.7306786636466995]
Detecting empathy has potential applications in society, healthcare and education.
Despite being a broad and overlapping topic, the avenue of empathy detection leveraging Machine Learning remains underexplored.
We discuss challenges, research gaps and potential applications in the Affective Computing-based empathy domain.
arXiv Detail & Related papers (2023-10-30T08:34:12Z) - Emotionally Numb or Empathetic? Evaluating How LLMs Feel Using EmotionBench [83.41621219298489]
We evaluate Large Language Models' (LLMs) anthropomorphic capabilities using the emotion appraisal theory from psychology.
We collect a dataset containing over 400 situations that have proven effective in eliciting the eight emotions central to our study.
We conduct a human evaluation involving more than 1,200 subjects worldwide.
arXiv Detail & Related papers (2023-08-07T15:18:30Z) - EmpBot: A T5-based Empathetic Chatbot focusing on Sentiments [75.11753644302385]
Empathetic conversational agents should not only understand what is being discussed, but also acknowledge the implied feelings of the conversation partner.
We propose a method based on a transformer pretrained language model (T5)
We evaluate our model on the EmpatheticDialogues dataset using both automated metrics and human evaluation.
arXiv Detail & Related papers (2021-10-30T19:04:48Z) - Exemplars-guided Empathetic Response Generation Controlled by the
Elements of Human Communication [88.52901763928045]
We propose an approach that relies on exemplars to cue the generative model on fine stylistic properties that signal empathy to the interlocutor.
We empirically show that these approaches yield significant improvements in empathetic response quality in terms of both automated and human-evaluated metrics.
arXiv Detail & Related papers (2021-06-22T14:02:33Z) - PVG at WASSA 2021: A Multi-Input, Multi-Task, Transformer-Based
Architecture for Empathy and Distress Prediction [0.0]
We propose a multi-input, multi-task framework for the task of empathy score prediction.
For the distress score prediction task, the system is boosted by the addition of lexical features.
Our submission ranked 1$st$ based on the average correlation (0.545) as well as the distress correlation (0.574), and 2$nd$ for the empathy Pearson correlation (0.517)
arXiv Detail & Related papers (2021-03-04T20:12:25Z) - Towards Persona-Based Empathetic Conversational Models [58.65492299237112]
Empathetic conversational models have been shown to improve user satisfaction and task outcomes in numerous domains.
In Psychology, persona has been shown to be highly correlated to personality, which in turn influences empathy.
We propose a new task towards persona-based empathetic conversations and present the first empirical study on the impact of persona on empathetic responding.
arXiv Detail & Related papers (2020-04-26T08:51:01Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.