WASSA@IITK at WASSA 2021: Multi-task Learning and Transformer Finetuning
for Emotion Classification and Empathy Prediction
- URL: http://arxiv.org/abs/2104.09827v1
- Date: Tue, 20 Apr 2021 08:24:10 GMT
- Title: WASSA@IITK at WASSA 2021: Multi-task Learning and Transformer Finetuning
for Emotion Classification and Empathy Prediction
- Authors: Jay Mundra, Rohan Gupta, Sagnik Mukherjee
- Abstract summary: This paper describes our contribution to the WASSA 2021 shared task on Empathy Prediction and Emotion Classification.
The broad goal of this task was to model an empathy score, a distress score and the overall level of emotion of an essay written in response to a newspaper article associated with harm to someone.
We have used the ELECTRA model abundantly and also advanced deep learning approaches like multi-task learning.
- Score: 0.0
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: This paper describes our contribution to the WASSA 2021 shared task on
Empathy Prediction and Emotion Classification. The broad goal of this task was
to model an empathy score, a distress score and the overall level of emotion of
an essay written in response to a newspaper article associated with harm to
someone. We have used the ELECTRA model abundantly and also advanced deep
learning approaches like multi-task learning. Additionally, we also leveraged
standard machine learning techniques like ensembling. Our system achieves a
Pearson Correlation Coefficient of 0.533 on sub-task I and a macro F1 score of
0.5528 on sub-task II. We ranked 1st in Emotion Classification sub-task and 3rd
in Empathy Prediction sub-task
Related papers
- ThangDLU at #SMM4H 2024: Encoder-decoder models for classifying text data on social disorders in children and adolescents [49.00494558898933]
This paper describes our participation in Task 3 and Task 5 of the #SMM4H (Social Media Mining for Health) 2024 Workshop.
Task 3 is a multi-class classification task centered on tweets discussing the impact of outdoor environments on symptoms of social anxiety.
Task 5 involves a binary classification task focusing on tweets reporting medical disorders in children.
We applied transfer learning from pre-trained encoder-decoder models such as BART-base and T5-small to identify the labels of a set of given tweets.
arXiv Detail & Related papers (2024-04-30T17:06:20Z) - PetKaz at SemEval-2024 Task 3: Advancing Emotion Classification with an LLM for Emotion-Cause Pair Extraction in Conversations [4.463184061618504]
We present our submission to the SemEval-2023 Task3 "The Competition of Multimodal Emotion Cause Analysis in Conversations"
Our approach relies on combining fine-tuned GPT-3.5 for emotion classification and a BiLSTM-based neural network to detect causes.
arXiv Detail & Related papers (2024-04-08T13:25:03Z) - SemEval 2024 -- Task 10: Emotion Discovery and Reasoning its Flip in
Conversation (EDiReF) [61.49972925493912]
SemEval-2024 Task 10 is a shared task centred on identifying emotions in code-mixed dialogues.
This task comprises three distinct subtasks - emotion recognition in conversation for code-mixed dialogues, emotion flip reasoning for code-mixed dialogues, and emotion flip reasoning for English dialogues.
A total of 84 participants engaged in this task, with the most adept systems attaining F1-scores of 0.70, 0.79, and 0.76 for the respective subtasks.
arXiv Detail & Related papers (2024-02-29T08:20:06Z) - Empathy and Distress Detection using Ensembles of Transformer Models [0.0]
This paper presents our approach for the WASSA 2023 Empathy, Emotion and Personality Shared Task.
Empathy and distress detection are crucial challenges in Natural Language Processing.
Our final submission has a Pearson's r score of 0.346, placing us third in the empathy and distress detection subtask.
arXiv Detail & Related papers (2023-12-05T08:50:34Z) - Large Language Models Understand and Can be Enhanced by Emotional
Stimuli [53.53886609012119]
We take the first step towards exploring the ability of Large Language Models to understand emotional stimuli.
Our experiments show that LLMs have a grasp of emotional intelligence, and their performance can be improved with emotional prompts.
Our human study results demonstrate that EmotionPrompt significantly boosts the performance of generative tasks.
arXiv Detail & Related papers (2023-07-14T00:57:12Z) - Accurate Emotion Strength Assessment for Seen and Unseen Speech Based on
Data-Driven Deep Learning [70.30713251031052]
We propose a data-driven deep learning model, i.e. StrengthNet, to improve the generalization of emotion strength assessment for seen and unseen speech.
Experiments show that the predicted emotion strength of the proposed StrengthNet is highly correlated with ground truth scores for both seen and unseen speech.
arXiv Detail & Related papers (2022-06-15T01:25:32Z) - Leveraging Emotion-specific Features to Improve Transformer Performance
for Emotion Classification [0.0]
This paper describes the approach to the Emotion Classification shared task held at WASSA 2022 by team PVGs AI Club.
This Track 2 sub-task focuses on building models which can predict a multi-class emotion label based on essays from news articles.
arXiv Detail & Related papers (2022-04-30T14:36:04Z) - EmpBot: A T5-based Empathetic Chatbot focusing on Sentiments [75.11753644302385]
Empathetic conversational agents should not only understand what is being discussed, but also acknowledge the implied feelings of the conversation partner.
We propose a method based on a transformer pretrained language model (T5)
We evaluate our model on the EmpatheticDialogues dataset using both automated metrics and human evaluation.
arXiv Detail & Related papers (2021-10-30T19:04:48Z) - Team Phoenix at WASSA 2021: Emotion Analysis on News Stories with
Pre-Trained Language Models [1.6536018920603175]
We describe our system entry for the WASSA 2021 Shared Task.
Our proposed models achieved an Average Pearson Score of 0.417 and a Macro-F1 Score of 0.502 in Track 1 and Track 2, respectively.
arXiv Detail & Related papers (2021-03-10T14:00:54Z) - PVG at WASSA 2021: A Multi-Input, Multi-Task, Transformer-Based
Architecture for Empathy and Distress Prediction [0.0]
We propose a multi-input, multi-task framework for the task of empathy score prediction.
For the distress score prediction task, the system is boosted by the addition of lexical features.
Our submission ranked 1$st$ based on the average correlation (0.545) as well as the distress correlation (0.574), and 2$nd$ for the empathy Pearson correlation (0.517)
arXiv Detail & Related papers (2021-03-04T20:12:25Z) - Emotion Carrier Recognition from Personal Narratives [74.24768079275222]
Personal Narratives (PNs) are recollections of facts, events, and thoughts from one's own experience.
We propose a novel task for Narrative Understanding: Emotion Carrier Recognition (ECR)
arXiv Detail & Related papers (2020-08-17T17:16:08Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.