Supporting Cognitive and Emotional Empathic Writing of Students
- URL: http://arxiv.org/abs/2105.14815v1
- Date: Mon, 31 May 2021 09:18:50 GMT
- Title: Supporting Cognitive and Emotional Empathic Writing of Students
- Authors: Thiemo Wambsganss, Christina Niklaus, Matthias S\"ollner, Siegfried
Handschuh and Jan Marco Leimeister
- Abstract summary: We present an annotation approach to capturing emotional and cognitive empathy in student-written peer reviews on business models in German.
We trained predictive models to detect the annotated empathy structures and embedded them in an adaptive writing support system.
We evaluated our tool in a peer learning exercise with 58 students and found promising results for perceived empathy skill learning, perceived feedback accuracy, and intention to use.
- Score: 15.125096968712063
- License: http://creativecommons.org/licenses/by-sa/4.0/
- Abstract: We present an annotation approach to capturing emotional and cognitive
empathy in student-written peer reviews on business models in German. We
propose an annotation scheme that allows us to model emotional and cognitive
empathy scores based on three types of review components. Also, we conducted an
annotation study with three annotators based on 92 student essays to evaluate
our annotation scheme. The obtained inter-rater agreement of {\alpha}=0.79 for
the components and the multi-{\pi}=0.41 for the empathy scores indicate that
the proposed annotation scheme successfully guides annotators to a substantial
to moderate agreement. Moreover, we trained predictive models to detect the
annotated empathy structures and embedded them in an adaptive writing support
system for students to receive individual empathy feedback independent of an
instructor, time, and location. We evaluated our tool in a peer learning
exercise with 58 students and found promising results for perceived empathy
skill learning, perceived feedback accuracy, and intention to use. Finally, we
present our freely available corpus of 500 empathy-annotated, student-written
peer reviews on business models and our annotation guidelines to encourage
future research on the design and development of empathy support systems.
Related papers
- Designing for Self-Regulation in Informal Programming Learning: Insights from a Storytelling-Centric Approach [7.71141191415569]
We develop a system consisting of a web platform and browser extensions to support self-regulation online.<n>The design aims to add learner-defined structure to otherwise unstructured experiences by translating them into learning stories with AI-generated feedback.<n>We use three quantitative scales and a qualitative survey to examine users' characteristics and perceptions of the system's support for their self-regulation.
arXiv Detail & Related papers (2025-07-30T13:30:04Z) - IntentionESC: An Intention-Centered Framework for Enhancing Emotional Support in Dialogue Systems [74.0855067343594]
In emotional support conversations, unclear intentions can lead supporters to employ inappropriate strategies.<n>We propose the Intention-centered Emotional Support Conversation framework.<n>It defines the possible intentions of supporters, identifies key emotional state aspects for inferring these intentions, and maps them to appropriate support strategies.
arXiv Detail & Related papers (2025-06-06T10:14:49Z) - From Coders to Critics: Empowering Students through Peer Assessment in the Age of AI Copilots [3.3094795918443634]
This paper presents an empirical study of a rubric based, anonymized peer review process implemented in a large programming course.<n>Students evaluated each other's final projects (2D game) and their assessments were compared to instructor grades using correlation, mean absolute error, and root mean square error (RMSE)<n>Results show that peer review can approximate instructor evaluation with moderate accuracy and foster student engagement, evaluative thinking, and interest in providing good feedback to their peers.
arXiv Detail & Related papers (2025-05-28T08:17:05Z) - Supporting Students' Reading and Cognition with AI [12.029238454394445]
We analyzed text from 124 sessions with AI tools to understand users' reading processes and cognitive engagement.
We propose design implications for future AI reading-support systems, including structured scaffolds for lower-level cognitive tasks.
We advocate for adaptive, human-in-the-loop features that allow students and instructors to tailor their reading experiences with AI.
arXiv Detail & Related papers (2025-04-07T17:51:27Z) - Enhancing Student Feedback Using Predictive Models in Visual Literacy Courses [2.366162376710038]
This study uses Na"ive Bayes modeling to analyze peer review data obtained from an undergraduate visual literacy course over five years.
Our findings highlight the utility of Na"ive Bayes modeling, particularly in the analysis of student comments based on parts of speech.
arXiv Detail & Related papers (2024-05-23T20:02:36Z) - Rethinking the Evaluation of Dialogue Systems: Effects of User Feedback on Crowdworkers and LLMs [57.16442740983528]
In ad-hoc retrieval, evaluation relies heavily on user actions, including implicit feedback.
The role of user feedback in annotators' assessment of turns in a conversational perception has been little studied.
We focus on how the evaluation of task-oriented dialogue systems ( TDSs) is affected by considering user feedback, explicit or implicit, as provided through the follow-up utterance of a turn being evaluated.
arXiv Detail & Related papers (2024-04-19T16:45:50Z) - K-ESConv: Knowledge Injection for Emotional Support Dialogue Systems via
Prompt Learning [83.19215082550163]
We propose K-ESConv, a novel prompt learning based knowledge injection method for emotional support dialogue system.
We evaluate our model on an emotional support dataset ESConv, where the model retrieves and incorporates knowledge from external professional emotional Q&A forum.
arXiv Detail & Related papers (2023-12-16T08:10:10Z) - An integrated framework for developing and evaluating an automated
lecture style assessment system [0.784125444722239]
The proposed application utilizes specific measurable biometric characteristics, such as facial expressions, body activity, speech rate and intonation, hand movement, and facial pose.
Results indicate that participants found the application novel and useful in providing automated feedback regarding lecture quality.
arXiv Detail & Related papers (2023-11-30T21:31:21Z) - A Matter of Annotation: An Empirical Study on In Situ and Self-Recall Activity Annotations from Wearable Sensors [56.554277096170246]
We present an empirical study that evaluates and contrasts four commonly employed annotation methods in user studies focused on in-the-wild data collection.
For both the user-driven, in situ annotations, where participants annotate their activities during the actual recording process, and the recall methods, where participants retrospectively annotate their data at the end of each day, the participants had the flexibility to select their own set of activity classes and corresponding labels.
arXiv Detail & Related papers (2023-05-15T16:02:56Z) - Seeking Subjectivity in Visual Emotion Distribution Learning [93.96205258496697]
Visual Emotion Analysis (VEA) aims to predict people's emotions towards different visual stimuli.
Existing methods often predict visual emotion distribution in a unified network, neglecting the inherent subjectivity in its crowd voting process.
We propose a novel textitSubjectivity Appraise-and-Match Network (SAMNet) to investigate the subjectivity in visual emotion distribution.
arXiv Detail & Related papers (2022-07-25T02:20:03Z) - A literature survey on student feedback assessment tools and their usage
in sentiment analysis [0.0]
We evaluate the effectiveness of various in-class feedback assessment methods such as Kahoot!, Mentimeter, Padlet, and polling.
We propose a sentiment analysis model for extracting the explicit suggestions from the students' qualitative feedback comments.
arXiv Detail & Related papers (2021-09-09T06:56:30Z) - SIFN: A Sentiment-aware Interactive Fusion Network for Review-based Item
Recommendation [48.1799451277808]
We propose a Sentiment-aware Interactive Fusion Network (SIFN) for review-based item recommendation.
We first encode user/item reviews via BERT and propose a light-weighted sentiment learner to extract semantic features of each review.
Then, we propose a sentiment prediction task that guides the sentiment learner to extract sentiment-aware features via explicit sentiment labels.
arXiv Detail & Related papers (2021-08-18T08:04:38Z) - A Corpus for Argumentative Writing Support in German [23.677732296698622]
We propose an annotation scheme that allows to model claims and premises as well as support and attack relations.
We conduct an annotation study with three annotators on 50 persuasive essays to evaluate our scheme.
We present our freely available corpus of 1,000 persuasive student-written peer reviews on business models.
arXiv Detail & Related papers (2020-10-26T15:52:12Z) - A Unified Dual-view Model for Review Summarization and Sentiment
Classification with Inconsistency Loss [51.448615489097236]
Acquiring accurate summarization and sentiment from user reviews is an essential component of modern e-commerce platforms.
We propose a novel dual-view model that jointly improves the performance of these two tasks.
Experiment results on four real-world datasets from different domains demonstrate the effectiveness of our model.
arXiv Detail & Related papers (2020-06-02T13:34:11Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.