RedditESS: A Mental Health Social Support Interaction Dataset -- Understanding Effective Social Support to Refine AI-Driven Support Tools
- URL: http://arxiv.org/abs/2503.21888v1
- Date: Thu, 27 Mar 2025 18:03:11 GMT
- Title: RedditESS: A Mental Health Social Support Interaction Dataset -- Understanding Effective Social Support to Refine AI-Driven Support Tools
- Authors: Zeyad Alghamdi, Tharindu Kumarage, Garima Agrawal, Mansooreh Karami, Ibrahim Almuteb, Huan Liu,
- Abstract summary: We introduce RedditESS, a novel real-world dataset derived from Reddit posts, including supportive comments and original posters' follow-up responses.<n>By broadening the understanding of effective support, our study paves the way for advanced AI-driven mental health interventions.
- Score: 11.476784855198062
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Effective mental health support is crucial for alleviating psychological distress. While large language model (LLM)-based assistants have shown promise in mental health interventions, existing research often defines "effective" support primarily in terms of empathetic acknowledgments, overlooking other essential dimensions such as informational guidance, community validation, and tangible coping strategies. To address this limitation and better understand what constitutes effective support, we introduce RedditESS, a novel real-world dataset derived from Reddit posts, including supportive comments and original posters' follow-up responses. Grounded in established social science theories, we develop an ensemble labeling mechanism to annotate supportive comments as effective or not and perform qualitative assessments to ensure the reliability of the annotations. Additionally, we demonstrate the practical utility of RedditESS by using it to guide LLM alignment toward generating more context-sensitive and genuinely helpful supportive responses. By broadening the understanding of effective support, our study paves the way for advanced AI-driven mental health interventions.
Related papers
- AutoCBT: An Autonomous Multi-agent Framework for Cognitive Behavioral Therapy in Psychological Counseling [57.054489290192535]
Traditional in-person psychological counseling remains primarily niche, often chosen by individuals with psychological issues.
Online automated counseling offers a potential solution for those hesitant to seek help due to feelings of shame.
arXiv Detail & Related papers (2025-01-16T09:57:12Z) - Understanding Student Sentiment on Mental Health Support in Colleges Using Large Language Models [5.3204794327005205]
This paper uses public Student Voice Survey data to analyze student sentiments on mental health support with large language models (LLMs)<n>The investigation of both traditional machine learning methods and state-of-the-art LLMs showed the best performance of GPT-3.5 and BERT on this new dataset.
arXiv Detail & Related papers (2024-11-18T02:53:15Z) - SouLLMate: An Application Enhancing Diverse Mental Health Support with Adaptive LLMs, Prompt Engineering, and RAG Techniques [9.146311285410631]
Mental health issues significantly impact individuals' daily lives, yet many do not receive the help they need even with available online resources.
This study aims to provide diverse, accessible, stigma-free, personalized, and real-time mental health support through cutting-edge AI technologies.
arXiv Detail & Related papers (2024-10-17T22:04:32Z) - CBT-Bench: Evaluating Large Language Models on Assisting Cognitive Behavior Therapy [67.23830698947637]
We propose a new benchmark, CBT-BENCH, for the systematic evaluation of cognitive behavioral therapy (CBT) assistance.<n>We include three levels of tasks in CBT-BENCH: I: Basic CBT knowledge acquisition, with the task of multiple-choice questions; II: Cognitive model understanding, with the tasks of cognitive distortion classification, primary core belief classification, and fine-grained core belief classification; III: Therapeutic response generation, with the task of generating responses to patient speech in CBT therapy sessions.<n> Experimental results indicate that while LLMs perform well in reciting CBT knowledge, they fall short in complex real-world scenarios
arXiv Detail & Related papers (2024-10-17T04:52:57Z) - SouLLMate: An Adaptive LLM-Driven System for Advanced Mental Health Support and Assessment, Based on a Systematic Application Survey [9.146311285410631]
Mental health issues significantly impact individuals' daily lives, yet many do not receive the help they need even with available online resources.
This study aims to provide accessible, stigma-free, personalized, and real-time mental health support through cutting-edge AI technologies.
arXiv Detail & Related papers (2024-10-06T17:11:29Z) - Enhancing AI-Driven Psychological Consultation: Layered Prompts with Large Language Models [44.99833362998488]
We explore the use of large language models (LLMs) like GPT-4 to augment psychological consultation services.
Our approach introduces a novel layered prompting system that dynamically adapts to user input.
We also develop empathy-driven and scenario-based prompts to enhance the LLM's emotional intelligence.
arXiv Detail & Related papers (2024-08-29T05:47:14Z) - PsychoGAT: A Novel Psychological Measurement Paradigm through Interactive Fiction Games with LLM Agents [68.50571379012621]
Psychological measurement is essential for mental health, self-understanding, and personal development.
PsychoGAT (Psychological Game AgenTs) achieves statistically significant excellence in psychometric metrics such as reliability, convergent validity, and discriminant validity.
arXiv Detail & Related papers (2024-02-19T18:00:30Z) - Exploring the Effects of AI-assisted Emotional Support Processes in
Online Mental Health Community [26.36961585672868]
We design an AI-infused workflow that allows users to write emotional supporting messages to other users' posts.
Based on a preliminary user study, we identified that the system helped seekers to clarify emotion and describe text concretely.
arXiv Detail & Related papers (2022-02-21T09:25:36Z) - Understanding the Information Needs and Practices of Human Supporters of
an Online Mental Health Intervention to Inform Machine Learning Applications [6.5893732458797185]
The research investigates how new opportunities provided through recent advances in the field of AI and machine learning (ML) can contribute useful data insights to effectively support the work practices of iCBT supporters.
This paper reports detailed findings of an interview study with 15 iCBT supporters that deepens understanding of their existing work practices and information needs.
The analysis contributes (1) a set of six themes that summarize the strategies and challenges that iCBT supporters encounter in providing effective, personalized feedback to their mental health clients; and (2) presents for each theme concrete opportunities for how methods of ML could help support and address identified challenges and information needs.
arXiv Detail & Related papers (2021-11-12T11:43:31Z) - Towards Emotional Support Dialog Systems [61.58828606097423]
We define the Emotional Support Conversation task and propose an ESC Framework, which is grounded on the Helping Skills Theory.
We construct an Emotion Support Conversation dataset (ESConv) with rich annotation (especially support strategy) in a help-seeker and supporter mode.
We evaluate state-of-the-art dialog models with respect to the ability to provide emotional support.
arXiv Detail & Related papers (2021-06-02T13:30:43Z) - MET: Multimodal Perception of Engagement for Telehealth [52.54282887530756]
We present MET, a learning-based algorithm for perceiving a human's level of engagement from videos.
We release a new dataset, MEDICA, for mental health patient engagement detection.
arXiv Detail & Related papers (2020-11-17T15:18:38Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.