Assess and Prompt: A Generative RL Framework for Improving Engagement in Online Mental Health Communities
- URL: http://arxiv.org/abs/2508.16788v1
- Date: Fri, 22 Aug 2025 20:40:05 GMT
- Title: Assess and Prompt: A Generative RL Framework for Improving Engagement in Online Mental Health Communities
- Abstract summary: We present a novel framework that identifies gaps and prompts users to enrich their posts, thereby improving engagement.<n>Our model dynamically assesses posts for the presence/absence of support attributes, and generates targeted prompts to elicit missing information.<n> Empirical results across four notable language models demonstrate significant improvements in attribute elicitation and user engagement.
- Score: 18.36818914416437
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: Online Mental Health Communities (OMHCs) provide crucial peer and expert support, yet many posts remain unanswered due to missing support attributes that signal the need for help. We present a novel framework that identifies these gaps and prompts users to enrich their posts, thereby improving engagement. To support this, we introduce REDDME, a new dataset of 4,760 posts from mental health subreddits annotated for the span and intensity of three key support attributes: event what happened?, effect what did the user experience?, and requirement what support they need?. Next, we devise a hierarchical taxonomy, CueTaxo, of support attributes for controlled question generation. Further, we propose MH-COPILOT, a reinforcement learning-based system that integrates (a) contextual attribute-span identification, (b) support attribute intensity classification, (c) controlled question generation via a hierarchical taxonomy, and (d) a verifier for reward modeling. Our model dynamically assesses posts for the presence/absence of support attributes, and generates targeted prompts to elicit missing information. Empirical results across four notable language models demonstrate significant improvements in attribute elicitation and user engagement. A human evaluation further validates the model's effectiveness in real-world OMHC settings.
Related papers
- Inform, Coach, Relate, Listen: Auditing LLM Caregiving Support Roles [15.229339929488162]
Language models are increasingly being deployed for conversational support in informal caregiving contexts.<n>Most safety evaluations assess model behavior under generic prompts, leaving a critical question unexamined: does a model's safety profile change with its support role?<n>We study this by operationalizing four expert-reviewed support roles grounded in social support theory: Inform, Coach, Relate, and Listen.<n>We evaluate across three language models on 5,000 real-world queries from online Alzheimer's Disease and Related Dementias communities.
arXiv Detail & Related papers (2026-05-28T07:04:56Z) - Auditing Support Strategies in LLMs through Grounded Multi-Turn Social Simulation [2.102846336724103]
Support-seeking narratives from five Reddit communities are decomposed into ordered fragments.<n>Support composition shifts systematically with estimated distress.<n>Community context shapes behavior, tracking topic and discourse norms rather than demographic categories.
arXiv Detail & Related papers (2026-04-18T17:36:15Z) - Ask, Answer, and Detect: Role-Playing LLMs for Personality Detection with Question-Conditioned Mixture-of-Experts [4.618735978506653]
ROME is a novel framework that explicitly injects psychological knowledge into personality detection.<n>We show that ROME consistently outperforms state-of-the-art baselines in experiments on two real-world datasets.
arXiv Detail & Related papers (2025-12-09T17:07:54Z) - Improving Speech Emotion Recognition with Mutual Information Regularized Generative Model [28.107097945179905]
We propose a data augmentation framework aided by cross-modal information transfer and mutual information regularization.<n>Our framework was tested on three benchmark datasets: IEMOCAP, MSP-IMPROV and MSP-Podcast.
arXiv Detail & Related papers (2025-10-11T07:29:32Z) - What Makes a Good Natural Language Prompt? [72.3282960118995]
We conduct a meta-analysis surveying more than 150 prompting-related papers from leading NLP and AI conferences from 2022 to 2025.<n>We propose a property- and human-centric framework for evaluating prompt quality, encompassing 21 properties categorized into six dimensions.<n>We then empirically explore multi-property prompt enhancements in reasoning tasks, observing that single-property enhancements often have the greatest impact.
arXiv Detail & Related papers (2025-06-07T23:19:27Z) - Understanding Social Support Needs in Questions: A Hybrid Approach Integrating Semi-Supervised Learning and LLM-based Data Augmentation [9.535629021196973]
We develop a novel framework, Hybrid Approach for SOcial Support need classification (HA-SOS)<n>HA-SOS integrates an answer-enhanced semi-supervised learning approach, a text data augmentation technique leveraging large language models (LLMs) with reliability- and diversity-aware sample selection mechanism, and a unified training process to automatically label social support needs in questions.<n>In practice, our HA-SOS framework facilitates online Q&A platform managers and answerers to better understand users' social support needs, enabling them to provide timely, personalized answers and interventions.
arXiv Detail & Related papers (2025-03-21T07:25:16Z) - A Quantitative Evaluation of the Expressivity of BMI, Pose and Gender in Body Embeddings for Recognition and Identification [56.10719736365069]
We extend the notion of expressivity, defined as the mutual information between learned features and specific attributes, to quantify how strongly attributes are encoded.<n>We find that BMI consistently shows the highest expressivity in the final layers, indicating its dominant role in recognition.<n>These findings demonstrate the central role of body attributes in ReID and establish a principled approach for uncovering attribute driven correlations.
arXiv Detail & Related papers (2025-03-09T05:15:54Z) - Learning from Neighbors: Category Extrapolation for Long-Tail Learning [62.30734737735273]
We offer a novel perspective on long-tail learning, inspired by an observation: datasets with finer granularity tend to be less affected by data imbalance.<n>We introduce open-set auxiliary classes that are visually similar to existing ones, aiming to enhance representation learning for both head and tail classes.<n>To prevent the overwhelming presence of auxiliary classes from disrupting training, we introduce a neighbor-silencing loss.
arXiv Detail & Related papers (2024-10-21T13:06:21Z) - Do RAG Systems Cover What Matters? Evaluating and Optimizing Responses with Sub-Question Coverage [74.70255719194819]
We introduce a novel framework based on sub-question coverage, which measures how well a RAG system addresses different facets of a question.
We use this framework to evaluate three commercial generative answer engines: You.com, Perplexity AI, and Bing Chat.
We find that while all answer engines cover core sub-questions more often than background or follow-up ones, they still miss around 50% of core sub-questions.
arXiv Detail & Related papers (2024-10-20T22:59:34Z) - SouLLMate: An Application Enhancing Diverse Mental Health Support with Adaptive LLMs, Prompt Engineering, and RAG Techniques [9.146311285410631]
Mental health issues significantly impact individuals' daily lives, yet many do not receive the help they need even with available online resources.
This study aims to provide diverse, accessible, stigma-free, personalized, and real-time mental health support through cutting-edge AI technologies.
arXiv Detail & Related papers (2024-10-17T22:04:32Z) - Multi-Prompts Learning with Cross-Modal Alignment for Attribute-based
Person Re-Identification [18.01407937934588]
We present a new framework called Multi-Prompts ReID (MP-ReID) based on prompt learning and language models.
MP-ReID learns to hallucinate diverse, informative, and promptable sentences for describing the query images.
Explicit prompts are obtained by ensembling generation models, such as ChatGPT and VQA models.
arXiv Detail & Related papers (2023-12-28T03:00:19Z) - Towards Verifiable Generation: A Benchmark for Knowledge-aware Language Model Attribution [48.86322922826514]
This paper defines a new task of Knowledge-aware Language Model Attribution (KaLMA)
First, we extend attribution source from unstructured texts to Knowledge Graph (KG), whose rich structures benefit both the attribution performance and working scenarios.
Second, we propose a new Conscious Incompetence" setting considering the incomplete knowledge repository.
Third, we propose a comprehensive automatic evaluation metric encompassing text quality, citation quality, and text citation alignment.
arXiv Detail & Related papers (2023-10-09T11:45:59Z) - PAL: Persona-Augmented Emotional Support Conversation Generation [54.069321178816686]
Due to the lack of human resources for mental health support, there is an increasing demand for employing conversational agents for support.
Recent work has demonstrated the effectiveness of dialogue models in providing emotional support.
We propose a framework for dynamically inferring and modeling seekers' persona.
arXiv Detail & Related papers (2022-12-19T04:12:54Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.