Structured Dialogue System for Mental Health: An LLM Chatbot Leveraging the PM+ Guidelines

• URL: http://arxiv.org/abs/2411.10681v1
• Date: Sat, 16 Nov 2024 03:12:17 GMT
• Title: Structured Dialogue System for Mental Health: An LLM Chatbot Leveraging the PM+ Guidelines
• Authors: Yixiang Chen, Xinyu Zhang, Jinran Wang, Xurong Xie, Nan Yan, Hui Chen, Lan Wang,
• Abstract summary: SuDoSys is a stage-aware multi-turn dialogue system designed to provide psychological counseling. The system stores essential information throughout the counseling process, ensuring coherent and directed conversations. When assessed using both objective and subjective evaluations, SuDoSys demonstrates its effectiveness in generating logically coherent responses.
• Score: 23.230484270460877
• License:
• Abstract: The Structured Dialogue System, referred to as SuDoSys, is an innovative Large Language Model (LLM)-based chatbot designed to provide psychological counseling. SuDoSys leverages the World Health Organization (WHO)'s Problem Management Plus (PM+) guidelines to deliver stage-aware multi-turn dialogues. Existing methods for employing an LLM in multi-turn psychological counseling typically involve direct fine-tuning using generated dialogues, often neglecting the dynamic stage shifts of counseling sessions. Unlike previous approaches, SuDoSys considers the different stages of counseling and stores essential information throughout the counseling process, ensuring coherent and directed conversations. The system employs an LLM, a stage-aware instruction generator, a response unpacker, a topic database, and a stage controller to maintain dialogue flow. In addition, we propose a novel technique that simulates counseling clients to interact with the evaluated system and evaluate its performance automatically. When assessed using both objective and subjective evaluations, SuDoSys demonstrates its effectiveness in generating logically coherent responses. The system's code and program scripts for evaluation are open-sourced.

Related papers

• Dialogue is Better Than Monologue: Instructing Medical LLMs via Strategical Conversations [74.83732294523402]
  We introduce a novel benchmark that simulates real-world diagnostic scenarios, integrating noise and difficulty levels aligned with USMLE standards. We also explore dialogue-based fine-tuning, which transforms static datasets into conversational formats to better capture iterative reasoning processes. Experiments show that dialogue-tuned models outperform traditional methods, with improvements of $9.64%$ in multi-round reasoning scenarios and $6.18%$ in accuracy in a noisy environment.
  arXiv  Detail & Related papers  (2025-01-29T18:58:48Z)
• STAMPsy: Towards SpatioTemporal-Aware Mixed-Type Dialogues for Psychological Counseling [18.20043364420125]
  Existing psychological counseling dialogue systems mainly on basic empathetic dialogue or QA with minimal professional knowledge and without goal guidance. In many real-world counseling, clients often seek multi-type help, such as diagnosis, consultation therapy, console, and common questions. In this paper, we identify this challenge as how to construct mixed-type dialogue systems for psychological counseling that enable clients to clarify their goals before proceeding with counseling.
  arXiv  Detail & Related papers  (2024-12-21T15:48:02Z)
• Script-Based Dialog Policy Planning for LLM-Powered Conversational Agents: A Basic Architecture for an "AI Therapist" [0.0]
  Large Language Model (LLM)-Powered Conversational Agents have the potential to provide users with scaled behavioral healthcare support. We introduce a novel paradigm for dialog policy planning in conversational agents enabling them to act according to an expert-written "script" We implement two variants of Script-Based Dialog Policy Planning using different prompting techniques and synthesize a total of 100 conversations with LLM-simulated patients.
  arXiv  Detail & Related papers  (2024-12-13T12:12:47Z)
• Interactive Agents: Simulating Counselor-Client Psychological Counseling via Role-Playing LLM-to-LLM Interactions [12.455050661682051]
  We propose a framework that employs two large language models (LLMs) via role-playing for simulating counselor-client interactions. Our framework involves two LLMs, one acting as a client equipped with a specific and real-life user profile and the other playing the role of an experienced counselor.
  arXiv  Detail & Related papers  (2024-08-28T13:29:59Z)
• Controllable Conversations: Planning-Based Dialogue Agent with Large Language Models [52.7201882529976]
  Planning-based Conversational Agents (PCA) is a dialogue framework aimed at enhancing controllability of LLM-driven agents. We propose a dataset comprising SOP-annotated multi-scenario dialogues, generated using a semi-automated role-playing system with GPT-4o. We also propose a novel method that integrates Chain of Thought reasoning with supervised fine-tuning for SOP prediction and utilizes Monte Carlo Tree Search for optimal action planning during dialogues.
  arXiv  Detail & Related papers  (2024-07-04T12:23:02Z)
• Data Augmentation of Multi-turn Psychological Dialogue via Knowledge-driven Progressive Thought Prompting [46.919537239016734]
  Large language models (LLMs) have simplified the implementation of multi-turn dialogues. It remains challenging to deliver satisfactory performance in low-resource domain, like psychological dialogue dialogue. We propose a knowledge-driven progressive thought prompting method to guide LLM to generate psychology-related dialogue.
  arXiv  Detail & Related papers  (2024-06-24T12:02:56Z)
• Plug-and-Play Policy Planner for Large Language Model Powered Dialogue Agents [121.46051697742608]
  We introduce a new dialogue policy planning paradigm to strategize dialogue problems with a tunable language model plug-in named PPDPP. Specifically, we develop a novel training framework to facilitate supervised fine-tuning over available human-annotated data. PPDPP consistently and substantially outperforms existing approaches on three different proactive dialogue applications.
  arXiv  Detail & Related papers  (2023-11-01T03:20:16Z)
• Prompting and Evaluating Large Language Models for Proactive Dialogues: Clarification, Target-guided, and Non-collaboration [72.04629217161656]
  This work focuses on three aspects of proactive dialogue systems: clarification, target-guided, and non-collaborative dialogues. To trigger the proactivity of LLMs, we propose the Proactive Chain-of-Thought prompting scheme.
  arXiv  Detail & Related papers  (2023-05-23T02:49:35Z)
• Response-act Guided Reinforced Dialogue Generation for Mental Health Counseling [25.524804770124145]
  We present READER, a dialogue-act guided response generator for mental health counseling conversations. READER is built on transformer to jointly predict a potential dialogue-act d(t+1) for the next utterance (aka response-act) and to generate an appropriate response u(t+1) We evaluate READER on HOPE, a benchmark counseling conversation dataset.
  arXiv  Detail & Related papers  (2023-01-30T08:53:35Z)
• Speaker and Time-aware Joint Contextual Learning for Dialogue-act Classification in Counselling Conversations [15.230185998553159]
  We develop a novel dataset, named HOPE, to provide a platform for the dialogue-act classification in counselling conversations. We collect 12.9K utterances from publicly-available counselling session videos on YouTube, extract their transcripts, clean, and annotate them with DAC labels. We propose SPARTA, a transformer-based architecture with a novel speaker- and time-aware contextual learning for the dialogue-act classification.
  arXiv  Detail & Related papers  (2021-11-12T10:30:30Z)
• Advances in Multi-turn Dialogue Comprehension: A Survey [51.215629336320305]
  Training machines to understand natural language and interact with humans is an elusive and essential task of artificial intelligence. This paper reviews the previous methods from the technical perspective of dialogue modeling for the dialogue comprehension task. In addition, we categorize dialogue-related pre-training techniques which are employed to enhance PrLMs in dialogue scenarios.
  arXiv  Detail & Related papers  (2021-10-11T03:52:37Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.