Scaffolding Empathy: Training Counselors with Simulated Patients and Utterance-level Performance Visualizations
- URL: http://arxiv.org/abs/2502.18673v1
- Date: Tue, 25 Feb 2025 22:12:24 GMT
- Title: Scaffolding Empathy: Training Counselors with Simulated Patients and Utterance-level Performance Visualizations
- Authors: Ian Steenstra, Farnaz Nouraei, Timothy W. Bickmore,
- Abstract summary: We seek to accelerate and optimize counselor training by providing frequent, detailed feedback to trainees as they interact with a simulated patient.<n>Our first application domain involves training motivational interviewing skills for counselors.<n>We developed and evaluated an LLM-powered training system that features a simulated patient and visualizations of turn-by-turn performance feedback.
- Score: 9.257985820123
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Learning therapeutic counseling involves significant role-play experience with mock patients, with current manual training methods providing only intermittent granular feedback. We seek to accelerate and optimize counselor training by providing frequent, detailed feedback to trainees as they interact with a simulated patient. Our first application domain involves training motivational interviewing skills for counselors. Motivational interviewing is a collaborative counseling style in which patients are guided to talk about changing their behavior, with empathetic counseling an essential ingredient. We developed and evaluated an LLM-powered training system that features a simulated patient and visualizations of turn-by-turn performance feedback tailored to the needs of counselors learning motivational interviewing. We conducted an evaluation study with professional and student counselors, demonstrating high usability and satisfaction with the system. We present design implications for the development of automated systems that train users in counseling skills and their generalizability to other types of social skills training.
Related papers
- Virtual Agent-Based Communication Skills Training to Facilitate Health Persuasion Among Peers [1.8408516054528479]
We present an approach that uses virtual agents to coach community-based volunteers in health counseling techniques.<n>We use this approach in a virtual agent-based system to increase COVID-19 vaccination.
arXiv Detail & Related papers (2024-12-16T18:34:32Z) - Multi-Modal Self-Supervised Learning for Surgical Feedback Effectiveness Assessment [66.6041949490137]
We propose a method that integrates information from transcribed verbal feedback and corresponding surgical video to predict feedback effectiveness.
Our findings show that both transcribed feedback and surgical video are individually predictive of trainee behavior changes.
Our results demonstrate the potential of multi-modal learning to advance the automated assessment of surgical feedback.
arXiv Detail & Related papers (2024-11-17T00:13:00Z) - Interactive Agents: Simulating Counselor-Client Psychological Counseling via Role-Playing LLM-to-LLM Interactions [12.455050661682051]
We propose a framework that employs two large language models (LLMs) via role-playing for simulating counselor-client interactions.
Our framework involves two LLMs, one acting as a client equipped with a specific and real-life user profile and the other playing the role of an experienced counselor.
arXiv Detail & Related papers (2024-08-28T13:29:59Z) - Cactus: Towards Psychological Counseling Conversations using Cognitive Behavioral Theory [24.937025825501998]
We create a multi-turn dialogue dataset that emulates real-life interactions using the goal-oriented and structured approach of Cognitive Behavioral Therapy (CBT)
We benchmark against established psychological criteria used to evaluate real counseling sessions, ensuring alignment with expert evaluations.
Experimental results demonstrate that Camel, a model trained with Cactus, outperforms other models in counseling skills, highlighting its effectiveness and potential as a counseling agent.
arXiv Detail & Related papers (2024-07-03T13:41:31Z) - Socially Interactive Agents for Robotic Neurorehabilitation Training: Conceptualization and Proof-of-concept Study [7.365940126473552]
We introduce an AI-based system aimed at delivering personalized, out-of-hospital assistance during neurorehabilitation training.
With the assistance of a professional, the envisioned system is designed to accommodate the unique rehabilitation requirements of an individual patient.
Our approach involves the integration of an interactive socially-aware virtual agent into a neurorehabilitation robotic framework.
arXiv Detail & Related papers (2024-06-17T19:07:05Z) - PATIENT-Ψ: Using Large Language Models to Simulate Patients for Training Mental Health Professionals [22.87612889868498]
PATIENT-Psi is a novel patient simulation framework for cognitive behavior therapy (CBT) training.
We propose an interactive training scheme, PATIENT-Psi-TRAINER, for mental health trainees to practice a key skill in CBT.
arXiv Detail & Related papers (2024-05-30T03:20:56Z) - Multi-Level Feedback Generation with Large Language Models for Empowering Novice Peer Counselors [43.42054421125617]
Existing mechanisms of providing feedback largely rely on human supervision.
Our work aims to leverage large language models to provide contextualized and multi-level feedback to empower peer counselors.
arXiv Detail & Related papers (2024-03-21T04:23:56Z) - K-ESConv: Knowledge Injection for Emotional Support Dialogue Systems via
Prompt Learning [83.19215082550163]
We propose K-ESConv, a novel prompt learning based knowledge injection method for emotional support dialogue system.
We evaluate our model on an emotional support dataset ESConv, where the model retrieves and incorporates knowledge from external professional emotional Q&A forum.
arXiv Detail & Related papers (2023-12-16T08:10:10Z) - Design, Development, and Evaluation of an Interactive Personalized
Social Robot to Monitor and Coach Post-Stroke Rehabilitation Exercises [68.37238218842089]
We develop an interactive social robot exercise coaching system for personalized rehabilitation.
This system integrates a neural network model with a rule-based model to automatically monitor and assess patients' rehabilitation exercises.
Our system can adapt to new participants and achieved 0.81 average performance to assess their exercises, which is comparable to the experts' agreement level.
arXiv Detail & Related papers (2023-05-12T17:37:04Z) - "GAN I hire you?" -- A System for Personalized Virtual Job Interview
Training [49.201250723083]
This study develops an interactive job interview training system with a Generative Adversarial Network (GAN)-based approach.
The overall study results indicate that the GAN-based generated behavioral feedback is helpful.
arXiv Detail & Related papers (2022-06-08T13:03:39Z) - Enabling AI and Robotic Coaches for Physical Rehabilitation Therapy:
Iterative Design and Evaluation with Therapists and Post-Stroke Survivors [66.07833535962762]
Artificial intelligence (AI) and robotic coaches promise the improved engagement of patients on rehabilitation exercises through social interaction.
Previous work explored the potential of automatically monitoring exercises for AI and robotic coaches, but deployment remains a challenge.
We present our efforts on eliciting the detailed design specifications on how AI and robotic coaches could interact with and guide patient's exercises.
arXiv Detail & Related papers (2021-06-15T22:06:39Z) - Opportunities of a Machine Learning-based Decision Support System for
Stroke Rehabilitation Assessment [64.52563354823711]
Rehabilitation assessment is critical to determine an adequate intervention for a patient.
Current practices of assessment mainly rely on therapist's experience, and assessment is infrequently executed due to the limited availability of a therapist.
We developed an intelligent decision support system that can identify salient features of assessment using reinforcement learning.
arXiv Detail & Related papers (2020-02-27T17:04:07Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.