Modeling Motivational Interviewing Strategies On An Online Peer-to-Peer
Counseling Platform
- URL: http://arxiv.org/abs/2211.05182v1
- Date: Wed, 9 Nov 2022 20:25:33 GMT
- Title: Modeling Motivational Interviewing Strategies On An Online Peer-to-Peer
Counseling Platform
- Authors: Raj Sanjay Shah, Faye Holt, Shirley Anugrah Hayati, Aastha Agarwal,
Yi-Chia Wang, Robert E. Kraut, Diyi Yang
- Abstract summary: This paper seeks to bridge the gap by mapping peer-counselor chat-messages to motivational interviewing techniques.
We study the impact of MI techniques on the conversation ratings to investigate the techniques that predict clients' satisfaction with their counseling sessions.
This work provides a deeper understanding of the use of motivational interviewing techniques on peer-to-peer counselor platforms.
- Score: 35.9642101732025
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Millions of people participate in online peer-to-peer support sessions, yet
there has been little prior research on systematic psychology-based evaluations
of fine-grained peer-counselor behavior in relation to client satisfaction.
This paper seeks to bridge this gap by mapping peer-counselor chat-messages to
motivational interviewing (MI) techniques. We annotate 14,797 utterances from
734 chat conversations using 17 MI techniques and introduce four new
interviewing codes such as chit-chat and inappropriate to account for the
unique conversational patterns observed on online platforms. We automate the
process of labeling peer-counselor responses to MI techniques by fine-tuning
large domain-specific language models and then use these automated measures to
investigate the behavior of the peer counselors via correlational studies.
Specifically, we study the impact of MI techniques on the conversation ratings
to investigate the techniques that predict clients' satisfaction with their
counseling sessions. When counselors use techniques such as reflection and
affirmation, clients are more satisfied. Examining volunteer counselors' change
in usage of techniques suggest that counselors learn to use more introduction
and open questions as they gain experience. This work provides a deeper
understanding of the use of motivational interviewing techniques on
peer-to-peer counselor platforms and sheds light on how to build better
training programs for volunteer counselors on online platforms.
Related papers
- Interactive Agents: Simulating Counselor-Client Psychological Counseling via Role-Playing LLM-to-LLM Interactions [12.455050661682051]
We propose a framework that employs two large language models (LLMs) via role-playing for simulating counselor-client interactions.
Our framework involves two LLMs, one acting as a client equipped with a specific and real-life user profile and the other playing the role of an experienced counselor.
arXiv Detail & Related papers (2024-08-28T13:29:59Z) - Cactus: Towards Psychological Counseling Conversations using Cognitive Behavioral Theory [24.937025825501998]
We create a multi-turn dialogue dataset that emulates real-life interactions using the goal-oriented and structured approach of Cognitive Behavioral Therapy (CBT)
We benchmark against established psychological criteria used to evaluate real counseling sessions, ensuring alignment with expert evaluations.
Experimental results demonstrate that Camel, a model trained with Cactus, outperforms other models in counseling skills, highlighting its effectiveness and potential as a counseling agent.
arXiv Detail & Related papers (2024-07-03T13:41:31Z) - K-ESConv: Knowledge Injection for Emotional Support Dialogue Systems via
Prompt Learning [83.19215082550163]
We propose K-ESConv, a novel prompt learning based knowledge injection method for emotional support dialogue system.
We evaluate our model on an emotional support dataset ESConv, where the model retrieves and incorporates knowledge from external professional emotional Q&A forum.
arXiv Detail & Related papers (2023-12-16T08:10:10Z) - ChatCounselor: A Large Language Models for Mental Health Support [8.639639227401625]
ChatCounselor is a large language model (LLM) solution designed to provide mental health support.
The training dataset, Psych8k, was constructed from 260 in-depth interviews, each spanning an hour.
ChatCounselor surpasses existing open-source models in the counseling Bench and approaches the performance level of ChatGPT.
arXiv Detail & Related papers (2023-09-27T07:57:21Z) - Building Emotional Support Chatbots in the Era of LLMs [64.06811786616471]
We introduce an innovative methodology that synthesizes human insights with the computational prowess of Large Language Models (LLMs)
By utilizing the in-context learning potential of ChatGPT, we generate an ExTensible Emotional Support dialogue dataset, named ExTES.
Following this, we deploy advanced tuning techniques on the LLaMA model, examining the impact of diverse training strategies, ultimately yielding an LLM meticulously optimized for emotional support interactions.
arXiv Detail & Related papers (2023-08-17T10:49:18Z) - Understanding Client Reactions in Online Mental Health Counseling [11.12088513389927]
Previous NLP research on counseling has mainly focused on studying counselors' intervention strategies rather than their clients' reactions to the intervention.
This work aims to fill this gap by developing a theoretically grounded annotation framework that encompasses counselors' strategies and client reaction behaviors.
Our study shows how clients react to counselors' strategies, how such reactions affect the final counseling outcomes, and how counselors can adjust their strategies in response to these reactions.
arXiv Detail & Related papers (2023-06-27T09:39:54Z) - Helping the Helper: Supporting Peer Counselors via AI-Empowered Practice
and Feedback [40.065280357381035]
CARE is an interactive AI-based tool to empower peer counselors through automatic suggestion generation.
During the practical training stage, CARE helps diagnose which specific counseling strategies are most suitable in the given context.
CARE especially helps novice counselors respond better in challenging situations.
arXiv Detail & Related papers (2023-05-15T19:48:59Z) - Partner Matters! An Empirical Study on Fusing Personas for Personalized
Response Selection in Retrieval-Based Chatbots [51.091235903442715]
This paper makes an attempt to explore the impact of utilizing personas that describe either self or partner speakers on the task of response selection.
Four persona fusion strategies are designed, which assume personas interact with contexts or responses in different ways.
Empirical studies on the Persona-Chat dataset show that the partner personas can improve the accuracy of response selection.
arXiv Detail & Related papers (2021-05-19T10:32:30Z) - You Impress Me: Dialogue Generation via Mutual Persona Perception [62.89449096369027]
The research in cognitive science suggests that understanding is an essential signal for a high-quality chit-chat conversation.
Motivated by this, we propose P2 Bot, a transmitter-receiver based framework with the aim of explicitly modeling understanding.
arXiv Detail & Related papers (2020-04-11T12:51:07Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.