Habit Coach: Customising RAG-based chatbots to support behavior change

• URL: http://arxiv.org/abs/2411.19229v2
• Date: Mon, 16 Dec 2024 17:16:54 GMT
• Title: Habit Coach: Customising RAG-based chatbots to support behavior change
• Authors: Arian Fooroogh Mand Arabi, Cansu Koyuturk, Michael O'Mahony, Raffaella Calati, Dimitri Ognibene,
• Abstract summary: Habit Coach is designed to support users in habit change through personalized interaction.<n>We developed the system using a Retrieval-Augmented Generation (RAG) system, which enables behavior personalization without retraining the underlying language model.<n>A key challenge in the development process was the difficulty of translating declarative knowledge into effective interaction behaviors.
• Score: 0.6184871136700835
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: This paper presents the iterative development of Habit Coach, a GPT-based chatbot designed to support users in habit change through personalized interaction. Employing a user-centered design approach, we developed the chatbot using a Retrieval-Augmented Generation (RAG) system, which enables behavior personalization without retraining the underlying language model (GPT-4). The system leverages document retrieval and specialized prompts to tailor interactions, drawing from Cognitive Behavioral Therapy (CBT) and narrative therapy techniques. A key challenge in the development process was the difficulty of translating declarative knowledge into effective interaction behaviors. In the initial phase, the chatbot was provided with declarative knowledge about CBT via reference textbooks and high-level conversational goals. However, this approach resulted in imprecise and inefficient behavior, as the GPT model struggled to convert static information into dynamic and contextually appropriate interactions. This highlighted the limitations of relying solely on declarative knowledge to guide chatbot behavior, particularly in nuanced, therapeutic conversations. Over four iterations, we addressed this issue by gradually transitioning towards procedural knowledge, refining the chatbot's interaction strategies, and improving its overall effectiveness. In the final evaluation, 5 participants engaged with the chatbot over five consecutive days, receiving individualized CBT interventions. The Self-Report Habit Index (SRHI) was used to measure habit strength before and after the intervention, revealing a reduction in habit strength post-intervention. These results underscore the importance of procedural knowledge in driving effective, personalized behavior change support in RAG-based systems.

Related papers

• AI-Powered Episodic Future Thinking [2.3539924479180288]
  Episodic Future Thinking (EFT) is an intervention that involves vividly imagining personal future events and experiences in detail. We present EFTeacher, an AI chatbots powered by the GPT-4-Turbo large language model, designed to generate EFT cues for users with lifestyle-related conditions.
  arXiv  Detail & Related papers  (2025-03-08T01:10:04Z)
• Empathetic Response in Audio-Visual Conversations Using Emotion Preference Optimization and MambaCompressor [44.499778745131046]
  Our study introduces a dual approach: firstly, we employ Emotional Preference Optimization (EPO) to train chatbots. This training enables the model to discern fine distinctions between correct and counter-emotional responses. Secondly, we introduce MambaCompressor to effectively compress and manage extensive conversation histories. Our comprehensive experiments across multiple datasets demonstrate that our model significantly outperforms existing models in generating empathetic responses and managing lengthy dialogues.
  arXiv  Detail & Related papers  (2024-12-23T13:44:51Z)
• Beyond Ontology in Dialogue State Tracking for Goal-Oriented Chatbot [3.2288892242158984]
  We propose a novel approach to enhance Dialogue State Tracking (DST) performance. Our method enables Large Language Model (LLM) to infer dialogue states through carefully designed prompts. Our approach achieved state-of-the-art with a JGA of 42.57%, and performed well in open-domain real-world conversations.
  arXiv  Detail & Related papers  (2024-10-30T07:36:23Z)
• Stephanie: Step-by-Step Dialogues for Mimicking Human Interactions in Social Conversations [50.698517967337885]
  We introduce a novel textbf-by-Step Dialogue Paradigm (Stephanie), designed to mimic the ongoing dynamic nature of human conversations. By employing a dual learning strategy and a further-split post-editing method, we generated and utilized a high-quality step-by-step dialogue dataset. Tailored automatic and human evaluations are conducted to assess its effectiveness compared to the traditional single-step dialogue paradigm.
  arXiv  Detail & Related papers  (2024-07-04T17:59:41Z)
• Towards Goal-Oriented Agents for Evolving Problems Observed via Conversation [1.33134751838052]
  The objective of this work is to train a chatbots capable of solving evolving problems through conversing with a user. The system consists of a virtual problem (in this case a simple game), a simulated user capable of answering natural language questions that can observe and perform actions on the problem, and a Deep Q-Network (DQN)-based chatbots architecture.
  arXiv  Detail & Related papers  (2024-01-11T10:38:43Z)
• Real-time Addressee Estimation: Deployment of a Deep-Learning Model on the iCub Robot [52.277579221741746]
  Addressee Estimation is a skill essential for social robots to interact smoothly with humans. Inspired by human perceptual skills, a deep-learning model for Addressee Estimation is designed, trained, and deployed on an iCub robot. The study presents the procedure of such implementation and the performance of the model deployed in real-time human-robot interaction.
  arXiv  Detail & Related papers  (2023-11-09T13:01:21Z)
• Does Collaborative Human-LM Dialogue Generation Help Information Extraction from Human Dialogues? [55.28340832822234]
  Problem-solving human dialogues in real applications can be much more complex than existing Wizard-of-Oz collections. We introduce a human-in-the-loop dialogue generation framework capable of synthesizing realistic dialogues.
  arXiv  Detail & Related papers  (2023-07-13T20:02:50Z)
• Towards Robust Online Dialogue Response Generation [62.99904593650087]
  We argue that this can be caused by a discrepancy between training and real-world testing. We propose a hierarchical sampling-based method consisting of both utterance-level sampling and semi-utterance-level sampling.
  arXiv  Detail & Related papers  (2022-03-07T06:51:41Z)
• Evaluation of In-Person Counseling Strategies To Develop Physical Activity Chatbot for Women [31.20917921863815]
  This work introduces an intervention conversation dataset collected from a real-world physical activity intervention program for women. We designed comprehensive annotation schemes in four dimensions (domain, strategy, social exchange, and task-focused exchange) and annotated a subset of dialogs. To understand how human intervention induces effective behavior changes, we analyzed the relationships between the intervention strategies and the participants' changes in the barrier and social support for physical activity.
  arXiv  Detail & Related papers  (2021-07-22T00:39:21Z)
• Enabling AI and Robotic Coaches for Physical Rehabilitation Therapy: Iterative Design and Evaluation with Therapists and Post-Stroke Survivors [66.07833535962762]
  Artificial intelligence (AI) and robotic coaches promise the improved engagement of patients on rehabilitation exercises through social interaction. Previous work explored the potential of automatically monitoring exercises for AI and robotic coaches, but deployment remains a challenge. We present our efforts on eliciting the detailed design specifications on how AI and robotic coaches could interact with and guide patient's exercises.
  arXiv  Detail & Related papers  (2021-06-15T22:06:39Z)
• Automated Quality Assessment of Cognitive Behavioral Therapy Sessions Through Highly Contextualized Language Representations [34.670548892766625]
  A BERT-based model is proposed for automatic behavioral scoring of a specific type of psychotherapy, called Cognitive Behavioral Therapy (CBT) The model is trained in a multi-task manner in order to achieve higher interpretability. BERT-based representations are further augmented with available therapy metadata, providing relevant non-linguistic context and leading to consistent performance improvements.
  arXiv  Detail & Related papers  (2021-02-23T09:22:29Z)
• Feature Fusion Strategies for End-to-End Evaluation of Cognitive Behavior Therapy Sessions [32.198800906972366]
  We develop an end-to-end pipeline that converts speech audio to diarized and transcribed text to code Cognitive Behavioral Therapy sessions automatically. We propose a novel method to augment the word-based features with the utterance level tags for subsequent CBT code estimation.
  arXiv  Detail & Related papers  (2020-05-15T22:26:58Z)
• TOD-BERT: Pre-trained Natural Language Understanding for Task-Oriented Dialogue [113.45485470103762]
  In this work, we unify nine human-human and multi-turn task-oriented dialogue datasets for language modeling. To better model dialogue behavior during pre-training, we incorporate user and system tokens into the masked language modeling.
  arXiv  Detail & Related papers  (2020-04-15T04:09:05Z)
• You Impress Me: Dialogue Generation via Mutual Persona Perception [62.89449096369027]
  The research in cognitive science suggests that understanding is an essential signal for a high-quality chit-chat conversation. Motivated by this, we propose P2 Bot, a transmitter-receiver based framework with the aim of explicitly modeling understanding.
  arXiv  Detail & Related papers  (2020-04-11T12:51:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.