Leveraging Large Language Models to Power Chatbots for Collecting User Self-Reported Data

• URL: http://arxiv.org/abs/2301.05843v2
• Date: Fri, 22 Sep 2023 22:33:24 GMT
• Title: Leveraging Large Language Models to Power Chatbots for Collecting User Self-Reported Data
• Authors: Jing Wei, Sungdong Kim, Hyunhoon Jung, Young-Ho Kim
• Abstract summary: Large language models (LLMs) provide a new way to build chatbots by accepting natural language prompts. We explore what design factors of prompts can help steer chatbots to talk naturally and collect data reliably.
• Score: 15.808841433843742
• License: http://creativecommons.org/publicdomain/zero/1.0/
• Abstract: Large language models (LLMs) provide a new way to build chatbots by accepting natural language prompts. Yet, it is unclear how to design prompts to power chatbots to carry on naturalistic conversations while pursuing a given goal, such as collecting self-report data from users. We explore what design factors of prompts can help steer chatbots to talk naturally and collect data reliably. To this aim, we formulated four prompt designs with different structures and personas. Through an online study (N = 48) where participants conversed with chatbots driven by different designs of prompts, we assessed how prompt designs and conversation topics affected the conversation flows and users' perceptions of chatbots. Our chatbots covered 79% of the desired information slots during conversations, and the designs of prompts and topics significantly influenced the conversation flows and the data collection performance. We discuss the opportunities and challenges of building chatbots with LLMs.

Related papers

• LLM Roleplay: Simulating Human-Chatbot Interaction [52.03241266241294]
  We propose a goal-oriented, persona-based method to automatically generate diverse multi-turn dialogues simulating human-chatbot interaction. Our method can simulate human-chatbot dialogues with a high indistinguishability rate.
  arXiv  Detail & Related papers  (2024-07-04T14:49:46Z)
• Multi-Purpose NLP Chatbot : Design, Methodology & Conclusion [0.0]
  This research paper provides a thorough analysis of the chatbots technology environment as it exists today. It provides a very flexible system that makes use of reinforcement learning strategies to improve user interactions and conversational experiences. The complexity of chatbots technology development is also explored in this study, along with the causes that have propelled these developments and their far-reaching effects on a range of sectors.
  arXiv  Detail & Related papers  (2023-10-13T09:47:24Z)
• AutoConv: Automatically Generating Information-seeking Conversations with Large Language Models [74.10293412011455]
  We propose AutoConv for synthetic conversation generation. Specifically, we formulate the conversation generation problem as a language modeling task. We finetune an LLM with a few human conversations to capture the characteristics of the information-seeking process.
  arXiv  Detail & Related papers  (2023-08-12T08:52:40Z)
• PLACES: Prompting Language Models for Social Conversation Synthesis [103.94325597273316]
  We use a small set of expert-written conversations as in-context examples to synthesize a social conversation dataset using prompting. We perform several thorough evaluations of our synthetic conversations compared to human-collected conversations.
  arXiv  Detail & Related papers  (2023-02-07T05:48:16Z)
• Training Conversational Agents with Generative Conversational Networks [74.9941330874663]
  We use Generative Conversational Networks to automatically generate data and train social conversational agents. We evaluate our approach on TopicalChat with automatic metrics and human evaluators, showing that with 10% of seed data it performs close to the baseline that uses 100% of the data.
  arXiv  Detail & Related papers  (2021-10-15T21:46:39Z)
• Few-Shot Bot: Prompt-Based Learning for Dialogue Systems [58.27337673451943]
  Learning to converse using only a few examples is a great challenge in conversational AI. The current best conversational models are either good chit-chatters (e.g., BlenderBot) or goal-oriented systems (e.g., MinTL) We propose prompt-based few-shot learning which does not require gradient-based fine-tuning but instead uses a few examples as the only source of learning.
  arXiv  Detail & Related papers  (2021-10-15T14:36:45Z)
• Put Chatbot into Its Interlocutor's Shoes: New Framework to Learn Chatbot Responding with Intention [55.77218465471519]
  This paper proposes an innovative framework to train chatbots to possess human-like intentions. Our framework included a guiding robot and an interlocutor model that plays the role of humans. We examined our framework using three experimental setups and evaluate the guiding robot with four different metrics to demonstrated flexibility and performance advantages.
  arXiv  Detail & Related papers  (2021-03-30T15:24:37Z)
• An ontology-based chatbot for crises management: use case coronavirus [0.0]
  The project is to create a COVID Assistant to provide the need of up to date information to be available 24 hours. This master thesis is dedicated to discuss COVID Assistant and explain each component in detail.
  arXiv  Detail & Related papers  (2020-11-02T09:30:51Z)
• If I Hear You Correctly: Building and Evaluating Interview Chatbots with Active Listening Skills [4.395837214164745]
  It is challenging to build effective interview chatbots that can handle user free-text responses to open-ended questions. We are investigating the feasibility and effectiveness of using publicly available, practical AI technologies to build effective interview chatbots.
  arXiv  Detail & Related papers  (2020-02-05T16:52:52Z)
• A Scalable Chatbot Platform Leveraging Online Community Posts: A Proof-of-Concept Study [4.623392924486831]
  We verify the feasibility of constructing a data-driven chatbots with processed online community posts by using them as pseudo-conversational data. We argue that chatbots for various purposes can be built extensively through the pipeline exploiting the common structure of community posts.
  arXiv  Detail & Related papers  (2020-01-10T01:45:45Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.