Automatic Generation of Chatbots for Conversational Web Browsing

• URL: http://arxiv.org/abs/2008.12097v2
• Date: Wed, 21 Oct 2020 10:15:47 GMT
• Title: Automatic Generation of Chatbots for Conversational Web Browsing
• Authors: Pietro Chitt\`o and Marcos Baez and Florian Daniel and Boualem Benatallah
• Abstract summary: We describe the foundations for generating a bot out of a website equipped with simple, bot-specific annotations. The goal is to enable users to use content and functionality accessible through rendered UIs by "talking to websites" instead of by operating the graphical UI using keyboard and mouse.
• Score: 4.994942792036863
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In this paper, we describe the foundations for generating a chatbot out of a website equipped with simple, bot-specific HTML annotations. The approach is part of what we call conversational web browsing, i.e., a dialog-based, natural language interaction with websites. The goal is to enable users to use content and functionality accessible through rendered UIs by "talking to websites" instead of by operating the graphical UI using keyboard and mouse. The chatbot mediates between the user and the website, operates its graphical UI on behalf of the user, and informs the user about the state of interaction. We describe the conceptual vocabulary and annotation format, the supporting conversational middleware and techniques, and the implementation of a demo able to deliver conversational web browsing experiences through Amazon Alexa.

Related papers

• Low-code from frontend to backend: Connecting conversational user interfaces to backend services via a low-code IoT platform [0.0]
  It proposes an architecture with a conversational language as using an IoT (Internet of Things) platform as a backend service. It elaborates and demonstrates how to combine a conversational user interface developed on the open source development platform Rasa with the open source platform Node-RED.
  arXiv  Detail & Related papers  (2024-09-13T07:15:04Z)
• Let's Go Real Talk: Spoken Dialogue Model for Face-to-Face Conversation [55.043492250775294]
  We introduce a novel Face-to-Face spoken dialogue model. It processes audio-visual speech from user input and generates audio-visual speech as the response. We also introduce MultiDialog, the first large-scale multimodal spoken dialogue corpus.
  arXiv  Detail & Related papers  (2024-06-12T04:48:36Z)
• Curriculum-Driven Edubot: A Framework for Developing Language Learning Chatbots Through Synthesizing Conversational Data [23.168347070904318]
  We present Curriculum-Driven EduBot, a framework for developing a chatbots that combines the interactive features of chatbots with the systematic material of English textbooks. We begin by extracting pertinent topics from textbooks and using large language models to generate dialogues related to these topics.
  arXiv  Detail & Related papers  (2023-09-28T19:14:18Z)
• Visual-Aware Text-to-Speech [101.89332968344102]
  We present a new visual-aware text-to-speech (VA-TTS) task to synthesize speech conditioned on both textual inputs and visual feedback of the listener in face-to-face communication. We devise a baseline model to fuse phoneme linguistic information and listener visual signals for speech synthesis.
  arXiv  Detail & Related papers  (2023-06-21T05:11:39Z)
• InternGPT: Solving Vision-Centric Tasks by Interacting with ChatGPT Beyond Language [82.92236977726655]
  InternGPT stands for textbfinteraction, textbfnonverbal, and textbfchatbots. We present an interactive visual framework named InternGPT, or iGPT for short.
  arXiv  Detail & Related papers  (2023-05-09T17:58:34Z)
• FaceChat: An Emotion-Aware Face-to-face Dialogue Framework [58.67608580694849]
  FaceChat is a web-based dialogue framework that enables emotionally-sensitive and face-to-face conversations. System has a wide range of potential applications, including counseling, emotional support, and personalized customer service.
  arXiv  Detail & Related papers  (2023-03-08T20:45:37Z)
• Comparing informativeness of an NLG chatbot vs graphical app in diet-information domain [0.190365714903665]
  We present an NLG chatbots that processes natural language queries and provides insights through a combination of charts and text. We apply it to nutrition, a domain communication quality is critical. We find that the conversational context significantly improved users' understanding of dietary data in various tasks.
  arXiv  Detail & Related papers  (2022-06-23T07:15:58Z)
• Making the case for audience design in conversational AI: Rapport expectations and language ideologies in a task-oriented chatbot [0.0]
  This paper argues that insights into users' language ideologies and their rapport expectations can be used to inform the audience design of the bot's language and interaction patterns. I will define audience design for conversational AI and discuss how user analyses of interactions and socio-linguistically informed theoretical approaches can be used to support audience design.
  arXiv  Detail & Related papers  (2022-06-21T19:21:30Z)
• X2T: Training an X-to-Text Typing Interface with Online Learning from User Feedback [83.95599156217945]
  We focus on assistive typing applications in which a user cannot operate a keyboard, but can supply other inputs. Standard methods train a model on a fixed dataset of user inputs, then deploy a static interface that does not learn from its mistakes. We investigate a simple idea that would enable such interfaces to improve over time, with minimal additional effort from the user.
  arXiv  Detail & Related papers  (2022-03-04T00:07:20Z)
• An Approach to Inference-Driven Dialogue Management within a Social Chatbot [10.760026478889667]
  Instead of framing conversation as a sequence of response generation tasks, we model conversation as a collaborative inference process. Our pipeline accomplishes this modelling in three broad stages. This approach lends itself to understanding latent semantics of user inputs, flexible initiative taking, and responses that are novel and coherent with the dialogue context.
  arXiv  Detail & Related papers  (2021-10-31T19:01:07Z)
• Put Chatbot into Its Interlocutor's Shoes: New Framework to Learn Chatbot Responding with Intention [55.77218465471519]
  This paper proposes an innovative framework to train chatbots to possess human-like intentions. Our framework included a guiding robot and an interlocutor model that plays the role of humans. We examined our framework using three experimental setups and evaluate the guiding robot with four different metrics to demonstrated flexibility and performance advantages.
  arXiv  Detail & Related papers  (2021-03-30T15:24:37Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.