Convo: What does conversational programming need? An exploration of machine learning interface design

• URL: http://arxiv.org/abs/2003.01318v1
• Date: Tue, 3 Mar 2020 03:39:37 GMT
• Title: Convo: What does conversational programming need? An exploration of machine learning interface design
• Authors: Jessica Van Brummelen, Kevin Weng, Phoebe Lin, Catherine Yeo
• Abstract summary: We compare different input methods to a conversational programming system we developed. participants completed novice and advanced tasks using voice-based, text-based, and voice-or-text-based systems. Results show that future conversational programming tools should be tailored to users' programming experience.
• Score: 8.831954614241232
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Vast improvements in natural language understanding and speech recognition have paved the way for conversational interaction with computers. While conversational agents have often been used for short goal-oriented dialog, we know little about agents for developing computer programs. To explore the utility of natural language for programming, we conducted a study ($n$=45) comparing different input methods to a conversational programming system we developed. Participants completed novice and advanced tasks using voice-based, text-based, and voice-or-text-based systems. We found that users appreciated aspects of each system (e.g., voice-input efficiency, text-input precision) and that novice users were more optimistic about programming using voice-input than advanced users. Our results show that future conversational programming tools should be tailored to users' programming experience and allow users to choose their preferred input mode. To reduce cognitive load, future interfaces can incorporate visualizations and possess custom natural language understanding and speech recognition models for programming.

Related papers

• WavChat: A Survey of Spoken Dialogue Models [66.82775211793547]
  Recent advancements in spoken dialogue models, exemplified by systems like GPT-4o, have captured significant attention in the speech domain. These advanced spoken dialogue models not only comprehend audio, music, and other speech-related features, but also capture stylistic and timbral characteristics in speech. Despite the progress in spoken dialogue systems, there is a lack of comprehensive surveys that systematically organize and analyze these systems.
  arXiv  Detail & Related papers  (2024-11-15T04:16:45Z)
• A Transformer-Based Multi-Stream Approach for Isolated Iranian Sign Language Recognition [0.0]
  This research aims to recognize Iranian Sign Language words with the help of the latest deep learning tools such as transformers. The dataset used includes 101 Iranian Sign Language words frequently used in academic environments such as universities.
  arXiv  Detail & Related papers  (2024-06-27T06:54:25Z)
• PwR: Exploring the Role of Representations in Conversational Programming [17.838776812138626]
  We introduce Programming with Representations (PwR), an approach that uses representations to convey the system's understanding back to the user in natural language. We find that representations significantly improve understandability, and instilled a sense of agency among our participants.
  arXiv  Detail & Related papers  (2023-09-18T05:38:23Z)
• ChatDev: Communicative Agents for Software Development [84.90400377131962]
  ChatDev is a chat-powered software development framework in which specialized agents are guided in what to communicate. These agents actively contribute to the design, coding, and testing phases through unified language-based communication.
  arXiv  Detail & Related papers  (2023-07-16T02:11:34Z)
• User Adaptive Language Learning Chatbots with a Curriculum [55.63893493019025]
  We adapt lexically constrained decoding to a dialog system, which urges the dialog system to include curriculum-aligned words and phrases in its generated utterances. The evaluation result demonstrates that the dialog system with curriculum infusion improves students' understanding of target words and increases their interest in practicing English.
  arXiv  Detail & Related papers  (2023-04-11T20:41:41Z)
• PADL: Language-Directed Physics-Based Character Control [66.517142635815]
  We present PADL, which allows users to issue natural language commands for specifying high-level tasks and low-level skills that a character should perform. We show that our framework can be applied to effectively direct a simulated humanoid character to perform a diverse array of complex motor skills.
  arXiv  Detail & Related papers  (2023-01-31T18:59:22Z)
• A Case Study in Engineering a Conversational Programming Assistant's Persona [72.47187215119664]
  Conversational capability was achieved by using an existing code-fluent Large Language Model. A discussion of the evolution of the prompt provides a case study in how to coax an existing foundation model to behave in a desirable manner for a particular application.
  arXiv  Detail & Related papers  (2023-01-13T14:48:47Z)
• Programming by Example and Text-to-Code Translation for Conversational Code Generation [1.8447697408534178]
  We propose a method for integrating Programming by Example and text-to-code systems. MPaTHS offers an accessible natural language interface for synthesizing general programs. We present a program representation that allows our method to be applied to the problem of task-oriented dialogue.
  arXiv  Detail & Related papers  (2022-11-21T15:20:45Z)
• Lifelong and Continual Learning Dialogue Systems [14.965054800464259]
  Book introduces the new paradigm of lifelong learning dialogue systems. As the systems chat more and more with users or learn more from external sources, they become more knowledgeable and better at conversing.
  arXiv  Detail & Related papers  (2022-11-12T02:39:41Z)
• Using Chatbots to Teach Languages [43.866863322607216]
  Our system can adapt to users' language proficiency on the fly. We provide automatic grammar error feedback to help users learn from their mistakes. Our next step is to make our system more adaptive to user profile information by using reinforcement learning algorithms.
  arXiv  Detail & Related papers  (2022-07-31T07:01:35Z)
• A Conversational Paradigm for Program Synthesis [110.94409515865867]
  We propose a conversational program synthesis approach via large language models. We train a family of large language models, called CodeGen, on natural language and programming language data. Our findings show the emergence of conversational capabilities and the effectiveness of the proposed conversational program synthesis paradigm.
  arXiv  Detail & Related papers  (2022-03-25T06:55:15Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.