Anticipating User Needs: Insights from Design Fiction on Conversational Agents for Computational Thinking

• URL: http://arxiv.org/abs/2311.06887v2
• Date: Thu, 13 Jun 2024 19:51:08 GMT
• Title: Anticipating User Needs: Insights from Design Fiction on Conversational Agents for Computational Thinking
• Authors: Jacob Penney, João Felipe Pimentel, Igor Steinmacher, Marco A. Gerosa,
• Abstract summary: We envision a conversational agent that guides students stepwise through exercises, tuning its method of guidance with an awareness of the educational background, skills and deficits, and learning preferences. The insights obtained in this paper can guide future implementations of tutoring agents oriented toward teaching computational thinking and computer programming.
• Score: 10.363782876965221
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Computational thinking, and by extension, computer programming, is notoriously challenging to learn. Conversational agents and generative artificial intelligence (genAI) have the potential to facilitate this learning process by offering personalized guidance, interactive learning experiences, and code generation. However, current genAI-based chatbots focus on professional developers and may not adequately consider educational needs. Involving educators in conceiving educational tools is critical for ensuring usefulness and usability. We enlisted nine instructors to engage in design fiction sessions in which we elicited abilities such a conversational agent supported by genAI should display. Participants envisioned a conversational agent that guides students stepwise through exercises, tuning its method of guidance with an awareness of the educational background, skills and deficits, and learning preferences. The insights obtained in this paper can guide future implementations of tutoring conversational agents oriented toward teaching computational thinking and computer programming.

Related papers

• Interactive Dialogue Agents via Reinforcement Learning on Hindsight Regenerations [58.65755268815283]
  Many real dialogues are interactive, meaning an agent's utterances will influence their conversational partner, elicit information, or change their opinion. We use this fact to rewrite and augment existing suboptimal data, and train via offline reinforcement learning (RL) an agent that outperforms both prompting and learning from unaltered human demonstrations. Our results in a user study with real humans show that our approach greatly outperforms existing state-of-the-art dialogue agents.
  arXiv  Detail & Related papers  (2024-11-07T21:37:51Z)
• Towards Educator-Driven Tutor Authoring: Generative AI Approaches for Creating Intelligent Tutor Interfaces [0.31873871499564926]
  We introduce generative AI capabilities to assist educators in creating tutor interfaces. Our approach leverages Large Language Models (LLMs) and prompt engineering to generate tutor layout and contents. A small-scale comparison shows the potential of our approach to enhance the efficiency of tutor interface design.
  arXiv  Detail & Related papers  (2024-05-23T15:46:10Z)
• Real-time Addressee Estimation: Deployment of a Deep-Learning Model on the iCub Robot [52.277579221741746]
  Addressee Estimation is a skill essential for social robots to interact smoothly with humans. Inspired by human perceptual skills, a deep-learning model for Addressee Estimation is designed, trained, and deployed on an iCub robot. The study presents the procedure of such implementation and the performance of the model deployed in real-time human-robot interaction.
  arXiv  Detail & Related papers  (2023-11-09T13:01:21Z)
• Thinking beyond chatbots' threat to education: Visualizations to elucidate the writing and coding process [0.0]
  The landscape of educational practices for teaching and learning languages has been predominantly centered around outcome-driven approaches. The recent accessibility of large language models has thoroughly disrupted these approaches. This work presents a new set of visualization tools to summarize the inherent and taught capabilities of a learner's writing or programming process.
  arXiv  Detail & Related papers  (2023-04-25T22:11:29Z)
• Opportunities and Challenges in Neural Dialog Tutoring [54.07241332881601]
  We rigorously analyze various generative language models on two dialog tutoring datasets for language learning. We find that although current approaches can model tutoring in constrained learning scenarios, they perform poorly in less constrained scenarios. Our human quality evaluation shows that both models and ground-truth annotations exhibit low performance in terms of equitable tutoring.
  arXiv  Detail & Related papers  (2023-01-24T11:00:17Z)
• CHAI: A CHatbot AI for Task-Oriented Dialogue with Offline Reinforcement Learning [85.3987745097806]
  offline reinforcement learning can be used to train dialogue agents entirely using static datasets collected from human speakers. Experiments show that recently developed offline RL methods can be combined with language models to yield realistic dialogue agents.
  arXiv  Detail & Related papers  (2022-04-18T17:43:21Z)
• Teachable Reinforcement Learning via Advice Distillation [161.43457947665073]
  We propose a new supervision paradigm for interactive learning based on "teachable" decision-making systems that learn from structured advice provided by an external teacher. We show that agents that learn from advice can acquire new skills with significantly less human supervision than standard reinforcement learning algorithms.
  arXiv  Detail & Related papers  (2022-03-19T03:22:57Z)
• Improving mathematical questioning in teacher training [1.794107419334178]
  High-fidelity, AI-based simulated classroom systems enable teachers to rehearse effective teaching strategies. This paper builds a text-based interactive conversational agent to help teachers practice mathematical questioning skills.
  arXiv  Detail & Related papers  (2021-12-02T05:33:03Z)
• Towards Teachable Conversational Agents [9.003996147141919]
  We explore the idea of using a conversational interface to investigate the interaction between human-teachers and interactive machine-learners. Results validate the concept of teachable conversational agents and highlight the factors relevant for the development of machine learning systems that intend to learn from conversational interactions.
  arXiv  Detail & Related papers  (2021-02-20T16:56:24Z)
• Teaching Tech to Talk: K-12 Conversational Artificial Intelligence Literacy Curriculum and Development Tools [9.797319790710711]
  We evaluate our Conversational Agent Interface for MIT App Inventor and workshop curriculum with respect to AI competencies. We found students struggled most with the concepts of AI ethics and learning, and recommend emphasizing these topics when teaching.
  arXiv  Detail & Related papers  (2020-09-11T20:52:46Z)
• Explainable Active Learning (XAL): An Empirical Study of How Local Explanations Impact Annotator Experience [76.9910678786031]
  We propose a novel paradigm of explainable active learning (XAL), by introducing techniques from the recently surging field of explainable AI (XAI) into an Active Learning setting. Our study shows benefits of AI explanation as interfaces for machine teaching--supporting trust calibration and enabling rich forms of teaching feedback, and potential drawbacks--anchoring effect with the model judgment and cognitive workload.
  arXiv  Detail & Related papers  (2020-01-24T22:52:18Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.