Human-AI Interaction Design in Machine Teaching

• URL: http://arxiv.org/abs/2206.05182v1
• Date: Fri, 10 Jun 2022 15:20:05 GMT
• Title: Human-AI Interaction Design in Machine Teaching
• Authors: Karan Taneja, Harshvardhan Sikka and Ashok Goel
• Abstract summary: The paper builds upon previous work where we proposed an MT framework with three components, viz., the teaching interface, the machine learner, and the knowledge base, and focus on the human-AI interaction design involved in realizing the teaching interface. We outline design decisions that need to be addressed in developing an MT system beginning from an ML task.
• Score: 1.5791732557395555
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Machine Teaching (MT) is an interactive process where a human and a machine interact with the goal of training a machine learning model (ML) for a specified task. The human teacher communicates their task expertise and the machine student gathers the required data and knowledge to produce an ML model. MT systems are developed to jointly minimize the time spent on teaching and the learner's error rate. The design of human-AI interaction in an MT system not only impacts the teaching efficiency, but also indirectly influences the ML performance by affecting the teaching quality. In this paper, we build upon our previous work where we proposed an MT framework with three components, viz., the teaching interface, the machine learner, and the knowledge base, and focus on the human-AI interaction design involved in realizing the teaching interface. We outline design decisions that need to be addressed in developing an MT system beginning from an ML task. The paper follows the Socratic method entailing a dialogue between a curious student and a wise teacher.

Related papers

• A look under the hood of the Interactive Deep Learning Enterprise (No-IDLE) [2.7719338074999538]
  No-IDLE aims to increase the reach of interactive deep learning solutions for non-experts in machine learning. One of the key innovations described in this technical report is a methodology for interactive machine learning combined with multimodal interaction.
  arXiv  Detail & Related papers  (2024-06-27T10:01:56Z)
• Mastering Robot Manipulation with Multimodal Prompts through Pretraining and Multi-task Fine-tuning [49.92517970237088]
  We tackle the problem of training a robot to understand multimodal prompts. This type of task poses a major challenge to robots' capability to understand the interconnection and complementarity between vision and language signals. We introduce an effective framework that learns a policy to perform robot manipulation with multimodal prompts.
  arXiv  Detail & Related papers  (2023-10-14T22:24:58Z)
• Empowering Private Tutoring by Chaining Large Language Models [87.76985829144834]
  This work explores the development of a full-fledged intelligent tutoring system powered by state-of-the-art large language models (LLMs) The system is into three inter-connected core processes-interaction, reflection, and reaction. Each process is implemented by chaining LLM-powered tools along with dynamically updated memory modules.
  arXiv  Detail & Related papers  (2023-09-15T02:42:03Z)
• ML-Based Teaching Systems: A Conceptual Framework [0.0]
  We investigate the potential of machine learning (ML) models to facilitate knowledge transfer in an organizational context. We examine key concepts, themes, and dimensions to better understand and design ML-based teaching systems.
  arXiv  Detail & Related papers  (2023-05-12T09:55:34Z)
• A Framework for Interactive Knowledge-Aided Machine Teaching [1.5791732557395555]
  We propose a framework for designing Machine Teaching systems. Our preliminary experiments show how MT systems can reduce both human teaching time and machine learner error rate.
  arXiv  Detail & Related papers  (2022-04-21T18:30:55Z)
• Self-directed Machine Learning [86.3709575146414]
  In education science, self-directed learning has been shown to be more effective than passive teacher-guided learning. We introduce the principal concept of Self-directed Machine Learning (SDML) and propose a framework for SDML. Our proposed SDML process benefits from self task selection, self data selection, self model selection, self optimization strategy selection and self evaluation metric selection.
  arXiv  Detail & Related papers  (2022-01-04T18:32:06Z)
• Iterative Teacher-Aware Learning [136.05341445369265]
  In human pedagogy, teachers and students can interact adaptively to maximize communication efficiency. We propose a gradient optimization based teacher-aware learner who can incorporate teacher's cooperative intention into the likelihood function.
  arXiv  Detail & Related papers  (2021-10-01T00:27:47Z)
• Towards Teachable Conversational Agents [9.003996147141919]
  We explore the idea of using a conversational interface to investigate the interaction between human-teachers and interactive machine-learners. Results validate the concept of teachable conversational agents and highlight the factors relevant for the development of machine learning systems that intend to learn from conversational interactions.
  arXiv  Detail & Related papers  (2021-02-20T16:56:24Z)
• SOLOIST: Building Task Bots at Scale with Transfer Learning and Machine Teaching [81.45928589522032]
  We parameterize modular task-oriented dialog systems using a Transformer-based auto-regressive language model. We pre-train, on heterogeneous dialog corpora, a task-grounded response generation model. Experiments show that SOLOIST creates new state-of-the-art on well-studied task-oriented dialog benchmarks.
  arXiv  Detail & Related papers  (2020-05-11T17:58:34Z)
• Explainable Active Learning (XAL): An Empirical Study of How Local Explanations Impact Annotator Experience [76.9910678786031]
  We propose a novel paradigm of explainable active learning (XAL), by introducing techniques from the recently surging field of explainable AI (XAI) into an Active Learning setting. Our study shows benefits of AI explanation as interfaces for machine teaching--supporting trust calibration and enabling rich forms of teaching feedback, and potential drawbacks--anchoring effect with the model judgment and cognitive workload.
  arXiv  Detail & Related papers  (2020-01-24T22:52:18Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.