A Framework for Interactive Knowledge-Aided Machine Teaching

• URL: http://arxiv.org/abs/2204.10357v1
• Date: Thu, 21 Apr 2022 18:30:55 GMT
• Title: A Framework for Interactive Knowledge-Aided Machine Teaching
• Authors: Karan Taneja, Harshvardhan Sikka and Ashok Goel
• Abstract summary: We propose a framework for designing Machine Teaching systems. Our preliminary experiments show how MT systems can reduce both human teaching time and machine learner error rate.
• Score: 1.5791732557395555
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Machine Teaching (MT) is an interactive process where humans train a machine learning model by playing the role of a teacher. The process of designing an MT system involves decisions that can impact both efficiency of human teachers and performance of machine learners. Previous research has proposed and evaluated specific MT systems but there is limited discussion on a general framework for designing them. We propose a framework for designing MT systems and also detail a system for the text classification problem as a specific instance. Our framework focuses on three components i.e. teaching interface, machine learner, and knowledge base; and their relations describe how each component can benefit the others. Our preliminary experiments show how MT systems can reduce both human teaching time and machine learner error rate.

Related papers

• AI, Meet Human: Learning Paradigms for Hybrid Decision Making Systems [4.936180840622583]
  Humans are now constantly interacting with machine learning-based systems, training and using models everyday. Several different techniques in computer science literature account for the human interaction with machine learning systems, but their classification is sparse and the goals varied. This survey proposes a taxonomy of Hybrid Decision Making Systems, providing both a conceptual and technical framework for understanding how current computer science literature models interaction between humans and machines.
  arXiv  Detail & Related papers  (2024-02-09T09:54:01Z)
• IMTLab: An Open-Source Platform for Building, Evaluating, and Diagnosing Interactive Machine Translation Systems [94.39110258587887]
  We present IMTLab, an open-source end-to-end interactive machine translation (IMT) system platform. IMTLab treats the whole interactive translation process as a task-oriented dialogue with a human-in-the-loop setting.
  arXiv  Detail & Related papers  (2023-10-17T11:29:04Z)
• Empowering Private Tutoring by Chaining Large Language Models [87.76985829144834]
  This work explores the development of a full-fledged intelligent tutoring system powered by state-of-the-art large language models (LLMs) The system is into three inter-connected core processes-interaction, reflection, and reaction. Each process is implemented by chaining LLM-powered tools along with dynamically updated memory modules.
  arXiv  Detail & Related papers  (2023-09-15T02:42:03Z)
• Human-AI Interaction Design in Machine Teaching [1.5791732557395555]
  The paper builds upon previous work where we proposed an MT framework with three components, viz., the teaching interface, the machine learner, and the knowledge base, and focus on the human-AI interaction design involved in realizing the teaching interface. We outline design decisions that need to be addressed in developing an MT system beginning from an ML task.
  arXiv  Detail & Related papers  (2022-06-10T15:20:05Z)
• MT-Opt: Continuous Multi-Task Robotic Reinforcement Learning at Scale [103.7609761511652]
  We show how a large-scale collective robotic learning system can acquire a repertoire of behaviors simultaneously. New tasks can be continuously instantiated from previously learned tasks. We train and evaluate our system on a set of 12 real-world tasks with data collected from 7 robots.
  arXiv  Detail & Related papers  (2021-04-16T16:38:02Z)
• Towards Teachable Conversational Agents [9.003996147141919]
  We explore the idea of using a conversational interface to investigate the interaction between human-teachers and interactive machine-learners. Results validate the concept of teachable conversational agents and highlight the factors relevant for the development of machine learning systems that intend to learn from conversational interactions.
  arXiv  Detail & Related papers  (2021-02-20T16:56:24Z)
• Intuitiveness in Active Teaching [7.8029610421817654]
  We analyze intuitiveness of certain algorithms when they are actively taught by users. We offer a systematic method to judge the efficacy of human-machine interactions.
  arXiv  Detail & Related papers  (2020-12-25T09:31:56Z)
• Neural Multi-Task Learning for Teacher Question Detection in Online Classrooms [50.19997675066203]
  We build an end-to-end neural framework that automatically detects questions from teachers' audio recordings. By incorporating multi-task learning techniques, we are able to strengthen the understanding of semantic relations among different types of questions.
  arXiv  Detail & Related papers  (2020-05-16T02:17:04Z)
• SOLOIST: Building Task Bots at Scale with Transfer Learning and Machine Teaching [81.45928589522032]
  We parameterize modular task-oriented dialog systems using a Transformer-based auto-regressive language model. We pre-train, on heterogeneous dialog corpora, a task-grounded response generation model. Experiments show that SOLOIST creates new state-of-the-art on well-studied task-oriented dialog benchmarks.
  arXiv  Detail & Related papers  (2020-05-11T17:58:34Z)
• Explainable Active Learning (XAL): An Empirical Study of How Local Explanations Impact Annotator Experience [76.9910678786031]
  We propose a novel paradigm of explainable active learning (XAL), by introducing techniques from the recently surging field of explainable AI (XAI) into an Active Learning setting. Our study shows benefits of AI explanation as interfaces for machine teaching--supporting trust calibration and enabling rich forms of teaching feedback, and potential drawbacks--anchoring effect with the model judgment and cognitive workload.
  arXiv  Detail & Related papers  (2020-01-24T22:52:18Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.