Teaching Robot Policies to Humans Using Erroneous Examples

• URL: http://arxiv.org/abs/2608.29023v1
• Date: Sat, 29 Aug 2026 03:33:23 GMT
• Title: Teaching Robot Policies to Humans Using Erroneous Examples
• Abstract summary: We propose using erroneous examples to teach robot policies.<n>We conduct a user study in which participants view incorrect demonstrations of robot behavior and correct the actions to align with the actual policy.<n>Our findings suggest that viewing these incorrect demonstrations and verbalizing one's reasoning in predicting a robot's actions improves retention of the policy over time.
• Score: 3.0276132192349796
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Human-robot collaboration describes the process of humans and autonomous agents working together to accomplish common goals. This process is facilitated best when robot policies, or behaviors in different situations, are made transparent to humans. Demonstration-based explanations have been a focus of human-robot collaboration research, and the field has frequently drawn upon literature from education to improve how humans are taught robot policies. However, no single teaching method has been proven effective across domains, difficulties, learners, and other variables; the question of how humans can most effectively be taught robot policies remains open. In traditional classrooms, learners are shown erroneous examples, in which they reflect on and correct incorrect responses to understand common pitfalls when learning a concept. We propose using erroneous examples to teach robot policies, extending an existing policy teaching framework. We conduct a user study in which participants view incorrect demonstrations of robot behavior and correct the actions to align with the actual policy. Our findings suggest that viewing these incorrect demonstrations and verbalizing one's reasoning in predicting a robot's actions improves retention of the policy over time, in agreement with the effect of erroneous examples in classrooms. We also categorize participants into distinct learning styles and establish that participants using inverse reinforcement learning-like reasoning perform best on policy prediction tasks. With this work, we aim to advance the methods by which robots educate humans on their policies.

Related papers

• Rethinking the Implications of Human Feedback for Preference Learning in Human-Robot Collaboration [2.8952292379640636]
  In Human-Robot Interaction, the standard approach to learn a reward model that represents human preferences for robot behavior consists of three steps.<n>First, the robot collects limited direct evidence from human feedback (e.g., positive or negative binary feedback)<n>Second, the robot utilizes the direct evidence to infer accepted or rejected labels feasible but unchosen actions using fixed implication rules.<n>Third, the robot updates the reward model with both the direct and derived evidence.
  arXiv  Detail & Related papers  (2026-09-12T14:54:54Z)
• Robot Self-Improvement via Human-Video Dynamics Models [52.14862052988773]
  We show that human videos can be used to learn embodiment-agnostic action, dynamics, and value representations that transfer across robot embodiments.<n>We introduce Dynamics-Guided Action Correction (DGAC), a training-free approach that leverages these adapted models to repair failed states.<n>Results show that human priors and robot failures can be combined to enable scalable autonomous policy improvement.
  arXiv  Detail & Related papers  (2026-06-19T13:17:27Z)
• Generative adversarial imitation learning for robot swarms: Learning from human demonstrations and trained policies [1.4180331276028662]
  In imitation learning, robots are supposed to learn from demonstrations of the desired behavior.<n>In this work, we provide a framework based on generative adversarial imitation learning.<n>We deploy the learned policies on a swarm of TurtleBot 4 robots in real-robot experiments.
  arXiv  Detail & Related papers  (2026-03-03T09:23:30Z)
• Human-Robot Mutual Learning through Affective-Linguistic Interaction and Differential Outcomes Training [Pre-Print] [0.3811184252495269]
  We test how affective-linguistic communication, in combination with differential outcomes training, affects mutual learning in a human-robot context. Taking inspiration from child- caregiver dynamics, our human-robot interaction setup consists of a (simulated) robot attempting to learn how best to communicate internal, homeostatically-controlled needs.
  arXiv  Detail & Related papers  (2024-07-01T13:35:08Z)
• Learning Video-Conditioned Policies for Unseen Manipulation Tasks [83.2240629060453]
  Video-conditioned Policy learning maps human demonstrations of previously unseen tasks to robot manipulation skills. We learn our policy to generate appropriate actions given current scene observations and a video of the target task. We validate our approach on a set of challenging multi-task robot manipulation environments and outperform state of the art.
  arXiv  Detail & Related papers  (2023-05-10T16:25:42Z)
• Aligning Robot and Human Representations [50.070982136315784]
  We argue that current representation learning approaches in robotics should be studied from the perspective of how well they accomplish the objective of representation alignment. We mathematically define the problem, identify its key desiderata, and situate current methods within this formalism.
  arXiv  Detail & Related papers  (2023-02-03T18:59:55Z)
• Learning Reward Functions for Robotic Manipulation by Observing Humans [92.30657414416527]
  We use unlabeled videos of humans solving a wide range of manipulation tasks to learn a task-agnostic reward function for robotic manipulation policies. The learned rewards are based on distances to a goal in an embedding space learned using a time-contrastive objective.
  arXiv  Detail & Related papers  (2022-11-16T16:26:48Z)
• Human-to-Robot Imitation in the Wild [50.49660984318492]
  We propose an efficient one-shot robot learning algorithm, centered around learning from a third-person perspective. We show one-shot generalization and success in real-world settings, including 20 different manipulation tasks in the wild.
  arXiv  Detail & Related papers  (2022-07-19T17:59:59Z)
• Fairness and Bias in Robot Learning [7.517692820105885]
  We present the first survey on fairness in robot learning from an interdisciplinary perspective spanning technical, ethical, and legal challenges. We propose a taxonomy for sources of bias and the resulting types of discrimination due to them. We present early advances in the field by covering different fairness definitions, ethical and legal considerations, and methods for fair robot learning.
  arXiv  Detail & Related papers  (2022-07-07T17:20:15Z)
• Co-GAIL: Learning Diverse Strategies for Human-Robot Collaboration [51.268988527778276]
  We present a method for learning a human-robot collaboration policy from human-human collaboration demonstrations. Our method co-optimizes a human policy and a robot policy in an interactive learning process.
  arXiv  Detail & Related papers  (2021-08-13T03:14:43Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.