Impact of Different Failures on a Robot's Perceived Reliability

• URL: http://arxiv.org/abs/2603.08821v1
• Date: Mon, 09 Mar 2026 18:27:53 GMT
• Title: Impact of Different Failures on a Robot's Perceived Reliability
• Abstract summary: We examine how various kinds of failures affect the robot's perceived reliability (PR)<n>We show that successes immediately following a failure have the same effect on PR as successes without a preceding failure.<n>Our findings highlight which robot failures are in higher need of repair in a human-robot interaction, and how trust could be recovered by robot successes.
• Score: 9.607560620828718
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Robots fail, potentially leading to a loss in the robot's perceived reliability (PR), a measure correlated with trustworthiness. In this study we examine how various kinds of failures affect the PR of the robot differently, and how this measure recovers without explicit social repair actions by the robot. In a preregistered and controlled online video study, participants were asked to predict a robot's success in a pick-and-place task. We examined manipulation failures (slips), freezing (lapses), and three types of incorrect picked objects or place goals (mistakes). Participants were shown one of 11 videos -- one of five types of failure, one of five types of failure followed by a successful execution in the same video, or a successful execution video. This was followed by two additional successful execution videos. Participants bet money either on the robot or on a coin toss after each video. People's betting patterns along with a qualitative analysis of their survey responses highlight that mistakes are less damaging to PR than slips or lapses, and some mistakes are even perceived as successes. We also see that successes immediately following a failure have the same effect on PR as successes without a preceding failure. Finally, we show that successful executions recover PR after a failure. Our findings highlight which robot failures are in higher need of repair in a human-robot interaction, and how trust could be recovered by robot successes.

Related papers

• LIBERO-RECOVER: Beyond Task Success Towards Failure Recovery in Robotic Manipulation Models [48.57715789642472]
  We introduce LIBERO-Recover Benchmark, a large scale benchmark for failure recovery in robotic manipulation.<n>We collect real execution failures from SOTA embodied models and construct 1,000+ scenarios across four recovery levels.<n>We evaluate four core capabilities: spatial understanding, object structure reasoning, interaction understanding, and topological reasoning.
  arXiv  Detail & Related papers  (2026-09-04T14:15:27Z)
• Dream2Reward: Transition-Alignment Reward Models from Positive Demonstrations for Robotic Manipulation [51.43645327777772]
  We introduce Dream2Reward, which learns a language-conditioned successful latent transition field from positive demonstrations.<n>It penalizes wrong-direction, overshooting, and stagnant motion even when the resulting observation appears to show progress.<n>Across online and offline policy learning, the same frozen reward model reduces reward hacking and supports stronger downstream performance.
  arXiv  Detail & Related papers  (2026-08-19T10:44:20Z)
• Robot Critics that Sweat the Small Stuff [44.13358184052461]
  We introduce a method to fine-tune critics by constructing pairwise progress supervision using success and failure rollouts obtained from a policy.<n>Our critic excels at fine-grained progress reasoning and subtle failure detection, outperforming prior progress reasoning baselines.
  arXiv  Detail & Related papers  (2026-06-19T16:14:12Z)
• Robot Self-Improvement via Human-Video Dynamics Models [52.14862052988773]
  We show that human videos can be used to learn embodiment-agnostic action, dynamics, and value representations that transfer across robot embodiments.<n>We introduce Dynamics-Guided Action Correction (DGAC), a training-free approach that leverages these adapted models to repair failed states.<n>Results show that human priors and robot failures can be combined to enable scalable autonomous policy improvement.
  arXiv  Detail & Related papers  (2026-06-19T13:17:27Z)
• How Visible Are Silent Manipulation Failures? An Observability Study of False-Success Detection in Simulated Robot Episodes [0.0]
  Imitation-learning policies for robot manipulation inherit the quality of the success labels attached to their training episodes.<n>A particularly damaging error is the false success: an episode the robot logs as a success when the task outcome was actually wrong.<n>We build a simulated testbed on two bimanual ALOHA tasks, induce failures through environment perturbations rather than label edits, label every episode by privileged simulator state that the detector never sees, and keep only episodes the robot flagged as successful.
  arXiv  Detail & Related papers  (2026-06-02T04:22:13Z)
• RoboReward: General-Purpose Vision-Language Reward Models for Robotics [124.34685604054312]
  Vision-language models (VLMs) have shown promise as automatic reward models, yet their effectiveness on real robot tasks is poorly understood.<n>We aim to close this gap by introducing RoboReward, a robotics reward dataset and benchmark built on large-scale real-robot corpora.
  arXiv  Detail & Related papers  (2026-01-02T12:47:34Z)
• H2R-Grounder: A Paired-Data-Free Paradigm for Translating Human Interaction Videos into Physically Grounded Robot Videos [58.006918399913665]
  We propose a video-to-video translation framework that converts ordinary human-object interaction videos into motion-consistent robot manipulation videos.<n>Our approach does not require any paired human-robot videos for training only a set of unpaired robot videos, making the system easy to scale.<n>At test time, we apply the same process to human videos (inpainting the person and overlaying human pose cues) and generate high-quality robot videos that mimic the human's actions.
  arXiv  Detail & Related papers  (2025-12-10T07:59:45Z)
• Guardian: Detecting Robotic Planning and Execution Errors with Vision-Language Models [53.20969621498248]
  We propose an automatic robot failure synthesis approach that procedurally perturbs successful trajectories to generate diverse planning and execution failures.<n>We construct three new failure detection benchmarks: RLBench-Fail, BridgeDataV2-Fail, and UR5-Fail.<n>We then train Guardian, a VLM with multi-view images for detailed failure reasoning and detection.
  arXiv  Detail & Related papers  (2025-12-01T17:57:27Z)
• Training Models to Detect Successive Robot Errors from Human Reactions [11.790205457987488]
  This research uses machine learning to recognize stages of robot failure from human reactions.<n>In a study with 26 participants interacting with a robot that made repeated conversational errors, behavioral features were extracted from video data to train models.<n>The best model achieved 93.5% accuracy for detecting errors and 84.1% for classifying successive failures.
  arXiv  Detail & Related papers  (2025-10-10T07:25:44Z)
• Giving Robots a Hand: Learning Generalizable Manipulation with Eye-in-Hand Human Video Demonstrations [66.47064743686953]
  Eye-in-hand cameras have shown promise in enabling greater sample efficiency and generalization in vision-based robotic manipulation. Videos of humans performing tasks, on the other hand, are much cheaper to collect since they eliminate the need for expertise in robotic teleoperation. In this work, we augment narrow robotic imitation datasets with broad unlabeled human video demonstrations to greatly enhance the generalization of eye-in-hand visuomotor policies.
  arXiv  Detail & Related papers  (2023-07-12T07:04:53Z)
• Learning Reward Functions for Robotic Manipulation by Observing Humans [92.30657414416527]
  We use unlabeled videos of humans solving a wide range of manipulation tasks to learn a task-agnostic reward function for robotic manipulation policies. The learned rewards are based on distances to a goal in an embedding space learned using a time-contrastive objective.
  arXiv  Detail & Related papers  (2022-11-16T16:26:48Z)
• Revisiting the Adversarial Robustness-Accuracy Tradeoff in Robot Learning [121.9708998627352]
  Recent work has shown that, in practical robot learning applications, the effects of adversarial training do not pose a fair trade-off. This work revisits the robustness-accuracy trade-off in robot learning by analyzing if recent advances in robust training methods and theory can make adversarial training suitable for real-world robot applications.
  arXiv  Detail & Related papers  (2022-04-15T08:12:15Z)
• Why did I fail? A Causal-based Method to Find Explanations for Robot Failures [0.17132914341329847]
  The ability of robots to explain such failures is paramount for interacting with humans to increase trust and transparency. To achieve this skill, the main challenges addressed in this paper are I) acquiring enough data to learn a cause-effect model of the environment and II) generating causal explanations based on that model. We propose a novel method that enables robots to generate contrastive explanations upon task failures.
  arXiv  Detail & Related papers  (2022-04-09T14:35:43Z)
• Impact of Explanation on Trust of a Novel Mobile Robot [1.603423221531441]
  The presence of an explanation of expected robot behavior affected a supervisor's trust in an autonomous robot. We measured trust both subjectively through surveys and objectively through a dual-task experiment design.
  arXiv  Detail & Related papers  (2021-01-26T14:36:26Z)
• Fault-Aware Robust Control via Adversarial Reinforcement Learning [35.16413579212691]
  We propose an adversarial reinforcement learning framework, which significantly increases robot fragility over joint damage cases. We validate our algorithm on a three-fingered robot hand and a quadruped robot. Our algorithm can be trained only in simulation and directly deployed on a real robot without any fine-tuning.
  arXiv  Detail & Related papers  (2020-11-17T16:01:06Z)
• Reasons People Want Explanations After Unrecoverable Pre-Handover Failures [3.584314460614721]
  We analyze the reasons why people want explanations in a handover scenario where a robot cannot possess the object. Results suggest that participants set expectations on their request and that a robot should provide explanations rather than non-verbal cues after failing.
  arXiv  Detail & Related papers  (2020-10-05T18:37:23Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.