Effective Explanations for Belief-Desire-Intention Robots: When and What to Explain

• URL: http://arxiv.org/abs/2507.02016v1
• Date: Wed, 02 Jul 2025 12:02:07 GMT
• Title: Effective Explanations for Belief-Desire-Intention Robots: When and What to Explain
• Authors: Cong Wang, Roberto Calandra, Verena Klös,
• Abstract summary: Explanations of the robot's reasoning process can help users to understand the robot intentions.<n>We have investigated user preferences for explanation demand and content for a robot that helps with daily cleaning tasks in a kitchen.<n>We propose two algorithms to identify surprising actions and to construct effective explanations for Belief-Desire-Intention (BDI) robots.
• Score: 7.509941298829417
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: When robots perform complex and context-dependent tasks in our daily lives, deviations from expectations can confuse users. Explanations of the robot's reasoning process can help users to understand the robot intentions. However, when to provide explanations and what they contain are important to avoid user annoyance. We have investigated user preferences for explanation demand and content for a robot that helps with daily cleaning tasks in a kitchen. Our results show that users want explanations in surprising situations and prefer concise explanations that clearly state the intention behind the confusing action and the contextual factors that were relevant to this decision. Based on these findings, we propose two algorithms to identify surprising actions and to construct effective explanations for Belief-Desire-Intention (BDI) robots. Our algorithms can be easily integrated in the BDI reasoning process and pave the way for better human-robot interaction with context- and user-specific explanations.

Related papers

• Learning Object Properties Using Robot Proprioception via Differentiable Robot-Object Interaction [52.12746368727368]
  Differentiable simulation has become a powerful tool for system identification.<n>Our approach calibrates object properties by using information from the robot, without relying on data from the object itself.<n>We demonstrate the effectiveness of our method on a low-cost robotic platform.
  arXiv  Detail & Related papers  (2024-10-04T20:48:38Z)
• Evaluating the Utility of Model Explanations for Model Development [54.23538543168767]
  We evaluate whether explanations can improve human decision-making in practical scenarios of machine learning model development. To our surprise, we did not find evidence of significant improvement on tasks when users were provided with any of the saliency maps. These findings suggest caution regarding the usefulness and potential for misunderstanding in saliency-based explanations.
  arXiv  Detail & Related papers  (2023-12-10T23:13:23Z)
• Robots with Different Embodiments Can Express and Influence Carefulness in Object Manipulation [104.5440430194206]
  This work investigates the perception of object manipulations performed with a communicative intent by two robots. We designed the robots' movements to communicate carefulness or not during the transportation of objects.
  arXiv  Detail & Related papers  (2022-08-03T13:26:52Z)
• Evaluating Human-like Explanations for Robot Actions in Reinforcement Learning Scenarios [1.671353192305391]
  We make use of human-like explanations built from the probability of success to complete the goal that an autonomous robot shows after performing an action. These explanations are intended to be understood by people who have no or very little experience with artificial intelligence methods.
  arXiv  Detail & Related papers  (2022-07-07T10:40:24Z)
• Understanding a Robot's Guiding Ethical Principles via Automatically Generated Explanations [4.393037165265444]
  We build upon an existing ethical framework to allow users to make suggestions about plans and receive automatically generated contrastive explanations. Results of a user study indicate that the generated explanations help humans to understand the ethical principles that underlie a robot's plan.
  arXiv  Detail & Related papers  (2022-06-20T22:55:00Z)
• The Who in XAI: How AI Background Shapes Perceptions of AI Explanations [61.49776160925216]
  We conduct a mixed-methods study of how two different groups--people with and without AI background--perceive different types of AI explanations. We find that (1) both groups showed unwarranted faith in numbers for different reasons and (2) each group found value in different explanations beyond their intended design.
  arXiv  Detail & Related papers  (2021-07-28T17:32:04Z)
• Explainable AI for Robot Failures: Generating Explanations that Improve User Assistance in Fault Recovery [19.56670862587773]
  We introduce a new type of explanation, that explains the cause of an unexpected failure during an agent's plan execution to non-experts. We investigate how such explanations can be autonomously generated, extending an existing encoder-decoder model.
  arXiv  Detail & Related papers  (2021-01-05T16:16:39Z)
• A Knowledge Driven Approach to Adaptive Assistance Using Preference Reasoning and Explanation [3.8673630752805432]
  We propose the robot uses Analogical Theory of Mind to infer what the user is trying to do. If the user is unsure or confused, the robot provides the user with an explanation.
  arXiv  Detail & Related papers  (2020-12-05T00:18:43Z)
• Projection Mapping Implementation: Enabling Direct Externalization of Perception Results and Action Intent to Improve Robot Explainability [62.03014078810652]
  Existing research on non-verbal cues, e.g., eye gaze or arm movement, may not accurately present a robot's internal states. Projecting the states directly onto a robot's operating environment has the advantages of being direct, accurate, and more salient.
  arXiv  Detail & Related papers  (2020-10-05T18:16:20Z)
• Joint Inference of States, Robot Knowledge, and Human (False-)Beliefs [90.20235972293801]
  Aiming to understand how human (false-temporal)-belief-a core socio-cognitive ability unify-would affect human interactions with robots, this paper proposes to adopt a graphical model to the representation of object states, robot knowledge, and human (false-)beliefs. An inference algorithm is derived to fuse individual pg from all robots across multi-views into a joint pg, which affords more effective reasoning inference capability to overcome the errors originated from a single view.
  arXiv  Detail & Related papers  (2020-04-25T23:02:04Z)
• Towards Transparent Robotic Planning via Contrastive Explanations [1.7231251035416644]
  We formalize the notion of contrastive explanations for robotic planning policies based on Markov decision processes. We present methods for the automated generation of contrastive explanations with three key factors: selectiveness, constrictiveness, and responsibility.
  arXiv  Detail & Related papers  (2020-03-16T19:44:31Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.