Investigating the Role of Explainability and AI Literacy in User Compliance

• URL: http://arxiv.org/abs/2406.12660v1
• Date: Tue, 18 Jun 2024 14:28:12 GMT
• Title: Investigating the Role of Explainability and AI Literacy in User Compliance
• Authors: Niklas Kühl, Christian Meske, Maximilian Nitsche, Jodie Lobana,
• Abstract summary: We find that users' compliance increases with the introduction of XAI but is also affected by AI literacy. We also find that the relationships between AI literacy XAI and users' compliance are mediated by the users' mental model of AI.
• Score: 2.8623940003518156
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: AI is becoming increasingly common across different domains. However, as sophisticated AI-based systems are often black-boxed, rendering the decision-making logic opaque, users find it challenging to comply with their recommendations. Although researchers are investigating Explainable AI (XAI) to increase the transparency of the underlying machine learning models, it is unclear what types of explanations are effective and what other factors increase compliance. To better understand the interplay of these factors, we conducted an experiment with 562 participants who were presented with the recommendations of an AI and two different types of XAI. We find that users' compliance increases with the introduction of XAI but is also affected by AI literacy. We also find that the relationships between AI literacy XAI and users' compliance are mediated by the users' mental model of AI. Our study has several implications for successfully designing AI-based systems utilizing XAI.

Related papers

• Improving Health Professionals' Onboarding with AI and XAI for Trustworthy Human-AI Collaborative Decision Making [3.2381492754749632]
  We present the findings of semi-structured interviews with health professionals and students majoring in medicine and health. For the interviews, we built upon human-AI interaction guidelines to create materials of an AI system for stroke rehabilitation assessment. Our findings reveal that beyond presenting traditional performance metrics on AI, participants desired benchmark information.
  arXiv  Detail & Related papers  (2024-05-26T04:30:17Z)
• Why is plausibility surprisingly problematic as an XAI criterion? [38.0428570713717]
  We conduct the first critical examination of a common XAI criterion: plausibility. It measures how convincing the AI explanation is to humans. We do not recommend using plausibility as a criterion to evaluate or optimize XAI algorithms.
  arXiv  Detail & Related papers  (2023-03-30T20:59:44Z)
• Seamful XAI: Operationalizing Seamful Design in Explainable AI [59.89011292395202]
  Mistakes in AI systems are inevitable, arising from both technical limitations and sociotechnical gaps. We propose that seamful design can foster AI explainability by revealing sociotechnical and infrastructural mismatches. We explore this process with 43 AI practitioners and real end-users.
  arXiv  Detail & Related papers  (2022-11-12T21:54:05Z)
• Connecting Algorithmic Research and Usage Contexts: A Perspective of Contextualized Evaluation for Explainable AI [65.44737844681256]
  A lack of consensus on how to evaluate explainable AI (XAI) hinders the advancement of the field. We argue that one way to close the gap is to develop evaluation methods that account for different user requirements.
  arXiv  Detail & Related papers  (2022-06-22T05:17:33Z)
• Cybertrust: From Explainable to Actionable and Interpretable AI (AI2) [58.981120701284816]
  Actionable and Interpretable AI (AI2) will incorporate explicit quantifications and visualizations of user confidence in AI recommendations. It will allow examining and testing of AI system predictions to establish a basis for trust in the systems' decision making.
  arXiv  Detail & Related papers  (2022-01-26T18:53:09Z)
• On Two XAI Cultures: A Case Study of Non-technical Explanations in Deployed AI System [3.4918511133757977]
  Not much of XAI is comprehensible to non-AI experts, who nonetheless are the primary audience and major stakeholders of deployed AI systems in practice. We advocate that it is critical to develop XAI methods for non-technical audiences. We then present a real-life case study, where AI experts provided non-technical explanations of AI decisions to non-technical stakeholders.
  arXiv  Detail & Related papers  (2021-12-02T07:02:27Z)
• A User-Centred Framework for Explainable Artificial Intelligence in Human-Robot Interaction [70.11080854486953]
  We propose a user-centred framework for XAI that focuses on its social-interactive aspect. The framework aims to provide a structure for interactive XAI solutions thought for non-expert users.
  arXiv  Detail & Related papers  (2021-09-27T09:56:23Z)
• The Who in XAI: How AI Background Shapes Perceptions of AI Explanations [61.49776160925216]
  We conduct a mixed-methods study of how two different groups--people with and without AI background--perceive different types of AI explanations. We find that (1) both groups showed unwarranted faith in numbers for different reasons and (2) each group found value in different explanations beyond their intended design.
  arXiv  Detail & Related papers  (2021-07-28T17:32:04Z)
• Building Bridges: Generative Artworks to Explore AI Ethics [56.058588908294446]
  In recent years, there has been an increased emphasis on understanding and mitigating adverse impacts of artificial intelligence (AI) technologies on society. A significant challenge in the design of ethical AI systems is that there are multiple stakeholders in the AI pipeline, each with their own set of constraints and interests. This position paper outlines some potential ways in which generative artworks can play this role by serving as accessible and powerful educational tools.
  arXiv  Detail & Related papers  (2021-06-25T22:31:55Z)
• The human-AI relationship in decision-making: AI explanation to support people on justifying their decisions [4.169915659794568]
  People need more awareness of how AI works and its outcomes to build a relationship with that system. In decision-making scenarios, people need more awareness of how AI works and its outcomes to build a relationship with that system.
  arXiv  Detail & Related papers  (2021-02-10T14:28:34Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.