Operationalising AI governance through ethics-based auditing: An industry case study

• URL: http://arxiv.org/abs/2407.06232v1
• Date: Sun, 7 Jul 2024 12:22:38 GMT
• Title: Operationalising AI governance through ethics-based auditing: An industry case study
• Authors: Jakob Mokander, Luciano Floridi,
• Abstract summary: Ethics based auditing (EBA) is a structured process whereby an entitys past or present behaviour is assessed for consistency with moral principles or norms. This article provides a detailed description of the organisational context in which EBA procedures must be integrated to be feasible and effective.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Ethics based auditing (EBA) is a structured process whereby an entitys past or present behaviour is assessed for consistency with moral principles or norms. Recently, EBA has attracted much attention as a governance mechanism that may bridge the gap between principles and practice in AI ethics. However, important aspects of EBA (such as the feasibility and effectiveness of different auditing procedures) have yet to be substantiated by empirical research. In this article, we address this knowledge gap by providing insights from a longitudinal industry case study. Over 12 months, we observed and analysed the internal activities of AstraZeneca, a biopharmaceutical company, as it prepared for and underwent an ethics-based AI audit. While previous literature concerning EBA has focused on proposing evaluation metrics or visualisation techniques, our findings suggest that the main difficulties large multinational organisations face when conducting EBA mirror classical governance challenges. These include ensuring harmonised standards across decentralised organisations, demarcating the scope of the audit, driving internal communication and change management, and measuring actual outcomes. The case study presented in this article contributes to the existing literature by providing a detailed description of the organisational context in which EBA procedures must be integrated to be feasible and effective.

Related papers

• Using AI Alignment Theory to understand the potential pitfalls of regulatory frameworks [55.2480439325792]
  This paper critically examines the European Union's Artificial Intelligence Act (EU AI Act) Uses insights from Alignment Theory (AT) research, which focuses on the potential pitfalls of technical alignment in Artificial Intelligence. As we apply these concepts to the EU AI Act, we uncover potential vulnerabilities and areas for improvement in the regulation.
  arXiv  Detail & Related papers  (2024-10-10T17:38:38Z)
• Ethical and Scalable Automation: A Governance and Compliance Framework for Business Applications [0.0]
  This paper introduces a framework ensuring that AI must be ethical, controllable, viable, and desirable. Different case studies validate this framework by integrating AI in both academic and practical environments.
  arXiv  Detail & Related papers  (2024-09-25T12:39:28Z)
• Open Problems in Technical AI Governance [93.89102632003996]
  Technical AI governance refers to technical analysis and tools for supporting the effective governance of AI. This paper is intended as a resource for technical researchers or research funders looking to contribute to AI governance.
  arXiv  Detail & Related papers  (2024-07-20T21:13:56Z)
• Auditing of AI: Legal, Ethical and Technical Approaches [0.0]
  AI auditing is a rapidly growing field of research and practice. Different approaches to AI auditing have different affordances and constraints. The next step in the evolution of auditing as an AI governance mechanism should be the interlinking of these available approaches.
  arXiv  Detail & Related papers  (2024-07-07T12:49:58Z)
• AI auditing: The Broken Bus on the Road to AI Accountability [1.9758196889515185]
  "AI audit" ecosystem is muddled and imprecise, making it difficult to work through various concepts and map out the stakeholders involved in the practice. First, we taxonomize current AI audit practices as completed by regulators, law firms, civil society, journalism, academia, consulting agencies. We find that only a subset of AI audit studies translate to desired accountability outcomes.
  arXiv  Detail & Related papers  (2024-01-25T19:00:29Z)
• Towards Responsible AI in Banking: Addressing Bias for Fair Decision-Making [69.44075077934914]
  "Responsible AI" emphasizes the critical nature of addressing biases within the development of a corporate culture. This thesis is structured around three fundamental pillars: understanding bias, mitigating bias, and accounting for bias. In line with open-source principles, we have released Bias On Demand and FairView as accessible Python packages.
  arXiv  Detail & Related papers  (2024-01-13T14:07:09Z)
• Responsible AI Considerations in Text Summarization Research: A Review of Current Practices [89.85174013619883]
  We focus on text summarization, a common NLP task largely overlooked by the responsible AI community. We conduct a multi-round qualitative analysis of 333 summarization papers from the ACL Anthology published between 2020-2022. We focus on how, which, and when responsible AI issues are covered, which relevant stakeholders are considered, and mismatches between stated and realized research goals.
  arXiv  Detail & Related papers  (2023-11-18T15:35:36Z)
• Towards a multi-stakeholder value-based assessment framework for algorithmic systems [76.79703106646967]
  We develop a value-based assessment framework that visualizes closeness and tensions between values. We give guidelines on how to operationalize them, while opening up the evaluation and deliberation process to a wide range of stakeholders.
  arXiv  Detail & Related papers  (2022-05-09T19:28:32Z)
• An Uncommon Task: Participatory Design in Legal AI [64.54460979588075]
  We examine a notable yet understudied AI design process in the legal domain that took place over a decade ago. We show how an interactive simulation methodology allowed computer scientists and lawyers to become co-designers.
  arXiv  Detail & Related papers  (2022-03-08T15:46:52Z)
• Ethics-Based Auditing of Automated Decision-Making Systems: Intervention Points and Policy Implications [0.0]
  This article outlines the conditions under which ethics-based auditing (EBA) procedures can be feasible and effective in practice. We frame ADMS as parts of larger socio-technical systems to demonstrate that to be feasible and effective, EBA procedures must link to intervention points.
  arXiv  Detail & Related papers  (2021-11-08T10:57:26Z)
• Ethics-Based Auditing of Automated Decision-Making Systems: Nature, Scope, and Limitations [1.2599533416395765]
  Delegating tasks to automated decision-making systems (ADMS) can improve efficiency and enable new solutions. For example, ADMS may produce discriminatory outcomes, violate individual privacy, and undermine human self-determination. New governance mechanisms are thus needed that help organisations design and deploy ADMS in ways that are ethical.
  arXiv  Detail & Related papers  (2021-10-21T08:51:28Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.