'Team-in-the-loop': Ostrom's IAD framework 'rules in use' to map and measure contextual impacts of AI

• URL: http://arxiv.org/abs/2303.14007v2
• Date: Sun, 30 Jun 2024 19:18:35 GMT
• Title: 'Team-in-the-loop': Ostrom's IAD framework 'rules in use' to map and measure contextual impacts of AI
• Authors: Deborah Morgan, Youmna Hashem, John Francis, Saba Esnaashari, Vincent J. Straub, Jonathan Bright,
• Abstract summary: This article explores how the 'rules in use' from Ostrom's Institutional Analysis and Development Framework (IAD) can be developed as a context analysis approach for AI.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: This article explores how the 'rules in use' from Ostrom's Institutional Analysis and Development Framework (IAD) can be developed as a context analysis approach for AI. AI risk assessment frameworks increasingly highlight the need to understand existing contexts. However, these approaches do not frequently connect with established institutional analysis scholarship. We outline a novel direction illustrated through a high-level example to understand how clinical oversight is potentially impacted by AI. Much current thinking regarding oversight for AI revolves around the idea of decision makers being in-the-loop and, thus, having capacity to intervene to prevent harm. However, our analysis finds that oversight is complex, frequently made by teams of professionals and relies upon explanation to elicit information. Professional bodies and liability also function as institutions of polycentric oversight. These are all impacted by the challenge of oversight of AI systems. The approach outlined has potential utility as a policy tool of context analysis aligned with the 'Govern and Map' functions of the National Institute of Standards and Technology (NIST) AI Risk Management Framework; however, further empirical research is needed. Our analysis illustrates the benefit of existing institutional analysis approaches in foregrounding team structures within oversight and, thus, in conceptions of 'human in the loop'.

Related papers

• Using AI Alignment Theory to understand the potential pitfalls of regulatory frameworks [55.2480439325792]
  This paper critically examines the European Union's Artificial Intelligence Act (EU AI Act) Uses insights from Alignment Theory (AT) research, which focuses on the potential pitfalls of technical alignment in Artificial Intelligence. As we apply these concepts to the EU AI Act, we uncover potential vulnerabilities and areas for improvement in the regulation.
  arXiv  Detail & Related papers  (2024-10-10T17:38:38Z)
• Open Problems in Technical AI Governance [93.89102632003996]
  Technical AI governance refers to technical analysis and tools for supporting the effective governance of AI. This paper is intended as a resource for technical researchers or research funders looking to contribute to AI governance.
  arXiv  Detail & Related papers  (2024-07-20T21:13:56Z)
• Combining AI Control Systems and Human Decision Support via Robustness and Criticality [53.10194953873209]
  We extend a methodology for adversarial explanations (AE) to state-of-the-art reinforcement learning frameworks. We show that the learned AI control system demonstrates robustness against adversarial tampering. In a training / learning framework, this technology can improve both the AI's decisions and explanations through human interaction.
  arXiv  Detail & Related papers  (2024-07-03T15:38:57Z)
• Particip-AI: A Democratic Surveying Framework for Anticipating Future AI Use Cases, Harms and Benefits [54.648819983899614]
  General purpose AI seems to have lowered the barriers for the public to use AI and harness its power. We introduce PARTICIP-AI, a framework for laypeople to speculate and assess AI use cases and their impacts.
  arXiv  Detail & Related papers  (2024-03-21T19:12:37Z)
• Responsible Artificial Intelligence: A Structured Literature Review [0.0]
  The EU has recently issued several publications emphasizing the necessity of trust in AI. This highlights the urgent need for international regulation. This paper introduces a comprehensive and, to our knowledge, the first unified definition of responsible AI.
  arXiv  Detail & Related papers  (2024-03-11T17:01:13Z)
• Responsible AI Considerations in Text Summarization Research: A Review of Current Practices [89.85174013619883]
  We focus on text summarization, a common NLP task largely overlooked by the responsible AI community. We conduct a multi-round qualitative analysis of 333 summarization papers from the ACL Anthology published between 2020-2022. We focus on how, which, and when responsible AI issues are covered, which relevant stakeholders are considered, and mismatches between stated and realized research goals.
  arXiv  Detail & Related papers  (2023-11-18T15:35:36Z)
• A Comprehensive Review and Systematic Analysis of Artificial Intelligence Regulation Policies [1.637145148171519]
  We present a comprehensive review of AI regulation proposals from different geographical locations and cultural backgrounds. We then perform a systematic analysis of these AI regulation proposals to understand how each proposal may fail. This study aims to help governing bodies untangling the AI regulatory chaos through a divide-and-conquer manner.
  arXiv  Detail & Related papers  (2023-07-23T03:44:03Z)
• Explainability in AI Policies: A Critical Review of Communications, Reports, Regulations, and Standards in the EU, US, and UK [1.5039745292757671]
  We perform the first thematic and gap analysis of policies and standards on explainability in the EU, US, and UK. We find that policies are often informed by coarse notions and requirements for explanations. We propose recommendations on how to address explainability in regulations for AI systems.
  arXiv  Detail & Related papers  (2023-04-20T07:53:07Z)
• Tackling problems, harvesting benefits -- A systematic review of the regulatory debate around AI [0.0]
  How to integrate an emerging and all-pervasive technology such as AI into the structures and operations of our society is a question of contemporary politics, science and public debate. This article analyzes the academic debate around the regulation of artificial intelligence (AI) The analysis concentrates on societal risks and harms, questions of regulatory responsibility, and possible adequate policy frameworks.
  arXiv  Detail & Related papers  (2022-09-07T11:29:30Z)
• An interdisciplinary conceptual study of Artificial Intelligence (AI) for helping benefit-risk assessment practices: Towards a comprehensive qualification matrix of AI programs and devices (pre-print 2020) [55.41644538483948]
  This paper proposes a comprehensive analysis of existing concepts coming from different disciplines tackling the notion of intelligence. The aim is to identify shared notions or discrepancies to consider for qualifying AI systems.
  arXiv  Detail & Related papers  (2021-05-07T12:01:31Z)
• Transdisciplinary AI Observatory -- Retrospective Analyses and Future-Oriented Contradistinctions [22.968817032490996]
  This paper motivates the need for an inherently transdisciplinary AI observatory approach. Building on these AI observatory tools, we present near-term transdisciplinary guidelines for AI safety.
  arXiv  Detail & Related papers  (2020-11-26T16:01:49Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.