Intervenability as a Design Requirement for Autonomy and Oversight within Human-Centered AI

• URL: http://arxiv.org/abs/2607.10322v1
• Date: Sat, 11 Jul 2026 13:56:45 GMT
• Title: Intervenability as a Design Requirement for Autonomy and Oversight within Human-Centered AI
• Abstract summary: New phenomenon is not covered by emergency shutdowns, workarounds, or the reconfiguration of automated systems.<n>Intervenability instantiates the principles of control-lability, autonomy, oversight, and keeping humans in the loop in the context of AI.
• Score: 1.5229257192293195
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Based on the literature and several practical examples of possible AI applica-tions, we outline the concept of intervenability. This new phenomenon is not covered by emergency shutdowns, workarounds, or the reconfiguration of automated systems. Intervenability instantiates the principles of control-lability, autonomy, oversight, and keeping humans in the loop in the context of AI. We provide a taxonomy that encompasses a range of possibilities for intervening activities and differentiates them regarding the mental effort of the users. This taxonomy extends the scope of interventions from real-time control of automated processes to AI-based discrete case-related decision-making. This is in accordance with human-centered AI, which seeks to combine human strengths with the usage of AI. We demonstrate how inter-venability can potentially contribute to the ongoing development of human capabilities on the one hand and to further technical improvement by recon-figuration of AI on the other. Exploring and collaboratively reflecting on the effects of interventions as an integral part of organizational practices is key to enabling this continuous improvement on both sides. Intervenability also provides further momentum for the design of an AI that can help realize in-terventions on its own and advance a smooth transition from intervention to reconfiguration of the AI.

Related papers

• The Boundaries of Automation: A Theory of Persistent Human Participation [107.84677954791773]
  We argue that human participation may persist even with highly capable AI systems.<n>In some activities, the target is not fully specified in advance but instead emerges through the interaction itself.<n>This perspective has important implications for the limits of automation.
  arXiv  Detail & Related papers  (2026-07-23T17:33:43Z)
• Solipsistic Superintelligence is Unlikely to be Cooperative [48.65947679109806]
  We argue that superintelligence, an extremely capable task solver, is unlikely to be cooperative.<n>We call for a non-solipsistic research paradigm that treats interdependence as a core design principle.
  arXiv  Detail & Related papers  (2026-06-02T06:54:55Z)
• From Passive Tool to Socio-cognitive Teammate: A Conceptual Framework for Agentic AI in Human-AI Collaborative Learning [0.0]
  We present a novel conceptual framework that charts the transition from AI as a tool to AI as a collaborative partner.<n>We examine whether an AI, lacking genuine consciousness or shared intentionality, can be considered a true collaborator.<n>This distinction has significant implications for pedagogy, instructional design, and the future research agenda for AI in education.
  arXiv  Detail & Related papers  (2025-08-20T16:17:32Z)
• Explanation-Driven Interventions for Artificial Intelligence Model Customization: Empowering End-Users to Tailor Black-Box AI in Rhinocytology [3.4705962607086973]
  This article presents a novel End-User Development (EUD) approach for black-box AI models.<n>The proposed method advances Human-Centered AI (HCAI), promoting a symbiotic relationship between humans and adaptive, user-tailored AI systems.
  arXiv  Detail & Related papers  (2025-04-07T08:44:48Z)
• The case for delegated AI autonomy for Human AI teaming in healthcare [3.441725960809854]
  We propose an advanced approach to integrating artificial intelligence (AI) into healthcare: autonomous decision support.<n>This approach allows the AI algorithm to act autonomously for a subset of patient cases whilst serving a supportive role in other subsets of patient cases based on defined delegation criteria.<n>It ensures safe handling of patient cases and potentially reduces clinician review time, whilst being mindful of AI tool limitations.
  arXiv  Detail & Related papers  (2025-03-24T15:26:54Z)
• AI Automatons: AI Systems Intended to Imitate Humans [54.19152688545896]
  There is a growing proliferation of AI systems designed to mimic people's behavior, work, abilities, likenesses, or humanness.<n>The research, design, deployment, and availability of such AI systems have prompted growing concerns about a wide range of possible legal, ethical, and other social impacts.
  arXiv  Detail & Related papers  (2025-03-04T03:55:38Z)
• Aligning Generalisation Between Humans and Machines [74.120848518198]
  AI technology can support humans in scientific discovery and forming decisions, but may also disrupt democracies and target individuals.<n>The responsible use of AI and its participation in human-AI teams increasingly shows the need for AI alignment.<n>A crucial yet often overlooked aspect of these interactions is the different ways in which humans and machines generalise.
  arXiv  Detail & Related papers  (2024-11-23T18:36:07Z)
• AI-Driven Human-Autonomy Teaming in Tactical Operations: Proposed Framework, Challenges, and Future Directions [10.16399860867284]
  Artificial Intelligence (AI) techniques are transforming tactical operations by augmenting human decision-making capabilities. This paper explores AI-driven Human-Autonomy Teaming (HAT) as a transformative approach. We propose a comprehensive framework that addresses the key components of AI-driven HAT.
  arXiv  Detail & Related papers  (2024-10-28T15:05:16Z)
• How Performance Pressure Influences AI-Assisted Decision Making [52.997197698288936]
  We show how pressure and explainable AI (XAI) techniques interact with AI advice-taking behavior.<n>Our results show complex interaction effects, with different combinations of pressure and XAI techniques either improving or worsening AI advice taking behavior.
  arXiv  Detail & Related papers  (2024-10-21T22:39:52Z)
• Position: Towards Bidirectional Human-AI Alignment [109.57781720848669]
  We argue that the research community should explicitly define and critically reflect on "alignment" to account for the bidirectional and dynamic relationship between humans and AI.<n>We introduce the Bidirectional Human-AI Alignment framework, which not only incorporates traditional efforts to align AI with human values but also introduces the critical, underexplored dimension of aligning humans with AI.
  arXiv  Detail & Related papers  (2024-06-13T16:03:25Z)
• A Mental-Model Centric Landscape of Human-AI Symbiosis [31.14516396625931]
  We introduce a significantly general version of human-aware AI interaction scheme, called generalized human-aware interaction (GHAI) We will see how this new framework allows us to capture the various works done in the space of human-AI interaction and identify the fundamental behavioral patterns supported by these works.
  arXiv  Detail & Related papers  (2022-02-18T22:08:08Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.