Specifying the Delegated-Autonomy Boundary: Requirements Engineering for Agentic AI

• URL: http://arxiv.org/abs/2607.17225v1
• Date: Sun, 19 Jul 2026 12:27:39 GMT
• Title: Specifying the Delegated-Autonomy Boundary: Requirements Engineering for Agentic AI
• Abstract summary: Agentic AI systems plan, maintain state, and act in external environments with varying degrees of autonomy.<n>Current practices bury these decisions inside prompts, tool schemas, and runtime policies, even though they are requirements-level commitments.<n>This paper proposes two complementary artifacts: an Agency Justification Record and an Agentic Delegation Policy.
• Score: 5.421928928336395
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Agentic AI systems do not just predict or recommend; they plan, maintain state, and act in external environments with varying degrees of autonomy. This changes the requirements engineering problem in a specific and under-addressed way: it introduces what we call the delegated-autonomy boundary -- the set of decisions about what may be delegated to the system, under what graduated authority, with what oversight, and how control is returned. Current practices bury these decisions inside prompts, tool schemas, and runtime policies, even though they are requirements-level commitments. This paper proposes two complementary artifacts. First, an Agency Justification Record (AJR) helps teams decide when an agent is warranted over simpler alternatives. Second, an Agentic Delegation Policy (ADP) captures what must be specified for safe and effective development: purpose, authority, information, coordination, assurance, and evolution. Crucially, authority in the ADP is modelled as graduated, i.e., a tiered structure. We illustrate the framework with two contrasting examples: a safety-critical hospital discharge coordination agent and an automated code review agent.

Related papers

• EMERGE-Policy: A Robot Mind Emerges Beyond a Single Policy [48.898967774856466]
  EMERGE-Policy coordinates both capability invocation and information exchange.<n>Main Agent retains task-level state within an active context window.<n>Role-specific Sub Agents process perception, execution monitoring, verification, and memory consolidation.
  arXiv  Detail & Related papers  (2026-08-30T16:46:06Z)
• Deontic Policies for Runtime Governance of Agentic AI Systems [2.1095754823099657]
  We propose AgenticRei, which realizes key governance requirements such as obligations, dispensations, policy conflict resolutions, and reasoning over policies.<n>Our approach composes naturally with industry-standard frameworks like A2AS.
  arXiv  Detail & Related papers  (2026-06-17T18:02:07Z)
• The Digital Apprentice: A Framework for Human-Directed Agentic AI Development [0.0]
  We present a framework for scalable, safe AI agency in which autonomy is earned, not assumed.<n>The Digital Apprentice is a developmental learner that internalizes the tacit methodology of a directing human.<n>We show how catching data drift and applying a different technique at runtime recovers degraded quality dimensions under traffic shift.
  arXiv  Detail & Related papers  (2026-06-03T00:49:13Z)
• Autonomy and Agency in Agentic AI: Architectural Tactics for Regulated Contexts [1.2031796234206136]
  This work introduces a two-dimensional design space in which both dimensions are organised into five operational levels.<n> Autonomy ranges from human-commanded operation (L1) to fully autonomous monitoring (L5)<n>We propose six architectural tactics--checkpoints, escalation, multi-agent delegation, tool provisioning, tool fencing, and write staging--for adjusting a deployment's position within it.
  arXiv  Detail & Related papers  (2026-05-12T13:20:30Z)
• From Assistance to Agency: Rethinking Autonomy and Control in CI/CD Pipelines [0.0]
  This paper presents a vision of agentic Continuous Integration and Continuous Deployment (CI/CD) in which the central challenge is not improving task performance but designing authority transfer.<n> Drawing on research prototypes and industrial platforms, we show that current systems operate mainly at the data plane under bounded autonomy.<n>We identify three recurring patterns: constrained autonomy as the dominant design, external governance as the primary safety mechanism, and a widening gap between deployment momentum and evaluation methodology.
  arXiv  Detail & Related papers  (2026-05-08T00:15:43Z)
• Architecting Secure AI Agents: Perspectives on System-Level Defenses Against Indirect Prompt Injection Attacks [46.32011684548212]
  AI agents are vulnerable to indirect prompt injection, in which malicious instructions embedded in untrusted data can trigger dangerous agent actions.<n>This position paper discusses our vision for system-level defenses against indirect prompt injection attacks.
  arXiv  Detail & Related papers  (2026-03-31T17:15:46Z)
• On the Regulatory Potential of User Interfaces for AI Agent Governance [27.951021158233587]
  We propose regulating user interfaces of AI agents as a way of enforcing transparency and behavioral requirements.<n>We analyze 22 existing agentic systems to identify UI elements that play key roles in human-agent interaction and communication.<n>Our work exposes a new surface for regulatory action that supplements previous proposals for practical AI agent governance.
  arXiv  Detail & Related papers  (2025-11-30T05:32:13Z)
• Toward a Theory of Agents as Tool-Use Decision-Makers [89.26889709510242]
  We argue that true autonomy requires agents to be grounded in a coherent epistemic framework that governs what they know, what they need to know, and how to acquire that knowledge efficiently.<n>We propose a unified theory that treats internal reasoning and external actions as equivalent epistemic tools, enabling agents to systematically coordinate introspection and interaction.<n>This perspective shifts the design of agents from mere action executors to knowledge-driven intelligence systems, offering a principled path toward building foundation agents capable of adaptive, efficient, and goal-directed behavior.
  arXiv  Detail & Related papers  (2025-06-01T07:52:16Z)
• Agent-as-a-Judge: Evaluate Agents with Agents [61.33974108405561]
  We introduce the Agent-as-a-Judge framework, wherein agentic systems are used to evaluate agentic systems. This is an organic extension of the LLM-as-a-Judge framework, incorporating agentic features that enable intermediate feedback for the entire task-solving process. We present DevAI, a new benchmark of 55 realistic automated AI development tasks.
  arXiv  Detail & Related papers  (2024-10-14T17:57:02Z)
• Pangu-Agent: A Fine-Tunable Generalist Agent with Structured Reasoning [50.47568731994238]
  Key method for creating Artificial Intelligence (AI) agents is Reinforcement Learning (RL) This paper presents a general framework model for integrating and learning structured reasoning into AI agents' policies.
  arXiv  Detail & Related papers  (2023-12-22T17:57:57Z)
• Formalizing the Problem of Side Effect Regularization [81.97441214404247]
  We propose a formal criterion for side effect regularization via the assistance game framework. In these games, the agent solves a partially observable Markov decision process. We show that this POMDP is solved by trading off the proxy reward with the agent's ability to achieve a range of future tasks.
  arXiv  Detail & Related papers  (2022-06-23T16:36:13Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.