AI Agent Governance: A Field Guide

• URL: http://arxiv.org/abs/2505.21808v1
• Date: Tue, 27 May 2025 22:26:51 GMT
• Title: AI Agent Governance: A Field Guide
• Authors: Jam Kraprayoon, Zoe Williams, Rida Fayyaz,
• Abstract summary: Agents - AI systems that can autonomously achieve goals in the world - are a major focus of leading tech companies, AI start-ups, and investors.<n>A future where capable agents are deployed en masse could see transformative benefits to society but also profound and novel risks.<n>Only a few researchers, primarily in civil society organizations, public research institutes, and frontier AI companies, are actively working on these challenges.
• Score: 0.0
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: This report serves as an accessible guide to the emerging field of AI agent governance. Agents - AI systems that can autonomously achieve goals in the world, with little to no explicit human instruction about how to do so - are a major focus of leading tech companies, AI start-ups, and investors. If these development efforts are successful, some industry leaders claim we could soon see a world where millions or billions of agents autonomously perform complex tasks across society. Society is largely unprepared for this development. A future where capable agents are deployed en masse could see transformative benefits to society but also profound and novel risks. Currently, the exploration of agent governance questions and the development of associated interventions remain in their infancy. Only a few researchers, primarily in civil society organizations, public research institutes, and frontier AI companies, are actively working on these challenges.

Related papers

• AI Workers, Geopolitics, and Algorithmic Collective Action [0.0]
  This paper argues that some AI workers can be considered actors of geopolitics.<n>It makes the case that governance alone cannot ensure responsible, ethical, or robust AI development and use.<n>It proposes engaging AI workers as sources of knowledge, relative power, and to encourage more responsible and just AI development.
  arXiv  Detail & Related papers  (2025-11-21T15:52:44Z)
• Ten Principles of AI Agent Economics [34.771189554393096]
  AI agents are evolving from specialized tools into dynamic participants in social and economic ecosystems.<n>Their autonomy and decision-making capabilities are poised to impact industries, professions, and human lives profoundly.<n>This paper presents ten principles of AI agent economics, offering a framework to understand how AI agents make decisions, influence social interactions, and participate in the broader economy.
  arXiv  Detail & Related papers  (2025-05-26T17:52:44Z)
• Fully Autonomous AI Agents Should Not be Developed [58.88624302082713]
  This paper argues that fully autonomous AI agents should not be developed.<n>In support of this position, we build from prior scientific literature and current product marketing to delineate different AI agent levels.<n>Our analysis reveals that risks to people increase with the autonomy of a system.
  arXiv  Detail & Related papers  (2025-02-04T19:00:06Z)
• Shaping AI's Impact on Billions of Lives [27.78474296888659]
  We argue for the community of AI practitioners to consciously and proactively work for the common good.<n>This paper offers a blueprint for a new type of innovation infrastructure.
  arXiv  Detail & Related papers  (2024-12-03T16:29:37Z)
• Position Paper: Agent AI Towards a Holistic Intelligence [53.35971598180146]
  We emphasize developing Agent AI -- an embodied system that integrates large foundation models into agent actions. In this paper, we propose a novel large action model to achieve embodied intelligent behavior, the Agent Foundation Model.
  arXiv  Detail & Related papers  (2024-02-28T16:09:56Z)
• Managing extreme AI risks amid rapid progress [171.05448842016125]
  We describe risks that include large-scale social harms, malicious uses, and irreversible loss of human control over autonomous AI systems. There is a lack of consensus about how exactly such risks arise, and how to manage them. Present governance initiatives lack the mechanisms and institutions to prevent misuse and recklessness, and barely address autonomous systems.
  arXiv  Detail & Related papers  (2023-10-26T17:59:06Z)
• The Rise and Potential of Large Language Model Based Agents: A Survey [91.71061158000953]
  Large language models (LLMs) are regarded as potential sparks for Artificial General Intelligence (AGI) We start by tracing the concept of agents from its philosophical origins to its development in AI, and explain why LLMs are suitable foundations for agents. We explore the extensive applications of LLM-based agents in three aspects: single-agent scenarios, multi-agent scenarios, and human-agent cooperation.
  arXiv  Detail & Related papers  (2023-09-14T17:12:03Z)
• An Ethical Framework for Guiding the Development of Affectively-Aware Artificial Intelligence [0.0]
  We propose guidelines for evaluating the (moral and) ethical consequences of affectively-aware AI. We propose a multi-stakeholder analysis framework that separates the ethical responsibilities of AI Developers vis-a-vis the entities that deploy such AI. We end with recommendations for researchers, developers, operators, as well as regulators and law-makers.
  arXiv  Detail & Related papers  (2021-07-29T03:57:53Z)
• Building Bridges: Generative Artworks to Explore AI Ethics [56.058588908294446]
  In recent years, there has been an increased emphasis on understanding and mitigating adverse impacts of artificial intelligence (AI) technologies on society. A significant challenge in the design of ethical AI systems is that there are multiple stakeholders in the AI pipeline, each with their own set of constraints and interests. This position paper outlines some potential ways in which generative artworks can play this role by serving as accessible and powerful educational tools.
  arXiv  Detail & Related papers  (2021-06-25T22:31:55Z)
• The Short Anthropological Guide to the Study of Ethical AI [91.3755431537592]
  Short guide serves as both an introduction to AI ethics and social science and anthropological perspectives on the development of AI. Aims to provide those unfamiliar with the field with an insight into the societal impact of AI systems and how, in turn, these systems can lead us to rethink how our world operates.
  arXiv  Detail & Related papers  (2020-10-07T12:25:03Z)
• U.S. Public Opinion on the Governance of Artificial Intelligence [0.0]
  Existing studies find that the public's trust in institutions can play a major role in shaping the regulation of emerging technologies. We examined Americans' perceptions of 13 AI governance challenges and their trust in governmental, corporate, and multistakeholder institutions to responsibly develop and manage AI.
  arXiv  Detail & Related papers  (2019-12-30T07:38:38Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.