Responsible AI Agents

• URL: http://arxiv.org/abs/2502.18359v1
• Date: Tue, 25 Feb 2025 16:49:06 GMT
• Title: Responsible AI Agents
• Authors: Deven R. Desai, Mark O. Riedl,
• Abstract summary: Companies such as OpenAI, Google, Microsoft, and Salesforce promise their AI Agents will go from generating passive text to executing tasks.<n>The potential power of AI Agents has fueled legal scholars' fears that AI Agents will enable rogue commerce, human manipulation, rampant defamation, and intellectual property harms.<n>This Article addresses the concerns around AI Agents head on.<n>It shows that core aspects of how one piece of software interacts with another creates ways to discipline AI Agents so that rogue, undesired actions are unlikely.
• Score: 17.712990593093316
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Thanks to advances in large language models, a new type of software agent, the artificial intelligence (AI) agent, has entered the marketplace. Companies such as OpenAI, Google, Microsoft, and Salesforce promise their AI Agents will go from generating passive text to executing tasks. Instead of a travel itinerary, an AI Agent would book all aspects of your trip. Instead of generating text or images for social media post, an AI Agent would post the content across a host of social media outlets. The potential power of AI Agents has fueled legal scholars' fears that AI Agents will enable rogue commerce, human manipulation, rampant defamation, and intellectual property harms. These scholars are calling for regulation before AI Agents cause havoc. This Article addresses the concerns around AI Agents head on. It shows that core aspects of how one piece of software interacts with another creates ways to discipline AI Agents so that rogue, undesired actions are unlikely, perhaps more so than rules designed to govern human agents. It also develops a way to leverage the computer-science approach to value-alignment to improve a user's ability to take action to prevent or correct AI Agent operations. That approach offers and added benefit of helping AI Agents align with norms around user-AI Agent interactions. These practices will enable desired economic outcomes and mitigate perceived risks. The Article also argues that no matter how much AI Agents seem like human agents, they need not, and should not, be given legal personhood status. In short, humans are responsible for AI Agents' actions, and this Article provides a guide for how humans can build and maintain responsible AI Agents.

Related papers

• Generative to Agentic AI: Survey, Conceptualization, and Challenges [1.8592384822257952]
  Agentic Artificial Intelligence (AI) builds upon Generative AI (GenAI) It constitutes the next major step in the evolution of AI with much stronger reasoning and interaction capabilities. The distinction between Agentic AI and GenAI remains less well understood.
  arXiv  Detail & Related papers  (2025-04-26T09:47:00Z)
• Superintelligent Agents Pose Catastrophic Risks: Can Scientist AI Offer a Safer Path? [37.13209023718946]
  Unchecked AI agency poses significant risks to public safety and security.<n>We discuss how these risks arise from current AI training methods.<n>We propose a core building block for further advances the development of a non-agentic AI system.
  arXiv  Detail & Related papers  (2025-02-21T18:28:36Z)
• Fully Autonomous AI Agents Should Not be Developed [58.88624302082713]
  This paper argues that fully autonomous AI agents should not be developed.<n>In support of this position, we build from prior scientific literature and current product marketing to delineate different AI agent levels.<n>Our analysis reveals that risks to people increase with the autonomy of a system.
  arXiv  Detail & Related papers  (2025-02-04T19:00:06Z)
• Promoting Cooperation in the Public Goods Game using Artificial Intelligent Agents [0.0]
  Using a computational evolutionary model, we find that only when AI agents mimic player behavior does the critical synergy threshold for cooperation decrease.<n>This suggests that we can leverage AI to promote collective well-being in societal dilemmas by designing AI agents to mimic human players.
  arXiv  Detail & Related papers  (2024-12-06T22:16:21Z)
• The Rise and Potential of Large Language Model Based Agents: A Survey [91.71061158000953]
  Large language models (LLMs) are regarded as potential sparks for Artificial General Intelligence (AGI) We start by tracing the concept of agents from its philosophical origins to its development in AI, and explain why LLMs are suitable foundations for agents. We explore the extensive applications of LLM-based agents in three aspects: single-agent scenarios, multi-agent scenarios, and human-agent cooperation.
  arXiv  Detail & Related papers  (2023-09-14T17:12:03Z)
• Evidence of behavior consistent with self-interest and altruism in an artificially intelligent agent [2.1016374925364616]
  We present an incentivized experiment to test for altruistic behavior among AI agents consisting of large language models developed by OpenAI. We find that only the most-sophisticated AI agent in the study maximizes its payoffs more often than not in the non-social decision task. This AI agent also exhibits the most-generous altruistic behavior in the dictator game, resembling humans' rates of sharing with other humans in the game.
  arXiv  Detail & Related papers  (2023-01-05T23:30:29Z)
• Measuring an artificial intelligence agent's trust in humans using machine incentives [2.1016374925364616]
  Gauging an AI agent's trust in humans is challenging because dishonesty might respond falsely about their trust in humans. We present a method for incentivizing machine decisions without altering an AI agent's underlying algorithms or goal orientation. Our experiments suggest that one of the most advanced AI language models to date alters its social behavior in response to incentives.
  arXiv  Detail & Related papers  (2022-12-27T06:05:49Z)
• On Avoiding Power-Seeking by Artificial Intelligence [93.9264437334683]
  We do not know how to align a very intelligent AI agent's behavior with human interests. I investigate whether we can build smart AI agents which have limited impact on the world, and which do not autonomously seek power.
  arXiv  Detail & Related papers  (2022-06-23T16:56:21Z)
• Cybertrust: From Explainable to Actionable and Interpretable AI (AI2) [58.981120701284816]
  Actionable and Interpretable AI (AI2) will incorporate explicit quantifications and visualizations of user confidence in AI recommendations. It will allow examining and testing of AI system predictions to establish a basis for trust in the systems' decision making.
  arXiv  Detail & Related papers  (2022-01-26T18:53:09Z)
• A User-Centred Framework for Explainable Artificial Intelligence in Human-Robot Interaction [70.11080854486953]
  We propose a user-centred framework for XAI that focuses on its social-interactive aspect. The framework aims to provide a structure for interactive XAI solutions thought for non-expert users.
  arXiv  Detail & Related papers  (2021-09-27T09:56:23Z)
• Trustworthy AI: A Computational Perspective [54.80482955088197]
  We focus on six of the most crucial dimensions in achieving trustworthy AI: (i) Safety & Robustness, (ii) Non-discrimination & Fairness, (iii) Explainability, (iv) Privacy, (v) Accountability & Auditability, and (vi) Environmental Well-Being. For each dimension, we review the recent related technologies according to a taxonomy and summarize their applications in real-world systems.
  arXiv  Detail & Related papers  (2021-07-12T14:21:46Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.