Exploring the Constraints on Artificial General Intelligence: A Game-Theoretic No-Go Theorem

• URL: http://arxiv.org/abs/2209.12346v2
• Date: Thu, 9 Nov 2023 23:51:01 GMT
• Title: Exploring the Constraints on Artificial General Intelligence: A Game-Theoretic No-Go Theorem
• Authors: Mehmet S. Ismail
• Abstract summary: I propose a game-theoretic framework that captures the strategic interactions between a human agent and a potential superhuman machine agent. My analysis contributes to a better understanding of the context that can shape the theoretical development of superhuman AI.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The emergence of increasingly sophisticated artificial intelligence (AI) systems have sparked intense debate among researchers, policymakers, and the public due to their potential to surpass human intelligence and capabilities in all domains. In this paper, I propose a game-theoretic framework that captures the strategic interactions between a human agent and a potential superhuman machine agent. I identify four key assumptions: Strategic Unpredictability, Access to Machine's Strategy, Rationality, and Superhuman Machine. The main result of this paper is an impossibility theorem: these four assumptions are inconsistent when taken together, but relaxing any one of them results in a consistent set of assumptions. Two straightforward policy recommendations follow: first, policymakers should control access to specific human data to maintain Strategic Unpredictability; and second, they should grant select AI researchers access to superhuman machine research to ensure Access to Machine's Strategy holds. My analysis contributes to a better understanding of the context that can shape the theoretical development of superhuman AI.

Related papers

• The three main doctrines on the future of AI [0.0]
  The dominance doctrine predicts that the first actor to create sufficiently advanced AI will attain overwhelming strategic superiority.<n>The extinction doctrine anticipates that humanity will likely lose control of ASI, leading to the extinction of the human species or its permanent disempowerment.<n>The replacement doctrine forecasts that AI will automate a large share of tasks currently performed by humans, but will not be so transformative as to fundamentally reshape or bring an end to human civilization.
  arXiv  Detail & Related papers  (2025-09-24T12:17:29Z)
• The next question after Turing's question: Introducing the Grow-AI test [51.56484100374058]
  This study aims to extend the framework for assessing artificial intelligence, called GROW-AI.<n>GROW-AI is designed to answer the question "Can machines grow up?" -- a natural successor to the Turing Test.<n>The originality of the work lies in the conceptual transposition of the process of "growing" from the human world to that of artificial intelligence.
  arXiv  Detail & Related papers  (2025-08-22T10:19:42Z)
• Artificial Intelligent Disobedience: Rethinking the Agency of Our Artificial Teammates [3.7692411550925677]
  This paper argues for expanding the agency of AI teammates to include intelligent disobedience.<n>It introduces a scale of AI agency levels and uses representative examples to highlight the importance of treating AI autonomy as an independent research focus.
  arXiv  Detail & Related papers  (2025-06-27T14:45:27Z)
• A Beautiful Mind: Principles and Strategies for AI-Augmented Human Reasoning [0.0]
  This paper outlines a human-centered augmented reasoning paradigm. It offers examples of interaction modes that can serve as bridges between human reasoning and AI algorithms.
  arXiv  Detail & Related papers  (2025-02-05T20:57:29Z)
• A Basis for Human Responsibility in Artificial Intelligence Computation [0.0]
  Recent advancements in artificial intelligence have reopened the question about the boundaries of AI autonomy. This paper explores these boundaries through the analysis of the Alignment Research Center experiment on GPT-4. By examining the thought experiment and its counterarguments will be enlightened how in the need for human activation and purpose definition lies the AI's inherent dependency on human-initiated actions.
  arXiv  Detail & Related papers  (2025-01-21T20:59:48Z)
• Aligning Generalisation Between Humans and Machines [74.120848518198]
  Recent advances in AI have resulted in technology that can support humans in scientific discovery and decision support but may also disrupt democracies and target individuals. The responsible use of AI increasingly shows the need for human-AI teaming. A crucial yet often overlooked aspect of these interactions is the different ways in which humans and machines generalise.
  arXiv  Detail & Related papers  (2024-11-23T18:36:07Z)
• Imagining and building wise machines: The centrality of AI metacognition [78.76893632793497]
  We argue that shortcomings stem from one overarching failure: AI systems lack wisdom. While AI research has focused on task-level strategies, metacognition is underdeveloped in AI systems. We propose that integrating metacognitive capabilities into AI systems is crucial for enhancing their robustness, explainability, cooperation, and safety.
  arXiv  Detail & Related papers  (2024-11-04T18:10:10Z)
• Attaining Human`s Desirable Outcomes in Human-AI Interaction via Structural Causal Games [34.34801907296059]
  In human-AI interaction, a prominent goal is to attain humans desirable outcome with the assistance of AI agents. We employ a theoretical framework called structural causal game (SCG) to formalize the human-AI interactive process. We introduce a strategy referred to as pre-policy intervention on the SCG to steer AI agents towards attaining the humans desirable outcome.
  arXiv  Detail & Related papers  (2024-05-26T14:42:49Z)
• Explainable Human-AI Interaction: A Planning Perspective [32.477369282996385]
  AI systems need to be explainable to the humans in the loop. We will discuss how the AI agent can use mental models to either conform to human expectations, or change those expectations through explanatory communication. While the main focus of the book is on cooperative scenarios, we will point out how the same mental models can be used for obfuscation and deception.
  arXiv  Detail & Related papers  (2024-05-19T22:22:21Z)
• Position Paper: Agent AI Towards a Holistic Intelligence [53.35971598180146]
  We emphasize developing Agent AI -- an embodied system that integrates large foundation models into agent actions. In this paper, we propose a novel large action model to achieve embodied intelligent behavior, the Agent Foundation Model.
  arXiv  Detail & Related papers  (2024-02-28T16:09:56Z)
• Learning to Make Adherence-Aware Advice [8.419688203654948]
  This paper presents a sequential decision-making model that takes into account the human's adherence level. We provide learning algorithms that learn the optimal advice policy and make advice only at critical time stamps.
  arXiv  Detail & Related papers  (2023-10-01T23:15:55Z)
• General Purpose Artificial Intelligence Systems (GPAIS): Properties, Definition, Taxonomy, Societal Implications and Responsible Governance [16.030931070783637]
  General-Purpose Artificial Intelligence Systems (GPAIS) has been defined to refer to these AI systems. To date, the possibility of an Artificial General Intelligence, powerful enough to perform any intellectual task as if it were human, or even improve it, has remained an aspiration, fiction, and considered a risk for our society. This work discusses existing definitions for GPAIS and proposes a new definition that allows for a gradual differentiation among types of GPAIS according to their properties and limitations.
  arXiv  Detail & Related papers  (2023-07-26T16:35:48Z)
• The Role of AI in Drug Discovery: Challenges, Opportunities, and Strategies [97.5153823429076]
  The benefits, challenges and drawbacks of AI in this field are reviewed. The use of data augmentation, explainable AI, and the integration of AI with traditional experimental methods are also discussed.
  arXiv  Detail & Related papers  (2022-12-08T23:23:39Z)
• Cybertrust: From Explainable to Actionable and Interpretable AI (AI2) [58.981120701284816]
  Actionable and Interpretable AI (AI2) will incorporate explicit quantifications and visualizations of user confidence in AI recommendations. It will allow examining and testing of AI system predictions to establish a basis for trust in the systems' decision making.
  arXiv  Detail & Related papers  (2022-01-26T18:53:09Z)
• On some Foundational Aspects of Human-Centered Artificial Intelligence [52.03866242565846]
  There is no clear definition of what is meant by Human Centered Artificial Intelligence. This paper introduces the term HCAI agent to refer to any physical or software computational agent equipped with AI components. We see the notion of HCAI agent, together with its components and functions, as a way to bridge the technical and non-technical discussions on human-centered AI.
  arXiv  Detail & Related papers  (2021-12-29T09:58:59Z)
• Explainable Artificial Intelligence Approaches: A Survey [0.22940141855172028]
  Lack of explainability of a decision from an Artificial Intelligence based "black box" system/model is a key stumbling block for adopting AI in high stakes applications. We demonstrate popular Explainable Artificial Intelligence (XAI) methods with a mutual case study/task. We analyze for competitive advantages from multiple perspectives. We recommend paths towards responsible or human-centered AI using XAI as a medium.
  arXiv  Detail & Related papers  (2021-01-23T06:15:34Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.