Measuring Progress Toward AGI: A Cognitive Framework

• URL: http://arxiv.org/abs/2605.28405v1
• Date: Wed, 27 May 2026 12:39:54 GMT
• Title: Measuring Progress Toward AGI: A Cognitive Framework
• Abstract summary: There is no clear framework for measuring progress toward AGI.<n>We present a framework for understanding system capabilities in relation to human cognitive abilities.<n>We propose a rigorous evaluation protocol in which a system's performance is measured across a suite of targeted, held-out cognitive tasks.
• Score: 41.45715025577419
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Despite widespread discussion of AGI, there is no clear framework for measuring progress toward it. This ambiguity fuels subjective claims, makes it difficult to track progress, and risks hindering responsible governance. As a starting point to address this gap, we present a framework for understanding system capabilities in relation to human cognitive abilities. Drawing from decades of research in psychology, neuroscience, and cognitive science, we introduce a Cognitive Taxonomy that deconstructs general intelligence into 10 key cognitive faculties. We then propose a rigorous evaluation protocol in which a system's performance is measured across a suite of targeted, held-out cognitive tasks, generating a 'cognitive profile' that can be used to understand a system's strengths and weaknesses. We hope this framework will provide a practical roadmap and an initial step toward more rigorous, empirical evaluation of AGI.

Related papers

• A Taxonomy of Cognitive Capability Gaps in Generative and Agentic AI [4.077787659104315]
  This paper presents a taxonomy-driven survey of the major cognitive capability gaps that continue to constrain the development of Cognitive AI.<n>We outline a conceptual Adaptive Cognitive Intelligence Architecture (ACIA) and examine emerging directions in cognition-centric evaluation.
  arXiv  Detail & Related papers  (2026-08-03T17:37:38Z)
• Multi-Dimensional Assessment for AI Cognition (MAAC): A Theoretical Framework for Process-Oriented Cognitive Evaluation of Text-Based AI Systems [1.8262547855491456]
  This paper introduces the Multi-Dimensional Assessment for AI Cognition (MAAC), a framework for shifting evaluation from what text-based AI systems produce to how they think.<n>MAAC defines nine cognitively motivated dimensions: Cognitive Load, Tool Execution, Content Quality, Memory Integration, Complexity Handling, Hallucination Control, Knowledge Transfer, Processing Efficiency, and Process-Outcome Alignment.<n>Five theoretical analyses provide initial support for the framework's coherence and empirical testability.
  arXiv  Detail & Related papers  (2026-08-01T14:01:17Z)
• A Survey of Reasoning in Autonomous Driving Systems: Open Challenges and Emerging Paradigms [49.66022971508878]
  We argue that reasoning should be elevated from a modular component to the system's cognitive core.<n>We derive and systematize seven core reasoning challenges, such as the responsiveness-reasoning trade-off and social-game reasoning.<n>We identify a fundamental and unresolved tension between the high-latency, deliberative nature of LLM-based reasoning and the millisecond-scale, safety-critical demands of vehicle control.
  arXiv  Detail & Related papers  (2026-03-11T07:40:53Z)
• Cognitive Warfare: Definition, Framework, and Case Study [3.357544650969485]
  This article proposes a unified definition of cognitive warfare, introduces an interaction framework grounded in the OODA loop, and identifies measurable attributes associated with cognitive superiority.<n>To illustrate the use of the framework, a notional case study demonstrates how these concepts can be applied to assess cognitive attacks and defenses in a contested environment.
  arXiv  Detail & Related papers  (2026-03-05T14:34:44Z)
• AI Deception: Risks, Dynamics, and Controls [153.71048309527225]
  This project provides a comprehensive and up-to-date overview of the AI deception field.<n>We identify a formal definition of AI deception, grounded in signaling theory from studies of animal deception.<n>We organize the landscape of AI deception research as a deception cycle, consisting of two key components: deception emergence and deception treatment.
  arXiv  Detail & Related papers  (2025-11-27T16:56:04Z)
• A Definition of AGI [208.25193480759026]
  The lack of a concrete definition for Artificial General Intelligence obscures the gap between today's specialized AI and human-level cognition.<n>This paper introduces a quantifiable framework to address this, defining AGI as matching the cognitive versatility and proficiency of a well-educated adult.
  arXiv  Detail & Related papers  (2025-10-21T01:28:35Z)
• Think Socially via Cognitive Reasoning [94.60442643943696]
  We introduce Cognitive Reasoning, a paradigm modeled on human social cognition.<n>CogFlow is a complete framework that instills this capability in LLMs.
  arXiv  Detail & Related papers  (2025-09-26T16:27:29Z)
• Invisible Architectures of Thought: Toward a New Science of AI as Cognitive Infrastructure [0.0]
  "Cognitive Infrastructure Studies" (CIS) is a new interdisciplinary domain to reconceptualize AI as "cognitive infrastructures"<n>CIS aims to address how AI preprocessing reshapes distributed cognition across individual, collective, and cultural scales.
  arXiv  Detail & Related papers  (2025-06-19T15:33:47Z)
• Two Experts Are All You Need for Steering Thinking: Reinforcing Cognitive Effort in MoE Reasoning Models Without Additional Training [86.70255651945602]
  We introduce a novel inference-time steering methodology called Reinforcing Cognitive Experts (RICE)<n>RICE aims to improve reasoning performance without additional training or complexs.<n> Empirical evaluations with leading MoE-based LRMs demonstrate noticeable and consistent improvements in reasoning accuracy, cognitive efficiency, and cross-domain generalization.
  arXiv  Detail & Related papers  (2025-05-20T17:59:16Z)
• How Metacognitive Architectures Remember Their Own Thoughts: A Systematic Review [16.35521789216079]
  Metacognition has gained significant attention for its potential to enhance autonomy and adaptability of artificial agents.<n>Existing overviews remain at a conceptual level that is undiscerning to the underlying algorithms, representations, and their respective success.
  arXiv  Detail & Related papers  (2025-02-28T08:48:41Z)
• Computational Metacognition [2.0552049801885746]
  Computational metacognition represents a cognitive systems perspective on high-order reasoning in integrated artificial systems. We show how computational metacognition improves performance by changing cognition through meta-level goal operations and learning.
  arXiv  Detail & Related papers  (2022-01-30T17:34:53Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.