Using profiles of cognitive capability to assess AI suitability for workplace tasks

• URL: http://arxiv.org/abs/2608.25623v1
• Date: Wed, 26 Aug 2026 10:48:09 GMT
• Title: Using profiles of cognitive capability to assess AI suitability for workplace tasks
• Abstract summary: We introduce a pipeline that profiles agents and tasks using a shared set of core cognitive capabilities.<n>As both use a common set of cognitive dimensions, they can be updated independently as models and roles change.<n>We validate capability recovery on synthetic agents, profile six AI systems, and elicit task requirements from 410 employees.
• Score: 5.826026042207654
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Organisations deploying AI face a scoping problem: which tasks can be automated, which should remain with humans, and which are best shared between the two. Aggregate benchmark scores provide little insight into where systems will succeed or fail in practice, while human judgements of model capabilities quickly become outdated. We introduce a pipeline that profiles agents and tasks using a shared set of core cognitive capabilities. Cognitive capability profiling infers an agent's capabilities from performance on a benchmark battery annotated for the cognitive demands of each item. Task requirements weighting elicits from domain experts the relative importance of these same capabilities for their work. As both use a common set of cognitive dimensions, they can be updated independently as models and roles change, and combined to estimate AI suitability at the level of a domain, organisation, role, or individual duty. We validate capability recovery on synthetic agents, profile six AI systems, and elicit task requirements from 410 employees across six occupational domains. AI systems differed more across cognitive dimensions than across model families, while workplace activities converged on a shared cognitive core. The resulting scores provide a comparative scoping tool for identifying promising candidates for piloting and areas where current systems are unlikely to be well suited. We discuss extending the framework to profile human workers alongside AI systems, moving from AI suitability towards human-machine task allocation.

Related papers

• When Does AI Augment Work? A Workflow-Level Framework for Human-Agent Collaboration [78.16115745870405]
  We aim to characterise the value of artificial intelligence in the workplace.<n>Current studies largely measure this value in terms of the current automation capabilities and public adoption of AI.<n>To account for this, we must expand the scope of our analysis beyond atomised tasks of today.
  arXiv  Detail & Related papers  (2026-09-11T06:29:34Z)
• Principal Trait Analysis: Towards Deriving "Skills" in Human-AI Collaboration [3.3894363032046506]
  Large Language Model-powered agents are increasingly used in the workplace via human-artificial intelligence (AI) collaboration.<n>We propose Principal Trait Analysis, a Principal Component Analysis-inspired algorithm for deriving common traits from patterns in conversations.<n>We find that PTA-derived traits are significant in explaining collaborator behavior across both settings and can help predict task outcomes.
  arXiv  Detail & Related papers  (2026-08-11T21:49:35Z)
• The Context Access Divide: Interaction-Level Architecture as a Complementary Dimension of Agentic Inequality [0.0]
  Two users with nominally equivalent AI access may experience qualitatively different AI utility.<n>For knowledge-intensive workers whose intellectual capital spans tens of thousands of files, the Context Access Divide (CAD) constitutes a qualitative threshold in AI usefulness.<n>We propose contextuality as a dimension of AI-mediated inequality that complements, but is not reducible to, the Sharp et al. framework.
  arXiv  Detail & Related papers  (2026-07-09T13:53:40Z)
• What Work is AI Actually Doing? Uncovering the Drivers of Generative AI Adoption [1.4977849232424492]
  This study investigates which intrinsic task characteristics drive users' decisions to delegate work to AI systems.<n>This research provides the first systematic evidence linking real-world generative AI usage to a comprehensive, multi-dimensional framework of intrinsic task characteristics.
  arXiv  Detail & Related papers  (2025-10-26T19:13:37Z)
• Evaluating Uncertainty and Quality of Visual Language Action-enabled Robots [13.26825865228582]
  We propose eight uncertainty metrics and five quality metrics specifically designed for VLA models for robotic manipulation tasks.<n>We assess their effectiveness through a large-scale empirical study involving 908 successful task executions from three state-of-the-art VLA models.
  arXiv  Detail & Related papers  (2025-07-22T22:15:59Z)
• A Task-Driven Human-AI Collaboration: When to Automate, When to Collaborate, When to Challenge [16.734679201317896]
  We show how proper human-AI integration maintains meaningful agency while improving performance.<n>This framework lays the foundation for practically effective and morally sound human-AI collaboration.
  arXiv  Detail & Related papers  (2025-05-23T23:19:15Z)
• Agentic Knowledgeable Self-awareness [79.25908923383776]
  KnowSelf is a data-centric approach that applies agents with knowledgeable self-awareness like humans.<n>Our experiments demonstrate that KnowSelf can outperform various strong baselines on different tasks and models with minimal use of external knowledge.
  arXiv  Detail & Related papers  (2025-04-04T16:03:38Z)
• WorkArena++: Towards Compositional Planning and Reasoning-based Common Knowledge Work Tasks [85.95607119635102]
  Large language models (LLMs) can mimic human-like intelligence.<n>WorkArena++ is designed to evaluate the planning, problem-solving, logical/arithmetic reasoning, retrieval, and contextual understanding abilities of web agents.
  arXiv  Detail & Related papers  (2024-07-07T07:15:49Z)
• Autonomous Open-Ended Learning of Tasks with Non-Stationary Interdependencies [64.0476282000118]
  Intrinsic motivations have proven to generate a task-agnostic signal to properly allocate the training time amongst goals. While the majority of works in the field of intrinsically motivated open-ended learning focus on scenarios where goals are independent from each other, only few of them studied the autonomous acquisition of interdependent tasks. In particular, we first deepen the analysis of a previous system, showing the importance of incorporating information about the relationships between tasks at a higher level of the architecture. Then we introduce H-GRAIL, a new system that extends the previous one by adding a new learning layer to store the autonomously acquired sequences
  arXiv  Detail & Related papers  (2022-05-16T10:43:01Z)
• Cognitive architecture aided by working-memory for self-supervised multi-modal humans recognition [54.749127627191655]
  The ability to recognize human partners is an important social skill to build personalized and long-term human-robot interactions. Deep learning networks have achieved state-of-the-art results and demonstrated to be suitable tools to address such a task. One solution is to make robots learn from their first-hand sensory data with self-supervision.
  arXiv  Detail & Related papers  (2021-03-16T13:50:24Z)
• Watch-And-Help: A Challenge for Social Perception and Human-AI Collaboration [116.28433607265573]
  We introduce Watch-And-Help (WAH), a challenge for testing social intelligence in AI agents. In WAH, an AI agent needs to help a human-like agent perform a complex household task efficiently. We build VirtualHome-Social, a multi-agent household environment, and provide a benchmark including both planning and learning based baselines.
  arXiv  Detail & Related papers  (2020-10-19T21:48:31Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.