Which Economic Tasks are Performed with AI? Evidence from Millions of Claude Conversations

• URL: http://arxiv.org/abs/2503.04761v1
• Date: Tue, 11 Feb 2025 00:46:43 GMT
• Title: Which Economic Tasks are Performed with AI? Evidence from Millions of Claude Conversations
• Authors: Kunal Handa, Alex Tamkin, Miles McCain, Saffron Huang, Esin Durmus, Sarah Heck, Jared Mueller, Jerry Hong, Stuart Ritchie, Tim Belonax, Kevin K. Troy, Dario Amodei, Jared Kaplan, Jack Clark, Deep Ganguli,
• Abstract summary: We leverage a recent privacy-preserving system to analyze over four million Claude.ai conversations.<n>Our analysis reveals that AI usage primarily concentrates in software development and writing tasks.<n>We also analyze how AI is being used for tasks, finding 57% of usage suggests augmentation of human capabilities.
• Score: 18.86239369192921
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Despite widespread speculation about artificial intelligence's impact on the future of work, we lack systematic empirical evidence about how these systems are actually being used for different tasks. Here, we present a novel framework for measuring AI usage patterns across the economy. We leverage a recent privacy-preserving system to analyze over four million Claude.ai conversations through the lens of tasks and occupations in the U.S. Department of Labor's O*NET Database. Our analysis reveals that AI usage primarily concentrates in software development and writing tasks, which together account for nearly half of all total usage. However, usage of AI extends more broadly across the economy, with approximately 36% of occupations using AI for at least a quarter of their associated tasks. We also analyze how AI is being used for tasks, finding 57% of usage suggests augmentation of human capabilities (e.g., learning or iterating on an output) while 43% suggests automation (e.g., fulfilling a request with minimal human involvement). While our data and methods face important limitations and only paint a picture of AI usage on a single platform, they provide an automated, granular approach for tracking AI's evolving role in the economy and identifying leading indicators of future impact as these technologies continue to advance.

Related papers

• General Scales Unlock AI Evaluation with Explanatory and Predictive Power [57.7995945974989]
  benchmarking has guided progress in AI, but it has offered limited explanatory and predictive power for general-purpose AI systems. We introduce general scales for AI evaluation that can explain what common AI benchmarks really measure. Our fully-automated methodology builds on 18 newly-crafted rubrics that place instance demands on general scales that do not saturate.
  arXiv  Detail & Related papers  (2025-03-09T01:13:56Z)
• SoK: On the Offensive Potential of AI [14.072632973726906]
  More and more evidence shows that AI is also used for offensive purposes.<n>No extant work has been able to draw a holistic picture of the offensive potential of AI.
  arXiv  Detail & Related papers  (2024-12-24T14:02:44Z)
• TheAgentCompany: Benchmarking LLM Agents on Consequential Real World Tasks [52.46737975742287]
  We build a self-contained environment with data that mimics a small software company environment.<n>We find that with the most competitive agent, 24% of the tasks can be completed autonomously.<n>This paints a nuanced picture on task automation with LM agents.
  arXiv  Detail & Related papers  (2024-12-18T18:55:40Z)
• How Performance Pressure Influences AI-Assisted Decision Making [57.53469908423318]
  We show how pressure and explainable AI (XAI) techniques interact with AI advice-taking behavior.<n>Our results show complex interaction effects, with different combinations of pressure and XAI techniques either improving or worsening AI advice taking behavior.
  arXiv  Detail & Related papers  (2024-10-21T22:39:52Z)
• Towards the Terminator Economy: Assessing Job Exposure to AI through LLMs [10.844598404826355]
  One-third of U.S. employment is highly exposed to AI, primarily in high-skill jobs. This exposure correlates positively with employment and wage growth from 2019 to 2023.
  arXiv  Detail & Related papers  (2024-07-27T08:14:18Z)
• AI and Jobs: Has the Inflection Point Arrived? Evidence from an Online Labor Platform [0.13124513975412255]
  We investigate how AI influences freelancers across different online labor markets (OLMs) To shed light on the underlying mechanisms, we developed a Cournot-type competition model. We find that U.S. web developers tend to benefit more from the release of ChatGPT compared to their counterparts in other regions.
  arXiv  Detail & Related papers  (2023-12-07T10:06:34Z)
• Why is AI not a Panacea for Data Workers? An Interview Study on Human-AI Collaboration in Data Storytelling [59.08591308749448]
  We interviewed eighteen data workers from both industry and academia to learn where and how they would like to collaborate with AI. Surprisingly, though the participants showed excitement about collaborating with AI, many of them also expressed reluctance and pointed out nuanced reasons.
  arXiv  Detail & Related papers  (2023-04-17T15:30:05Z)
• AI for IT Operations (AIOps) on Cloud Platforms: Reviews, Opportunities and Challenges [60.56413461109281]
  Artificial Intelligence for IT operations (AIOps) aims to combine the power of AI with the big data generated by IT Operations processes. We discuss in depth the key types of data emitted by IT Operations activities, the scale and challenges in analyzing them, and where they can be helpful. We categorize the key AIOps tasks as - incident detection, failure prediction, root cause analysis and automated actions.
  arXiv  Detail & Related papers  (2023-04-10T15:38:12Z)
• Data-centric Artificial Intelligence: A Survey [47.24049907785989]
  Recently, the role of data in AI has been significantly magnified, giving rise to the emerging concept of data-centric AI. In this survey, we discuss the necessity of data-centric AI, followed by a holistic view of three general data-centric goals. We believe this is the first comprehensive survey that provides a global view of a spectrum of tasks across various stages of the data lifecycle.
  arXiv  Detail & Related papers  (2023-03-17T17:44:56Z)
• On the Influence of Explainable AI on Automation Bias [0.0]
  We aim to shed light on the potential to influence automation bias by explainable AI (XAI) We conduct an online experiment with regard to hotel review classifications and discuss first results.
  arXiv  Detail & Related papers  (2022-04-19T12:54:23Z)
• Measuring Ethics in AI with AI: A Methodology and Dataset Construction [1.6861004263551447]
  We propose to use such newfound capabilities of AI technologies to augment our AI measuring capabilities. We do so by training a model to classify publications related to ethical issues and concerns. We highlight the implications of AI metrics, in particular their contribution towards developing trustful and fair AI-based tools and technologies.
  arXiv  Detail & Related papers  (2021-07-26T00:26:12Z)
• The MineRL BASALT Competition on Learning from Human Feedback [58.17897225617566]
  The MineRL BASALT competition aims to spur forward research on this important class of techniques. We design a suite of four tasks in Minecraft for which we expect it will be hard to write down hardcoded reward functions. We provide a dataset of human demonstrations on each of the four tasks, as well as an imitation learning baseline.
  arXiv  Detail & Related papers  (2021-07-05T12:18:17Z)
• Artificial Intelligence (AI) and IT identity: Antecedents Identifying with AI Applications [0.76146285961466]
  replacing managers with AI systems may have a negative impact on workers outcomes. It is unclear if workers receive the same benefits from their relationships with AI systems.
  arXiv  Detail & Related papers  (2020-05-15T10:59:43Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.