Developers and Generative AI: A Study of Self-Admitted Usage in Open Source Projects
- URL: http://arxiv.org/abs/2603.26277v1
- Date: Fri, 27 Mar 2026 10:44:06 GMT
- Title: Developers and Generative AI: A Study of Self-Admitted Usage in Open Source Projects
- Abstract summary: We present a taxonomy of 64 different ChatGPT and GitHub Copilot usage tasks, grouped into 7 categories.<n>We show how the usage avenues have been expanded, the extent to which developers perceived such a generative AI usage useful, and whether some concerns occurring more than one year ago are no longer present.
- Score: 18.524728732046146
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: The availability of generative Artificial Intelligence (AI) tools such as ChatGPT or GitHub Copilot is reshaping the way in which software is developed, evolved, and maintained. Oftentimes, developers leave traces of such an usage in software artifacts. This allows not only to understand how AI is used in software development, but also to let others be aware how such software artifacts were created, e.g., for licensing or trustworthiness purposes. This paper-building upon our preliminary work presented at MSR 2024-aims at qualitatively investigating on the self-admitted use of two very popular generative AI tools - ChatGPT and GitHub Copilot - in software development. To this aim, we mined GitHub for such traces, by looking at commits, issues and pull requests (PRs). Then, through a manual coding, we create a taxonomy of 64 different ChatGPT and GitHub Copilot usage tasks, grouped into 7 categories. By repeating our previous analysis two years after and by extending it to GitHub Copilot, we show how the usage avenues have been expanded, the extent to which developers perceived such a generative AI usage useful, and whether some concerns occurring more than one year ago are no longer present. The taxonomy of tasks we derived from such a qualitative study provided (i) developers with valuable insights into how generative AI can be integrated into their workflows, and (ii) researchers with a clear overview of tasks that developers perceive as well-suited for automation.
Related papers
- Workstream: A Local-First Developer Command Center for the AI-Augmented Engineering Workflow [0.0]
We present Workstream, an open-source, local-first developer command center that aggregates pull requests, task management, calendar, AI-powered code review, historical review intelligence, repository AI-readiness scoring, and agent observability into a single interface.<n>We describe the system architecture, a novel 5-category AI readiness scoring algorithm, a review intelligence pipeline that mines historical PR reviews for team-specific patterns, and an agent observability layer implementing the Model Context Protocol (MCP), Agent-to-Agent (A2A), and Agent Observability Protocol (AOP)
arXiv Detail & Related papers (2026-04-18T16:24:29Z) - Engineering Students' Usage and Perceptions of GitHub Copilot in Open-Source Projects [1.8665975431697428]
GitHub Copilot is a popular AI coding assistant.<n>It offers features including code autocompletion, comment-driven code generation, repository-aware suggestions, and a chat interface.<n>Different users use these tools differently due to differences in their perception, prior experience, and demographics.
arXiv Detail & Related papers (2026-04-12T17:40:16Z) - AI Co-Scientist for Ranking: Discovering Novel Search Ranking Models alongside LLM-based AI Agents with Cloud Computing Access [60.37646376282544]
We present an AI Co-Scientist framework that automates the full search ranking research pipeline.<n>This is the first study in the ranking community to utilize an AI Co-Scientist framework for algorithmic research.
arXiv Detail & Related papers (2026-03-23T09:29:08Z) - AIDev: Studying AI Coding Agents on GitHub [9.1677959533705]
We introduce AIDev, a large-scale dataset focused on agent-authored pull requests (Agentic-PRs) in real-world GitHub repositories.<n> AIDev aggregates 932,791 Agentic-PRs produced by five agents: OpenAI Codex, Devin, GitHub Copilot, Cursor, and Claude Code.<n>In addition, AIDev includes a curated subset of 33,596 Agentic-PRs from 2,807 repositories with over 100 stars, providing further information such as comments, reviews, commits, and related issues.
arXiv Detail & Related papers (2026-02-09T20:45:58Z) - Self-Admitted GenAI Usage in Open-Source Software [14.503048663131574]
We introduce the concept of self-admitted GenAI usage, that is, developers explicitly referring to the use of GenAI tools for content creation in software artifacts.<n>We analyze a curated sample of more than 250,000 GitHub repositories, identifying 1,292 such self-admissions across 156 repositories in commit messages, code comments, and project documentation.<n>Our findings reveal that developers actively manage how GenAI is used in their projects, highlighting the need for project-level transparency.
arXiv Detail & Related papers (2025-07-14T16:05:49Z) - Code with Me or for Me? How Increasing AI Automation Transforms Developer Workflows [60.04362496037186]
We present the first controlled study of developer interactions with coding agents.<n>We evaluate two leading copilot and agentic coding assistants.<n>Our results show agents can assist developers in ways that surpass copilots.
arXiv Detail & Related papers (2025-07-10T20:12:54Z) - From Developer Pairs to AI Copilots: A Comparative Study on Knowledge Transfer [8.567835367628787]
With the rise of AI coding assistants, developers now not only work with human partners but also, as some claim, with AI pair programmers.<n>To analyze knowledge transfer in both human-human and human-AI settings, we conducted an empirical study.<n>We found a similar frequency of successful knowledge transfer episodes and overlapping topical categories across both settings.
arXiv Detail & Related papers (2025-06-05T09:13:30Z) - OpenHands: An Open Platform for AI Software Developers as Generalist Agents [109.8507367518992]
We introduce OpenHands, a platform for the development of AI agents that interact with the world in similar ways to a human developer.<n>We describe how the platform allows for the implementation of new agents, safe interaction with sandboxed environments for code execution, and incorporation of evaluation benchmarks.
arXiv Detail & Related papers (2024-07-23T17:50:43Z) - Impact of the Availability of ChatGPT on Software Development: A Synthetic Difference in Differences Estimation using GitHub Data [49.1574468325115]
ChatGPT is an AI tool that enhances software production efficiency.
We estimate ChatGPT's effects on the number of git pushes, repositories, and unique developers per 100,000 people.
These results suggest that AI tools like ChatGPT can substantially boost developer productivity, though further analysis is needed to address potential downsides such as low quality code and privacy concerns.
arXiv Detail & Related papers (2024-06-16T19:11:15Z) - Generative AI for Pull Request Descriptions: Adoption, Impact, and
Developer Interventions [11.620351603683496]
GitHub's Copilot for Pull Requests (PRs) is a promising service aiming to automate various developer tasks related to PRs.
In this study, we examine 18,256 PRs in which parts of the descriptions were crafted by generative AI.
Our findings indicate that Copilot for PRs, though in its infancy, is seeing a marked uptick in adoption.
arXiv Detail & Related papers (2024-02-14T06:20:57Z) - The GitHub Development Workflow Automation Ecosystems [47.818229204130596]
Large-scale software development has become a highly collaborative endeavour.
This chapter explores the ecosystems of development bots and GitHub Actions.
It provides an extensive survey of the state-of-the-art in this domain.
arXiv Detail & Related papers (2023-05-08T15:24:23Z) - Investigating Explainability of Generative AI for Code through
Scenario-based Design [44.44517254181818]
generative AI (GenAI) technologies are maturing and being applied to application domains such as software engineering.
We conduct 9 workshops with 43 software engineers in which real examples from state-of-the-art generative AI models were used to elicit users' explainability needs.
Our work explores explainability needs for GenAI for code and demonstrates how human-centered approaches can drive the technical development of XAI in novel domains.
arXiv Detail & Related papers (2022-02-10T08:52:39Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.