"TODO: Fix the Mess Gemini Created": Towards Understanding GenAI-Induced Self-Admitted Technical Debt
- URL: http://arxiv.org/abs/2601.07786v1
- Date: Mon, 12 Jan 2026 17:59:34 GMT
- Title: "TODO: Fix the Mess Gemini Created": Towards Understanding GenAI-Induced Self-Admitted Technical Debt
- Abstract summary: GenAI-Induced Self-admitted Technical debt (GIST) is a proposed conceptual lens to describe recurring cases where developers incorporate AI-generated code while explicitly expressing uncertainty about its behavior or correctness.
- Score: 2.571080266714288
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: As large language models (LLMs) such as ChatGPT, Copilot, Claude, and Gemini become integrated into software development workflows, developers increasingly leave traces of AI involvement in their code comments. Among these, some comments explicitly acknowledge both the use of generative AI and the presence of technical shortcomings. Analyzing 6,540 LLM-referencing code comments from public Python and JavaScript-based GitHub repositories (November 2022-July 2025), we identified 81 that also self-admit technical debt(SATD). Developers most often describe postponed testing, incomplete adaptation, and limited understanding of AI-generated code, suggesting that AI assistance affects both when and why technical debt emerges. We term GenAI-Induced Self-admitted Technical debt (GIST) as a proposed conceptual lens to describe recurring cases where developers incorporate AI-generated code while explicitly expressing uncertainty about its behavior or correctness.
Related papers
- On Automated and Explainable Provenance of AI-Generated Code [56.818202904805446]
We argue that the next generation of CodeGenAI tools must be built on a foundation of explainable provenance.<n>We describe a research program combining large-scale empirical studies with post-hoc causal and interpretability techniques.
arXiv Detail & Related papers (2026-08-03T14:50:31Z) - Empirical Study on the Characteristics and Evolution of AI-usage in GitHub Repositories: Evidence from Code Comments [7.213400161126317]
We analyze 35,361 GitHub code comments that explicitly reference AI use and their associated code blocks.<n>We first open-code 500 unique comments and code blocks to derive a taxonomy of AI-assisted development activities.<n>We then annotate the full dataset using two LLM-based classifiers and aggregate predictions with Dawid-Skene expectation-maximization.
arXiv Detail & Related papers (2026-06-05T02:37:44Z) - Comprehension Debt in GenAI-Assisted Software Engineering Projects [1.1844977816228044]
This study investigates how GenAI tools contribute to Debt (CD) in the context of an undergraduate software engineering project.<n>We identify four CD accumulation patterns and one mitigating pattern in students' use of GenAI tools.<n>Our findings highlight the need for explicit pedagogical strategies to CD in software engineering education.
arXiv Detail & Related papers (2026-04-14T20:14:26Z) - To Copilot and Beyond: 22 AI Systems Developers Want Built [8.021702941771972]
We surveyed 860 Microsoft developers to understand where they want AI support, and where they want it to stay out.<n>We identify 22 AI systems that developers want built across five task categories.<n>For each, we describe the problem it solves, what makes it hard to build, and the constraints developers place on its behavior.
arXiv Detail & Related papers (2026-04-09T05:31:34Z) - Debt Behind the AI Boom: A Large-Scale Empirical Study of AI-Generated Code in the Wild [13.35459155979355]
We build a dataset of 304,362 verified AI-authored commits from 6,275 GitHub repositories.<n>We identify 484,606 distinct issues, and that code smells are by far the most common type, accounting for 89.1% of all issues.<n>These findings show that AI-generated code can introduce long-term maintenance costs into real software projects.
arXiv Detail & Related papers (2026-03-30T15:38:05Z) - Beyond Explainable AI (XAI): An Overdue Paradigm Shift and Post-XAI Research Directions [95.59915390053588]
This study focuses on Explainable Artificial Intelligence (XAI) approaches-focusing on deep neural networks (DNNs) and large language models (LLMs)<n>We discuss critical symptoms that stem from deeper root causes (i.e., two paradoxes, two conceptual confusions, and five false assumptions)<n>To move beyond XAI's limitations, we propose a four-pronged paradigm shift toward reliable and certified AI development.
arXiv Detail & Related papers (2026-02-27T16:58:27Z) - Mitigating "Epistemic Debt" in Generative AI-Scaffolded Novice Programming using Metacognitive Scripts [0.0]
Unrestricted AI encourages novices to outsource the Intrinsic Cognitive Load required for schema formation.<n>We show that successful vibe coders naturally engage in self-scaffolding, treating the AI as a consultant rather than a contractor.<n>We propose that future learning systems must enforce Metacognitive Friction to prevent the mass production of unmaintainable code.
arXiv Detail & Related papers (2026-02-22T21:25:04Z) - Comment Traps: How Defective Commented-out Code Augment Defects in AI-Assisted Code Generation [40.52928802861937]
GitHub Copilot and Cursor are revolutionizing software development practices.<n>Previous research has predominantly examined how code context influences the generation of defective code.<n>This study evaluates how AI coding assistants, GitHub Copilot and Cursor, are influenced by defective CO code.
arXiv Detail & Related papers (2025-12-23T13:08:19Z) - Vibe Coding in Practice: Motivations, Challenges, and a Future Outlook -- a Grey Literature Review [2.5195922470930614]
Vibe coding is the practice where users rely on AI code generation tools through intuition and trial-and-error without necessarily understanding the underlying code.<n>No research has systematically investigated why users engage in vibe coding, what they experience while doing so, and how they approach quality assurance (QA) and perceive the quality of the AI-generated code.<n>Our analysis reveals a speed-quality trade-off paradox, where vibe coders are motivated by speed and accessibility, often experiencing rapid instant success and flow'', yet most perceive the resulting code as fast but flawed.
arXiv Detail & Related papers (2025-09-30T22:35:00Z) - CoCoNUTS: Concentrating on Content while Neglecting Uninformative Textual Styles for AI-Generated Peer Review Detection [60.52240468810558]
We introduce CoCoNUTS, a content-oriented benchmark built upon a fine-grained dataset of AI-generated peer reviews.<n>We also develop CoCoDet, an AI review detector via a multi-task learning framework, to achieve more accurate and robust detection of AI involvement in review content.
arXiv Detail & Related papers (2025-08-28T06:03:11Z) - On Developers' Self-Declaration of AI-Generated Code: An Analysis of Practices [2.205621813527632]
This study aims to understand the ways developers use to self-declare AI-generated code.<n>In the first phase, we collected 613 instances of AI-generated code snippets from GitHub.<n>In the second phase, we conducted a follow-up practitioners' survey, which received 111 valid responses.
arXiv Detail & Related papers (2025-04-23T07:52:39Z) - Do Comments and Expertise Still Matter? An Experiment on Programmers' Adoption of AI-Generated JavaScript Code [8.673467364360857]
The adoption of AI-generated code was gauged by code similarity between AI-generated solutions and participants' submitted solutions.<n>Our findings revealed that, within the context of function-level programming tasks, the presence of comments significantly influences programmers' adoption of AI-generated code.
arXiv Detail & Related papers (2025-03-14T14:42:51Z) - Generation Probabilities Are Not Enough: Uncertainty Highlighting in AI Code Completions [54.55334589363247]
We study whether conveying information about uncertainty enables programmers to more quickly and accurately produce code.
We find that highlighting tokens with the highest predicted likelihood of being edited leads to faster task completion and more targeted edits.
arXiv Detail & Related papers (2023-02-14T18:43:34Z) - Seamful XAI: Operationalizing Seamful Design in Explainable AI [59.89011292395202]
Mistakes in AI systems are inevitable, arising from both technical limitations and sociotechnical gaps.
We propose that seamful design can foster AI explainability by revealing sociotechnical and infrastructural mismatches.
We explore this process with 43 AI practitioners and real end-users.
arXiv Detail & Related papers (2022-11-12T21:54:05Z) - Investigating Explainability of Generative AI for Code through
Scenario-based Design [44.44517254181818]
generative AI (GenAI) technologies are maturing and being applied to application domains such as software engineering.
We conduct 9 workshops with 43 software engineers in which real examples from state-of-the-art generative AI models were used to elicit users' explainability needs.
Our work explores explainability needs for GenAI for code and demonstrates how human-centered approaches can drive the technical development of XAI in novel domains.
arXiv Detail & Related papers (2022-02-10T08:52:39Z) - A User-Centred Framework for Explainable Artificial Intelligence in
Human-Robot Interaction [70.11080854486953]
We propose a user-centred framework for XAI that focuses on its social-interactive aspect.
The framework aims to provide a structure for interactive XAI solutions thought for non-expert users.
arXiv Detail & Related papers (2021-09-27T09:56:23Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.