From Technical Debt to Cognitive and Intent Debt: Rethinking Software Health in the Age of AI

• URL: http://arxiv.org/abs/2603.22106v3
• Date: Fri, 27 Mar 2026 17:49:45 GMT
• Title: From Technical Debt to Cognitive and Intent Debt: Rethinking Software Health in the Age of AI
• Abstract summary: Generative AI is accelerating software development, but may quietly shift where the real risks lie.<n>As AI generates code faster than teams can understand it, two under appreciated forms of debt accumulate: cognitive debt, the erosion of shared understanding across a team, and intent debt.<n>This article proposes a Triple Debt Model for reasoning about software health built around three interacting debt types.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Generative AI is accelerating software development, but may quietly shift where the real risks lie. As AI generates code faster than teams can understand it, two under appreciated forms of debt accumulate: cognitive debt, the erosion of shared understanding across a team, and intent debt, the absence of externalized rationale that both developers and AI agents need to work safely with code. This article proposes a Triple Debt Model for reasoning about software health built around three interacting debt types: technical debt in code, cognitive debt in people, and intent debt in externalized knowledge. Cognitive debt concerns what people understand; intent debt concerns what is explicitly captured for humans and machines to use. We discuss how generative AI changes the relative importance of these debt types, how each can be diagnosed and mitigated, and surfaced points of debate for practitioners.

Related papers

• Cognitive Debt: AI as Intellectual Leverage and the Dynamics of Systemic Fragility [0.65268245109828]
  We develop a formal theory of cognitive debt, the stock of unverified reasoning obligations that accumulates when individuals use AI as a substitute.<n> Rational agents incur positive cognitive debt because the costs are deferred, partially external, and masked by short-run productivity gains.<n>In a two-type heterogeneous-agent economy, high-cognitive-capital agents adopt AI more intensively and may eventually erode their unaided cognitive capital below that of initially lower-skilled agents.
  arXiv  Detail & Related papers  (2026-06-13T03:16:54Z)
• Characterizing initial human-AI proof formalization workflows [66.06866890889131]
  Advances in AI systems' ability to generate code and engage in increasingly high-level mathematical reasoning promise to transform people's ability to formalize and thereby verify proofs.<n>We conduct a mixed-methods analysis into the initial impact of AI on people's formalization.<n>A qualitative survey shows that people's preferences are diverse, but with a general desire for AI assistance in formalization.
  arXiv  Detail & Related papers  (2026-06-02T22:58:19Z)
• Trustworthy AI Suffers from Invariance Conflicts and Causality is The Solution [80.98492754957466]
  Core trustworthy AI objectives, such as fairness, robustness, privacy, and explainability, are hard to achieve simultaneously.<n>This paper argues that causality is necessary to understand and balance trade-offs in performance and multiple objectives of trustworthy AI.
  arXiv  Detail & Related papers  (2026-05-04T14:26:28Z)
• Comprehension Debt in GenAI-Assisted Software Engineering Projects [1.1844977816228044]
  This study investigates how GenAI tools contribute to Debt (CD) in the context of an undergraduate software engineering project.<n>We identify four CD accumulation patterns and one mitigating pattern in students' use of GenAI tools.<n>Our findings highlight the need for explicit pedagogical strategies to CD in software engineering education.
  arXiv  Detail & Related papers  (2026-04-14T20:14:26Z)
• Mitigating "Epistemic Debt" in Generative AI-Scaffolded Novice Programming using Metacognitive Scripts [0.0]
  Unrestricted AI encourages novices to outsource the Intrinsic Cognitive Load required for schema formation.<n>We show that successful vibe coders naturally engage in self-scaffolding, treating the AI as a consultant rather than a contractor.<n>We propose that future learning systems must enforce Metacognitive Friction to prevent the mass production of unmaintainable code.
  arXiv  Detail & Related papers  (2026-02-22T21:25:04Z)
• "TODO: Fix the Mess Gemini Created": Towards Understanding GenAI-Induced Self-Admitted Technical Debt [2.571080266714288]
  GenAI-Induced Self-admitted Technical debt (GIST) is a proposed conceptual lens to describe recurring cases where developers incorporate AI-generated code while explicitly expressing uncertainty about its behavior or correctness.
  arXiv  Detail & Related papers  (2026-01-12T17:59:34Z)
• Beyond Technical Debt: How AI-Assisted Development Creates Comprehension Debt in Resource-Constrained Indie Teams [29.850754213301368]
  This study introduces the CIGDI (Co-Intelligence Game Development Ideation) Framework.<n>The framework emerged from a three-month reflective practice and autoethnographic study of a three-person distributed team developing the 2D narrative game "The Worm's Memoirs"<n>While AI support democratized knowledge access and reduced cognitive load, our analysis identified a significant challenge: "comprehension debt"
  arXiv  Detail & Related papers  (2025-10-30T12:41:26Z)
• Bridging Minds and Machines: Toward an Integration of AI and Cognitive Science [48.38628297686686]
  Cognitive Science has profoundly shaped disciplines such as Artificial Intelligence (AI), Philosophy, Psychology, Neuroscience, Linguistics, and Culture.<n>Many breakthroughs in AI trace their roots to cognitive theories, while AI itself has become an indispensable tool for advancing cognitive research.<n>We argue that the future of AI within Cognitive Science lies not only in improving performance but also in constructing systems that deepen our understanding of the human mind.
  arXiv  Detail & Related papers  (2025-08-28T11:26:17Z)
• EmoDebt: Bayesian-Optimized Emotional Intelligence for Strategic Agent-to-Agent Debt Recovery [65.30120701878582]
  Large Language Model (LLM) agents are vulnerable to exploitation in emotion-sensitive domains like debt collection.<n>EmoDebt is an emotional intelligence engine that reframes a model's ability to express emotion in negotiation as a sequential decision-making problem.<n>EmoDebt achieves significant strategic robustness, substantially outperforming non-adaptive and emotion-agnostic baselines.
  arXiv  Detail & Related papers  (2025-03-27T01:41:34Z)
• Evaluating Intelligence via Trial and Error [59.80426744891971]
  We introduce Survival Game as a framework to evaluate intelligence based on the number of failed attempts in a trial-and-error process.<n>When the expectation and variance of failure counts are both finite, it signals the ability to consistently find solutions to new challenges.<n>Our results show that while AI systems achieve the Autonomous Level in simple tasks, they are still far from it in more complex tasks.
  arXiv  Detail & Related papers  (2025-02-26T05:59:45Z)
• Imagining and building wise machines: The centrality of AI metacognition [78.76893632793497]
  We examine what is known about human wisdom and sketch a vision of its AI counterpart.<n>We argue that AI systems particularly struggle with metacognition.<n>We discuss how wise AI might be benchmarked, trained, and implemented.
  arXiv  Detail & Related papers  (2024-11-04T18:10:10Z)
• Technical Debt Management: The Road Ahead for Successful Software Delivery [40.45645113369735]
  Technical Debt, considered by many to be the'silent killer' of software projects, has undeniably become part of the everyday vocabulary of software engineers. In this paper, we examine the state of the art in both industry and research communities in managing Technical Debt.
  arXiv  Detail & Related papers  (2024-03-11T07:48:35Z)
• Seamful XAI: Operationalizing Seamful Design in Explainable AI [59.89011292395202]
  Mistakes in AI systems are inevitable, arising from both technical limitations and sociotechnical gaps. We propose that seamful design can foster AI explainability by revealing sociotechnical and infrastructural mismatches. We explore this process with 43 AI practitioners and real end-users.
  arXiv  Detail & Related papers  (2022-11-12T21:54:05Z)
• Cybertrust: From Explainable to Actionable and Interpretable AI (AI2) [58.981120701284816]
  Actionable and Interpretable AI (AI2) will incorporate explicit quantifications and visualizations of user confidence in AI recommendations. It will allow examining and testing of AI system predictions to establish a basis for trust in the systems' decision making.
  arXiv  Detail & Related papers  (2022-01-26T18:53:09Z)
• Building Bridges: Generative Artworks to Explore AI Ethics [56.058588908294446]
  In recent years, there has been an increased emphasis on understanding and mitigating adverse impacts of artificial intelligence (AI) technologies on society. A significant challenge in the design of ethical AI systems is that there are multiple stakeholders in the AI pipeline, each with their own set of constraints and interests. This position paper outlines some potential ways in which generative artworks can play this role by serving as accessible and powerful educational tools.
  arXiv  Detail & Related papers  (2021-06-25T22:31:55Z)
• UX Debt: Developers Borrow While Users Pay [2.9479490707938982]
  User experience (UX) debt focuses on shortcuts taken to speed up development at the expense of subpar usability. Most research considers code-centric technical debt, focusing on the implementation. We outline three classes of UX debt that we observed in practice: code-centric, architecture-centric, and process-centric.
  arXiv  Detail & Related papers  (2021-04-14T14:59:44Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.