"I'm Not Reading All of That": Understanding Software Engineers' Level of Cognitive Engagement with Agentic Coding Assistants

• URL: http://arxiv.org/abs/2603.14225v2
• Date: Wed, 18 Mar 2026 13:41:18 GMT
• Title: "I'm Not Reading All of That": Understanding Software Engineers' Level of Cognitive Engagement with Agentic Coding Assistants
• Abstract summary: Over-reliance on AI systems can undermine users' critical thinking and promote complacency.<n>In software engineering, agentic coding assistants (ACAs) are rapidly becoming embedded in everyday development.
• Score: 9.74467739744379
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Over-reliance on AI systems can undermine users' critical thinking and promote complacency, a risk intensified by the emergence of agentic AI systems that operate with minimal human involvement. In software engineering, agentic coding assistants (ACAs) are rapidly becoming embedded in everyday development workflows. Since software engineers (SEs) create systems deployed across diverse and high-stakes real-world contexts, these assistants must function not merely as autonomous task performers but as Tools for Thought that actively support human reasoning and sensemaking. We conducted a formative study examining software engineers' cognitive engagement and sensemaking processes when working with an ACA. Our findings reveal that cognitive engagement consistently declines as tasks progress, and that current ACA designs provide limited affordances for reflection, verification, and meaning-making. Based on these findings, we identify concrete design opportunities leveraging richer interaction modalities and cognitive-forcing mechanisms to sustain engagement and promote deeper thinking in AI-assisted programming.

Related papers

• AgentForge: An Immersive Role-Playing Platform for Learning Agentic Software Engineering [4.609790123179083]
  We present textitAgentForge, an immersive learning system in which novices take on one of four software-engineering roles.<n>In each practice session, novices perform their chosen role while AI agents perform the remaining three.<n>In a study with 37 novice developers, participants achieved high task-completion rates with AI-agent support.
  arXiv  Detail & Related papers  (2026-08-04T18:58:18Z)
• Agents That Teach: Towards Designing Incidental Learning Back into AI-Assisted Software Development [1.6193916818014198]
  We argue that incidental learning will not re-emerge on its own and must be consciously designed back into developer-agent interactions.<n>We present "SHIELD", a multi-agent system grounded in the notion of "agents that teach"<n>We envision a path toward learning-aware development environments where productivity and learning are complementary, not competing.
  arXiv  Detail & Related papers  (2026-07-07T10:14:44Z)
• Fundamentals of Building Autonomous LLM Agents [64.39018305018904]
  This paper reviews the architecture and implementation methods of agents powered by large language models (LLMs)<n>The research aims to explore patterns to develop "agentic" LLMs that can automate complex tasks and bridge the performance gap with human capabilities.
  arXiv  Detail & Related papers  (2025-10-10T10:32:39Z)
• AI Agentic Programming: A Survey of Techniques, Challenges, and Opportunities [8.086360127362815]
  Large language model (LLM)-based coding agents autonomously plan, execute, and interact with tools such as compilers, debuggers, and version control systems.<n>Unlike conventional code generation, these agents decompose goals, coordinate multi-step processes, and adapt based on feedback, reshaping software development practices.
  arXiv  Detail & Related papers  (2025-08-15T00:14:31Z)
• Code with Me or for Me? How Increasing AI Automation Transforms Developer Workflows [60.04362496037186]
  We present the first controlled study of developer interactions with coding agents.<n>We evaluate two leading copilot and agentic coding assistants.<n>Our results show agents can assist developers in ways that surpass copilots.
  arXiv  Detail & Related papers  (2025-07-10T20:12:54Z)
• Multi-agent Embodied AI: Advances and Future Directions [46.23631919950584]
  Embodied artificial intelligence (Embodied AI) plays a pivotal role in the application of advanced technologies in the intelligent era.<n>This paper reviews the current state of research, analyzes key contributions, and identifies challenges and future directions.
  arXiv  Detail & Related papers  (2025-05-08T10:13:53Z)
• Explainability for Embedding AI: Aspirations and Actuality [1.8130068086063336]
  Explainable AI (XAI) may allow developers to understand better the systems they build.<n>Existing XAI systems still fall short of this aspiration.<n>We see an unmet need to provide developers with adequate support mechanisms to cope with this complexity.
  arXiv  Detail & Related papers  (2025-04-20T14:20:01Z)
• The Impact of Generative AI Coding Assistants on Developers Who Are Visually Impaired [3.2895414694900684]
  We conducted a study where developers who are visually impaired completed a series of programming tasks using a generative AI coding assistant.<n>While participants found the AI assistant beneficial and reported significant advantages, they also highlighted accessibility challenges.<n>Our findings emphasize the need to apply activity-centered design principles to generative AI assistants.
  arXiv  Detail & Related papers  (2025-03-10T22:06:43Z)
• Assistance or Disruption? Exploring and Evaluating the Design and Trade-offs of Proactive AI Programming Support [36.082282294551405]
  We introduce and evaluate Codellaborator, a design probe agent that initiates programming assistance based on editor activities and task context.<n>We find that proactive agents increase efficiency compared to prompt-only paradigm, but also incur workflow disruptions.
  arXiv  Detail & Related papers  (2025-02-25T21:37:25Z)
• Imagining and building wise machines: The centrality of AI metacognition [78.76893632793497]
  We examine what is known about human wisdom and sketch a vision of its AI counterpart.<n>We argue that AI systems particularly struggle with metacognition.<n>We discuss how wise AI might be benchmarked, trained, and implemented.
  arXiv  Detail & Related papers  (2024-11-04T18:10:10Z)
• WorkArena++: Towards Compositional Planning and Reasoning-based Common Knowledge Work Tasks [85.95607119635102]
  Large language models (LLMs) can mimic human-like intelligence.<n>WorkArena++ is designed to evaluate the planning, problem-solving, logical/arithmetic reasoning, retrieval, and contextual understanding abilities of web agents.
  arXiv  Detail & Related papers  (2024-07-07T07:15:49Z)
• Position Paper: Agent AI Towards a Holistic Intelligence [53.35971598180146]
  We emphasize developing Agent AI -- an embodied system that integrates large foundation models into agent actions. In this paper, we propose a novel large action model to achieve embodied intelligent behavior, the Agent Foundation Model.
  arXiv  Detail & Related papers  (2024-02-28T16:09:56Z)
• Incremental procedural and sensorimotor learning in cognitive humanoid robots [52.77024349608834]
  This work presents a cognitive agent that can learn procedures incrementally. We show the cognitive functions required in each substage and how adding new functions helps address tasks previously unsolved by the agent. Results show that this approach is capable of solving complex tasks incrementally.
  arXiv  Detail & Related papers  (2023-04-30T22:51:31Z)
• Watch-And-Help: A Challenge for Social Perception and Human-AI Collaboration [116.28433607265573]
  We introduce Watch-And-Help (WAH), a challenge for testing social intelligence in AI agents. In WAH, an AI agent needs to help a human-like agent perform a complex household task efficiently. We build VirtualHome-Social, a multi-agent household environment, and provide a benchmark including both planning and learning based baselines.
  arXiv  Detail & Related papers  (2020-10-19T21:48:31Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.