How Do Developers Interact with AI? An Exploratory Study on Modeling Developer Programming Behavior
- URL: http://arxiv.org/abs/2604.16393v3
- Date: Thu, 30 Apr 2026 14:36:14 GMT
- Title: How Do Developers Interact with AI? An Exploratory Study on Modeling Developer Programming Behavior
- Abstract summary: We show how hidden intentions and emotional dimensions intertwine with concrete actions during AI-assisted programming.<n>Using AI assistants often makes developers more focused on actively creating code, evaluating, and verifying generated results.<n>Some developers reported impostor-like feelings, expressing guilt or self-doubt about relying on AI.
- Score: 8.956327421839205
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Artificial Intelligence (AI) is reshaping how developers adopt software engineering practices, yet the multi-dimensional nature of developer-AI interaction remains under-explored. Prior studies have primarily examined dimensions observable from developer activities such as "Prompt Crafting" and "Code Editing," overlooking how hidden intentions and emotional dimensions intertwine with concrete actions during AI-assisted programming. To understand this phenomenon, we conducted a mixed-methods study with 76 developers split into AI-assisted and non-AI groups. Each performed programming tasks (Python with API management or Java with SQL). Developers retrospectively labeled their self-reported intentions, tool-supported actions, and emotions from screen recordings, supplemented by surveys and interviews. Our user study resulted in a novel model named S-IASE with four dimensions to describe programming behavior: intention, action, supporting tool, and emotion for a given development state. Our analysis reveals aggregated and sequential behavioral patterns. For example, using AI assistants often makes developers more focused on actively creating code, evaluating, and verifying generated results. AI-assisted participants showed emotionally stable development flow, as opposed to non-AI-assisted participants who experienced more fluctuating emotions. Interviews revealed further nuance: some developers reported impostor-like feelings, expressing guilt or self-doubt about relying on AI. Our work bridges an important gap in understanding the complexities of developer-AI interaction in programming context.
Related papers
- A Preliminary Study on the Impact of AI in the Creativity and Collaboration in Software Teams [7.9711199981607885]
Generative artificial intelligence (GenAI) tools are reshaping software engineering work, increasingly acting as cognitive partners.<n>This paper examines how software engineering professionals perceive and integrate AI tools focusing on creativity and collaboration within teams.
arXiv Detail & Related papers (2026-07-18T10:07:56Z) - You Shall Not Pass! Where and Why Developers Draw The Line on AI Autonomy [7.477031451733673]
Most developers accepted AI producing work under their oversight, although accepted autonomy varied substantively across tasks and individuals.<n> Acceptance was lowest for identity-defining, human-facing, and design-oriented work, and higher among developers with more AI experience and risk tolerance.<n>Our findings suggest that preferences for AI autonomy reflect how developers cognitively experience their work.
arXiv Detail & Related papers (2026-07-01T07:24:14Z) - Intentmaking and Sensemaking: Human Interaction with AI-Guided Mathematical Discovery [72.49593499512092]
We identify and characterize a distinct workflow we term intentmaking.<n>We frame this as a natural extension to sensemaking.<n>Our documentation of these themes suggests an approach to designing AI tools for scientific discovery.
arXiv Detail & Related papers (2026-05-07T09:30:25Z) - Unpacking Vibe Coding: Help-Seeking Processes in Student-AI Interactions While Programming [1.3802799822705387]
Generative AI is reshaping higher education programming through vibe coding, where students collaborate with AI via natural language.<n>We analyze 19,418 interaction turns from 110 undergraduate students to compare top- and low-performing students.<n>Results reveal that top performers engaged in instrumental help-seeking, eliciting tutor-like AI responses.
arXiv Detail & Related papers (2026-04-29T19:35:10Z) - Choose Your Own Adventure: Non-Linear AI-Assisted Programming with EvoGraph [11.960431631791812]
EvoGraph is a plugin that integrates AI interactions and code changes as a lightweight and interactive development graph.<n>Our user study with 20 participants revealed that EvoGraph addressed developers' challenges while imposing lower cognitive load.<n>Our work highlights design opportunities for tools to help developers make sense of and act on their problem-solving progress in the emerging AI-mediated programming context.
arXiv Detail & Related papers (2026-04-20T22:05:09Z) - Bridging Minds and Machines: Toward an Integration of AI and Cognitive Science [48.38628297686686]
Cognitive Science has profoundly shaped disciplines such as Artificial Intelligence (AI), Philosophy, Psychology, Neuroscience, Linguistics, and Culture.<n>Many breakthroughs in AI trace their roots to cognitive theories, while AI itself has become an indispensable tool for advancing cognitive research.<n>We argue that the future of AI within Cognitive Science lies not only in improving performance but also in constructing systems that deepen our understanding of the human mind.
arXiv Detail & Related papers (2025-08-28T11:26:17Z) - The SPACE of AI: Real-World Lessons on AI's Impact on Developers [0.807084206814932]
We study how developers perceive AI's influence across the dimensions of the SPACE framework: Satisfaction, Performance, Activity, Collaboration and Efficiency.<n>We find that AI is broadly adopted and widely seen as enhancing productivity, particularly for routine tasks.<n>Developers report increased efficiency and satisfaction, with less evidence of impact on collaboration.
arXiv Detail & Related papers (2025-07-31T21:45:54Z) - How Software Engineers Engage with AI: A Pragmatic Process Model and Decision Framework Grounded in Industry Observations [1.516251872371896]
GitHub Copilot and ChatGPT have given rise to "vibe coding"<n>This paper presents two complementary contributions.<n>First, a pragmatic process model capturing real-world AI-assisted SE activities, including prompt design, inspection, fallback, and refinement.<n>Second, a 2D decision framework that could help developers reason about trade-offs between effort saved and output quality.
arXiv Detail & Related papers (2025-07-23T21:00:21Z) - Code with Me or for Me? How Increasing AI Automation Transforms Developer Workflows [60.04362496037186]
We present the first controlled study of developer interactions with coding agents.<n>We evaluate two leading copilot and agentic coding assistants.<n>Our results show agents can assist developers in ways that surpass copilots.
arXiv Detail & Related papers (2025-07-10T20:12:54Z) - From Teacher to Colleague: How Coding Experience Shapes Developer Perceptions of AI Tools [0.0]
AI-assisted development tools promise productivity gains and improved code quality, yet their adoption among developers remains inconsistent.<n>We analyze survey data from 3380 developers to examine how coding experience relates to AI awareness, adoption, and the roles developers assign to AI in their workflow.
arXiv Detail & Related papers (2025-04-08T08:58:06Z) - Survey of User Interface Design and Interaction Techniques in Generative AI Applications [79.55963742878684]
We aim to create a compendium of different user-interaction patterns that can be used as a reference for designers and developers alike.
We also strive to lower the entry barrier for those attempting to learn more about the design of generative AI applications.
arXiv Detail & Related papers (2024-10-28T23:10:06Z) - Seamful XAI: Operationalizing Seamful Design in Explainable AI [59.89011292395202]
Mistakes in AI systems are inevitable, arising from both technical limitations and sociotechnical gaps.
We propose that seamful design can foster AI explainability by revealing sociotechnical and infrastructural mismatches.
We explore this process with 43 AI practitioners and real end-users.
arXiv Detail & Related papers (2022-11-12T21:54:05Z) - Building Bridges: Generative Artworks to Explore AI Ethics [56.058588908294446]
In recent years, there has been an increased emphasis on understanding and mitigating adverse impacts of artificial intelligence (AI) technologies on society.
A significant challenge in the design of ethical AI systems is that there are multiple stakeholders in the AI pipeline, each with their own set of constraints and interests.
This position paper outlines some potential ways in which generative artworks can play this role by serving as accessible and powerful educational tools.
arXiv Detail & Related papers (2021-06-25T22:31:55Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.