Factors Impacting Developer Efficiency: Results from an Adaptive Longitudinal Study

• URL: http://arxiv.org/abs/2608.16596v1
• Date: Mon, 17 Aug 2026 13:53:03 GMT
• Title: Factors Impacting Developer Efficiency: Results from an Adaptive Longitudinal Study
• Abstract summary: This study investigates the primary factors hindering the perceived efficiency of developers in a consulting and professional development context.<n>We conducted a mixed-methods longitudinal case study applying the Adaptive Developer Efficiency Monitoring Method (ADEMM) to 27 external software developers.
• Score: 0.8373057326694192
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Context: Developer efficiency is driven by technical, organizational, and personal factors, yet few longitudinal studies explore how these factors evolve over time. Objective: This study investigates the primary factors hindering the perceived efficiency of developers in a consulting and professional development context, analyzing how these factors vary across recurring data collection cycles and how they are described qualitatively. Method: We conducted a mixed-methods longitudinal case study applying the Adaptive Developer Efficiency Monitoring Method (ADEMM) to 27 external software developers, combining twelve waves of periodic surveys with eighteen semi-structured interviews, analyzed through statistical and thematic analysis. Results: The most frequent bottlenecks were organizational dependencies and waiting for external validation, which stayed structurally stable, followed by technical knowledge gaps, which declined as developers adapted. A generative AI usage barrier emerged qualitatively nine waves into the study, was incorporated into the survey instrument, and became the most frequently coded interview theme. Interviews corroborated the quantitative findings, with insufficient requirements documentation and organizational dependencies as the most recurrent themes alongside AI-related challenges. Conclusions: Perceived developer efficiency is highly dynamic and cannot be accurately captured through a single cross-sectional measurement. Adaptive monitoring via ADEMM identified an emerging factor, generative AI usage barriers, that a fixed instrument would have missed, and informed a concrete organizational intervention during the study. For organizations managing external developers, actions should target external dependencies, communication channels, and developers' evolving use of AI tools.

Related papers

• AI Contextual Measurement for Recovering Individual and Group-Level Effects: Validation Against Survey Measures and an Occupational Application [3.4545547482062378]
  AICOME is a framework for evaluating whether AI-derived respondent-level measures can recover individual and group-level effects in contextual models.<n>We validate the framework using the 2022 China Family Panel Studies (CFPS), where occupations provide the empirical grouping structure.<n>Results show that AI contextual measurement can recover much of the contextual-model information contained in observed survey variables when rich respondent and job characteristics are available.
  arXiv  Detail & Related papers  (2026-09-02T17:09:30Z)
• ADEMM: A Longitudinal Method for Monitoring Developer Efficiency in Industry [0.8373057326694192]
  This study proposes and evaluates the Adaptive Developer Efficiency Monitoring Method (ADEMM)<n>ADEMM is an adaptive longitudinal method for monitoring developer efficiency when the monitoring organization does not directly employ the developers.
  arXiv  Detail & Related papers  (2026-08-17T13:42:30Z)
• Exploring Dependence, Overreliance, and Addiction Related Behaviors Associated with Large Language Model Use Among Software Engineers [1.8757823231879849]
  This study investigates how software engineers experience the use of Large Language Models (LLMs) during professional software development.<n>The data were analyzed using descriptive statistics and qualitative thematic analysis of participants' open-ended responses.
  arXiv  Detail & Related papers  (2026-08-06T03:27:57Z)
• Developers' Experience with Generative AI Beyond Productivity Assessment -- Insights from an Empirical Mixed-Methods Field Study [7.932998356208937]
  This paper investigates how professional developers engage with Generative AI (GenAI) in their natural work environment.<n>Results show developers are generally satisfied with GenAI, particularly for monotonous, repetitive, and structured tasks.<n>During development-heavy tasks, results indicate that perceived cognitive load arises from AI interaction, while perceived productivity depends on AI output quality.
  arXiv  Detail & Related papers  (2026-07-02T15:43:21Z)
• AMATA: Adaptive Multi-Agent Trajectory Alignment for Knowledge-Intensive Question Answering [59.145044878490815]
  AMATA is an Adaptive Multi-Agent Trajectory Alignment framework.<n>It dynamically integrates external knowledge to improve response interpretability and factual grounding.<n>We introduce two principal innovations: (1) Intra-Trajectory Preference Learning, which learns objective-oriented preferences to prioritize critical agents, and (2) Inter-Agent Dependency Learning, which captures cross-agent tool dependencies.
  arXiv  Detail & Related papers  (2026-05-17T09:45:24Z)
• Beyond Individual Intelligence: Surveying Collaboration, Failure Attribution, and Self-Evolution in LLM-based Multi-Agent Systems [65.90791804095561]
  Multi-agent systems address this through structured collaboration among specialized agents, but tighter coordination amplifies a less explored risk.<n>Existing surveys cover individual agent capabilities, multi-agent collaboration, or agent self-evolution separately, leaving the causal dependencies among them unexamined.<n>This survey provides a unified review organized around four causally linked stages, which we term the LIFE progression: Lay the capability foundation, Integrate agents through collaboration, Find faults through attribution, and Evolve through autonomous self-improvement.
  arXiv  Detail & Related papers  (2026-05-14T14:36:13Z)
• IACDM: Interactive Adversarial Convergence Development Methodology -- A Structured Framework for AI-Assisted Software Development [0.0]
  This paper argues that failures share a structural cause -- the verification gap.<n>We present IACDM, a structured 8-phase framework designed to address the verification gap through external verification agents.
  arXiv  Detail & Related papers  (2026-03-31T09:48:09Z)
• Factors Influencing the Quality of AI-Generated Code: A Synthesis of Empirical Evidence [1.4465033892011254]
  The rapid adoption of AI-assisted code generation tools is transforming software development practices.<n>Concerns regarding the quality, reliability, and security of AI-generated code are increasingly reported in both academia and industry.
  arXiv  Detail & Related papers  (2026-03-26T08:06:42Z)
• Automated Self-Testing as a Quality Gate: Evidence-Driven Release Management for LLM Applications [51.56484100374058]
  We present an automated self-testing framework that introduces quality gates with evidence-based release decisions.<n>We evaluate the framework through a longitudinal case study of an internally deployed multi-agent conversational AI system.
  arXiv  Detail & Related papers  (2026-03-13T20:44:15Z)
• Leveraging LLM Parametric Knowledge for Fact Checking without Retrieval [60.25608870901428]
  Trustworthiness is a core research challenge for agentic AI systems built on Large Language Models (LLMs)<n>We propose the task of fact-checking without retrieval, focusing on the verification of arbitrary natural language claims, independent of their source robustness.
  arXiv  Detail & Related papers  (2026-03-05T18:42:51Z)
• SelfAI: Building a Self-Training AI System with LLM Agents [79.10991818561907]
  SelfAI is a general multi-agent platform that combines a User Agent for translating high-level research objectives into standardized experimental configurations.<n>An Experiment Manager orchestrates parallel, fault-tolerant training across heterogeneous hardware while maintaining a structured knowledge base for continuous feedback.<n>Across regression, computer vision, scientific computing, medical imaging, and drug discovery benchmarks, SelfAI consistently achieves strong performance and reduces redundant trials.
  arXiv  Detail & Related papers  (2025-11-29T09:18:39Z)
• Interactive Agents to Overcome Ambiguity in Software Engineering [61.40183840499932]
  AI agents are increasingly being deployed to automate tasks, often based on ambiguous and underspecified user instructions.<n>Making unwarranted assumptions and failing to ask clarifying questions can lead to suboptimal outcomes.<n>We study the ability of LLM agents to handle ambiguous instructions in interactive code generation settings by evaluating proprietary and open-weight models on their performance.
  arXiv  Detail & Related papers  (2025-02-18T17:12:26Z)
• GATEAU: Selecting Influential Samples for Long Context Alignment [59.579128690086385]
  GATEAU identifies influential samples enriched with long-range dependency relations.<n>Model trained on selected samples exhibits better instruction-following and long-context understanding capabilities.
  arXiv  Detail & Related papers  (2024-10-21T04:30:53Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.