How Gamification Affects Software Developers: Cautionary Evidence from a Natural Experiment on GitHub

• URL: http://arxiv.org/abs/2006.02371v3
• Date: Mon, 10 May 2021 14:36:19 GMT
• Title: How Gamification Affects Software Developers: Cautionary Evidence from a Natural Experiment on GitHub
• Authors: Lukas Moldon, Markus Strohmaier, Johannes Wachs
• Abstract summary: We find that the unannounced removal of daily activity streak counters from the user interface was followed by significant changes in behavior. Long-running streaks of activity were abandoned and became less common. We find that some developers abandon a goal to make contributions for 100 days in a row following the removal of the public streak counter.
• Score: 6.123324869194196
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: We examine how the behavior of software developers changes in response to removing gamification elements from GitHub, an online platform for collaborative programming and software development. We find that the unannounced removal of daily activity streak counters from the user interface (from user profile pages) was followed by significant changes in behavior. Long-running streaks of activity were abandoned and became less common. Weekend activity decreased and days in which developers made a single contribution became less common. Synchronization of streaking behavior in the platform's social network also decreased, suggesting that gamification is a powerful channel for social influence. Focusing on a set of software developers that were publicly pursuing a goal to make contributions for 100 days in a row, we find that some of these developers abandon this quest following the removal of the public streak counter. Our findings provide evidence for the significant impact of gamification on the behavior of developers on large collaborative programming and software development platforms. They urge caution: gamification can steer the behavior of software developers in unexpected and unwanted directions.

Related papers

• Understanding Code Understandability Improvements in Code Reviews [79.16476505761582]
  We analyzed 2,401 code review comments from Java open-source projects on GitHub. 83.9% of suggestions for improvement were accepted and integrated, with fewer than 1% later reverted.
  arXiv  Detail & Related papers  (2024-10-29T12:21:23Z)
• Identifying Factors Contributing to Bad Days for Software Developers: A Mixed Methods Study [1.1545092788508224]
  The presence of friction can significantly hinder productivity, increase frustration, and contribute to low morale among developers. This research employed a mixed-method approach, including interviews, surveys, diary studies, and analysis of developer telemetry data. Findings revealed factors that cause "bad days" for developers and significantly impact their work and well-being.
  arXiv  Detail & Related papers  (2024-10-24T02:43:33Z)
• OpenHands: An Open Platform for AI Software Developers as Generalist Agents [109.8507367518992]
  We introduce OpenHands, a platform for the development of AI agents that interact with the world in similar ways to a human developer. We describe how the platform allows for the implementation of new agents, safe interaction with sandboxed environments for code execution, and incorporation of evaluation benchmarks.
  arXiv  Detail & Related papers  (2024-07-23T17:50:43Z)
• Impact of the Availability of ChatGPT on Software Development: A Synthetic Difference in Differences Estimation using GitHub Data [49.1574468325115]
  ChatGPT is an AI tool that enhances software production efficiency. We estimate ChatGPT's effects on the number of git pushes, repositories, and unique developers per 100,000 people. These results suggest that AI tools like ChatGPT can substantially boost developer productivity, though further analysis is needed to address potential downsides such as low quality code and privacy concerns.
  arXiv  Detail & Related papers  (2024-06-16T19:11:15Z)
• Characterising Developer Sentiment in Software Components: An Exploratory Study of Gentoo [6.253919624802852]
  Collaborative software development happens in teams, that cooperate on shared artefacts, and discuss development on online platforms. Previous research has shown how communication between team members, especially in an open-source environment, can become extremely toxic. Our study shows that, in recent years, negative emotions have generally decreased in the communication between Gentoo developers.
  arXiv  Detail & Related papers  (2024-05-27T09:22:47Z)
• Improving Testing Behavior by Gamifying IntelliJ [13.086283144520513]
  We introduce IntelliGame, a gamified plugin for the popular IntelliJ Java Integrated Development Environment. IntelliGame rewards developers for positive testing behavior using a multi-level achievement system. A controlled experiment with 49 participants reveals substantial differences in the testing behavior triggered by IntelliGame.
  arXiv  Detail & Related papers  (2023-10-17T11:40:55Z)
• Emoji Promotes Developer Participation and Issue Resolution on GitHub [20.29522783013561]
  We study how emoji usage influences developer participation and issue resolution in virtual workspaces. We find that emojis can significantly reduce the resolution time of issues and attract more user participation.
  arXiv  Detail & Related papers  (2023-08-30T23:26:33Z)
• CONCORD: Clone-aware Contrastive Learning for Source Code [64.51161487524436]
  Self-supervised pre-training has gained traction for learning generic code representations valuable for many downstream SE tasks. We argue that it is also essential to factor in how developers code day-to-day for general-purpose representation learning. In particular, we propose CONCORD, a self-supervised, contrastive learning strategy to place benign clones closer in the representation space while moving deviants further apart.
  arXiv  Detail & Related papers  (2023-06-05T20:39:08Z)
• The GitHub Development Workflow Automation Ecosystems [47.818229204130596]
  Large-scale software development has become a highly collaborative endeavour. This chapter explores the ecosystems of development bots and GitHub Actions. It provides an extensive survey of the state-of-the-art in this domain.
  arXiv  Detail & Related papers  (2023-05-08T15:24:23Z)
• A Lot of Talk and a Badge: An Exploratory Analysis of Personal Achievements in GitHub [13.556531448699284]
  GitHub introduced a new element through personal achievements, whereby badges are unlocked and displayed on developers' personal profile pages in recognition of their development activities. We present an exploratory analysis using mixed methods to study the diffusion of personal badges in GitHub. We find that most of the developers sampled own at least a badge, but we also observe an increasing number of users who choose to keep their profile private and opt out of displaying badges.
  arXiv  Detail & Related papers  (2023-03-26T12:08:50Z)
• Using Developer Discussions to Guide Fixing Bugs in Software [51.00904399653609]
  We propose using bug report discussions, which are available before the task is performed and are also naturally occurring, avoiding the need for additional information from developers. We demonstrate that various forms of natural language context derived from such discussions can aid bug-fixing, even leading to improved performance over using commit messages corresponding to the oracle bug-fixing commits.
  arXiv  Detail & Related papers  (2022-11-11T16:37:33Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.