Smells Depend on the Context: An Interview Study of Issue Tracking Problems and Smells in Practice

• URL: http://arxiv.org/abs/2601.04124v2
• Date: Mon, 12 Jan 2026 09:03:20 GMT
• Title: Smells Depend on the Context: An Interview Study of Issue Tracking Problems and Smells in Practice
• Authors: Lloyd Montgomery, Clara Lüders, Christian Rahe, Walid Maalej,
• Abstract summary: Little is known about the challenges Software Engineering teams encounter in ITSs.<n>We conducted an in-depth interview study with 26 experienced SE practitioners.<n>We identified 14 common problems including issue findability, zombie issues, workflow bloat, and lack of workflow enforcement.<n>Our results suggest that ITS problems and smells are highly dependent on context factors such as ITS configuration, workflow stage, and team size.
• Score: 5.280471121231262
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Issue Tracking Systems (ITSs) enable software developers and managers to collect and resolve issues collaboratively. While researchers have extensively analysed ITS data to automate or assist specific activities such as issue assignments, duplicate detection, or priority prediction, developer studies on ITSs remain rare. Particularly, little is known about the challenges Software Engineering (SE) teams encounter in ITSs and when certain practices and workarounds (such as leaving issue fields like "priority" empty) are considered problematic. To fill this gap, we conducted an in-depth interview study with 26 experienced SE practitioners from different organisations and industries. We asked them about general problems encountered, as well as the relevance of 31 ITS smells (aka potentially problematic practices) discussed in the literature. By applying Thematic Analysis to the interview notes, we identified 14 common problems including issue findability, zombie issues, workflow bloat, and lack of workflow enforcement. Participants also stated that many of the ITS smells do not occur or are not problematic. Our results suggest that ITS problems and smells are highly dependent on context factors such as ITS configuration, workflow stage, and team size. We also discuss potential tooling solutions to configure, monitor, and visualise ITS smells to cope with these challenges.

Related papers

• BeyondSWE: Can Current Code Agent Survive Beyond Single-Repo Bug Fixing? [61.247730037229815]
  We introduce BeyondSWE, a comprehensive benchmark that broadens existing evaluations along two axes - resolution scope and knowledge scope.<n>To investigate the role of external knowledge, we develop SearchSWE, a framework that integrates deep search with coding abilities.<n>This work offers both a realistic, challenging evaluation benchmark and a flexible framework to advance research toward more capable code agents.
  arXiv  Detail & Related papers  (2026-03-03T17:52:01Z)
• What Drives Issue Resolution Speed? An Empirical Study of Scientific Workflow Systems on GitHub [4.902956965439]
  Scientific Systems (SWSs) play a vital role in enabling reproducible, scalable, and automated scientific analysis.<n>This paper presents an empirical study of issue management and resolution across a collection of GitHub-hosted SWS projects.
  arXiv  Detail & Related papers  (2025-12-21T18:41:27Z)
• FrontierCS: Evolving Challenges for Evolving Intelligence [174.80075821079708]
  We introduce FrontierCS, a benchmark of 156 open-ended problems across diverse areas of computer science.<n>For each problem we provide an expert reference solution and an automatic evaluator.<n>We find that frontier reasoning models still lag far behind human experts on both the algorithmic and research tracks.
  arXiv  Detail & Related papers  (2025-12-17T18:52:45Z)
• Issue Tracking Ecosystems: Context and Best Practices [0.0]
  GitHub and Jira are popular tools that support Software Engineering (SE) organisations through the management of issues''<n>An Issue Tracking Ecosystem (ITE) is the aggregate of the central ITS and the related SE artefacts, stakeholders, and processes.<n>I undertake the challenge of understanding ITEs at a broader level, addressing these questions regarding complexity and diversity.
  arXiv  Detail & Related papers  (2025-07-09T09:57:13Z)
• An Empirical Investigation on the Challenges in Scientific Workflow Systems Development [6.920993703034064]
  This study examines interactions between developers and researchers on Stack Overflow (SO) and GitHub.<n>By analyzing issues, we identified 13 topics (e.g., Errors and Bug Fixing, Documentation, Dependencies) and discovered that data structures and operations is the most difficult.<n>We also found common topics between SO and GitHub, such as data structures and operations, task management, and workflow scheduling.
  arXiv  Detail & Related papers  (2024-11-16T21:14:11Z)
• SUPER: Evaluating Agents on Setting Up and Executing Tasks from Research Repositories [55.161075901665946]
  Super aims to capture the realistic challenges faced by researchers working with Machine Learning (ML) and Natural Language Processing (NLP) research repositories. Our benchmark comprises three distinct problem sets: 45 end-to-end problems with annotated expert solutions, 152 sub problems derived from the expert set that focus on specific challenges, and 602 automatically generated problems for larger-scale development. We show that state-of-the-art approaches struggle to solve these problems with the best model (GPT-4o) solving only 16.3% of the end-to-end set, and 46.1% of the scenarios.
  arXiv  Detail & Related papers  (2024-09-11T17:37:48Z)
• Mining Issue Trackers: Concepts and Techniques [6.99674326582747]
  Internal and external stakeholders report, manage, and discuss "issues" An issue tracker is a software tool used by organisations to interact with users and manage various aspects of the software development lifecycle. This chapter discusses four major use cases for algorithmically analysing issue data.
  arXiv  Detail & Related papers  (2024-03-08T23:02:41Z)
• Competition-Level Problems are Effective LLM Evaluators [121.15880285283116]
  This paper aims to evaluate the reasoning capacities of large language models (LLMs) in solving recent programming problems in Codeforces. We first provide a comprehensive evaluation of GPT-4's peiceived zero-shot performance on this task, considering various aspects such as problems' release time, difficulties, and types of errors encountered. Surprisingly, theThoughtived performance of GPT-4 has experienced a cliff like decline in problems after September 2021 consistently across all the difficulties and types of problems.
  arXiv  Detail & Related papers  (2023-12-04T18:58:57Z)
• AI for IT Operations (AIOps) on Cloud Platforms: Reviews, Opportunities and Challenges [60.56413461109281]
  Artificial Intelligence for IT operations (AIOps) aims to combine the power of AI with the big data generated by IT Operations processes. We discuss in depth the key types of data emitted by IT Operations activities, the scale and challenges in analyzing them, and where they can be helpful. We categorize the key AIOps tasks as - incident detection, failure prediction, root cause analysis and automated actions.
  arXiv  Detail & Related papers  (2023-04-10T15:38:12Z)
• Supporting the Task-driven Skill Identification in Open Source Project Issue Tracking Systems [0.0]
  We investigate the automatic labeling of open issues strategy to help the contributors to pick a task to contribute. By identifying the skills, we claim the contributor candidates should pick a task more suitable. We applied quantitative studies to analyze the relevance of the labels in an experiment and compare the strategies' relative importance.
  arXiv  Detail & Related papers  (2022-11-02T14:17:22Z)
• Competency Problems: On Finding and Removing Artifacts in Language Data [50.09608320112584]
  We argue that for complex language understanding tasks, all simple feature correlations are spurious. We theoretically analyze the difficulty of creating data for competency problems when human bias is taken into account.
  arXiv  Detail & Related papers  (2021-04-17T21:34:10Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.