Managing Technical Debt in a Multidisciplinary Data Intensive Software Team: an Observational Case Study

• URL: http://arxiv.org/abs/2506.18219v1
• Date: Mon, 23 Jun 2025 00:53:45 GMT
• Title: Managing Technical Debt in a Multidisciplinary Data Intensive Software Team: an Observational Case Study
• Authors: Ulrike M. Graetsch, Rashina Hoda, Hourieh Khalazjadeh, Mojtaba Shahin, John Grundy,
• Abstract summary: There is an increase in the investment and development of data-intensive (DI) solutions.<n>Without careful management, this growing investment will also grow associated technical debt (TD)<n>This research contributes empirical, practice based insights about multidisciplinary DI team TD management practices.
• Score: 12.110862907227203
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Context: There is an increase in the investment and development of data-intensive (DI) solutions, systems that manage large amounts of data. Without careful management, this growing investment will also grow associated technical debt (TD). Delivery of DI solutions requires a multidisciplinary skill set, but there is limited knowledge about how multidisciplinary teams develop DI systems and manage TD. Objective: This research contributes empirical, practice based insights about multidisciplinary DI team TD management practices. Method: This research was conducted as an exploratory observation case study. We used socio-technical grounded theory (STGT) for data analysis to develop concepts and categories that articulate TD and TDs debt management practices. Results: We identify TD that the DI team deals with, in particular technical data components debt and pipeline debt. We explain how the team manages the TD, assesses TD, what TD treatments they consider and how they implement TD treatments to fit sprint capacity constraints. Conclusion: We align our findings to existing TD and TDM taxonomies, discuss their implications and highlight the need for new implementation patterns and tool support for multidisciplinary DI teams.

Related papers

• A Practical Guide for Establishing a Technical Debt Management Process (Preprint) [0.9685837672183747]
  Technical Debt (TD) refers to short-term beneficial software solutions that impede future changes.<n>We conducted 19 workshops and retrospectives, analyzing 108 meetings (96 hours) over a 30-month period.<n>We identified the TDM approaches used by all teams as a starting point for best practices.
  arXiv  Detail & Related papers  (2026-03-03T15:28:50Z)
• Deep Research: A Systematic Survey [118.82795024422722]
  Deep Research (DR) aims to combine the reasoning capabilities of large language models with external tools, such as search engines.<n>This survey presents a comprehensive and systematic overview of deep research systems.
  arXiv  Detail & Related papers  (2025-11-24T15:28:28Z)
• Establishing Technical Debt Management -- A Five-Step Workshop Approach and an Action Research Study [1.3514953384460018]
  Technical debt (TD) items are constructs in a software system providing short-term benefits but hindering future changes.<n>This study aimed to establish a TDM process in an IT company based on a workshop concept.
  arXiv  Detail & Related papers  (2025-08-21T13:44:01Z)
• The Technical Debt Gamble: A Case Study on Technical Debt in a Large-Scale Industrial Microservice Architecture [3.6641804813567305]
  This research explores how technical debt (TD) manifests in a large-scale microservice-based industrial system.<n>Results show that simple static source code analysis can be an efficient entry point for holistic TD discovery.<n>We identify a set of fitting strategies for TD management in microservice architecture.
  arXiv  Detail & Related papers  (2025-06-19T11:04:39Z)
• Racing Against the Clock: Exploring the Impact of Scheduled Deadlines on Technical Debt [3.391083554509444]
  This study investigates the impact of scheduled deadlines on Technical Debt (TD)<n>It analyzes how scheduled deadlines affect code quality, commit activities, and issues in issue-tracking systems.
  arXiv  Detail & Related papers  (2025-05-07T00:05:01Z)
• Unravelling Technical debt topics through Time, Programming Languages and Repository [5.669063174637433]
  This study explores the dynamic landscape of Technical Debt (TD) topics in software engineering by examining its evolution across time, programming languages, and repositories.<n>We have conducted an explorative analysis of TD data extracted from GitHub issues spanning from 2015 to September 2023.<n>This study categorises the TD topics and tracks their progression over time. Furthermore, we have incorporated sentiment analysis for each identified topic, providing a deeper insight into the perceptions and attitudes associated with these topics.
  arXiv  Detail & Related papers  (2025-04-16T02:20:56Z)
• Multimodal Chain-of-Thought Reasoning: A Comprehensive Survey [124.23247710880008]
  multimodal CoT (MCoT) reasoning has recently garnered significant research attention.<n>Existing MCoT studies design various methodologies to address the challenges of image, video, speech, audio, 3D, and structured data.<n>We present the first systematic survey of MCoT reasoning, elucidating the relevant foundational concepts and definitions.
  arXiv  Detail & Related papers  (2025-03-16T18:39:13Z)
• Systematic literature review on forecasting and prediction of technical debt evolution [0.0]
  Technical debt (TD) refers to the additional costs incurred due to compromises in software quality. This study aims to explore existing knowledge in software engineering to gain insights into approaches proposed in research and industry.
  arXiv  Detail & Related papers  (2024-06-17T18:50:37Z)
• A Survey on Knowledge Distillation of Large Language Models [99.11900233108487]
  Knowledge Distillation (KD) emerges as a pivotal methodology for transferring advanced capabilities to open-source models. This paper presents a comprehensive survey of KD's role within the realm of Large Language Models (LLMs)
  arXiv  Detail & Related papers  (2024-02-20T16:17:37Z)
• Analyzing the concept of technical debt in the context of agile software development: A systematic literature review [3.246212137124741]
  Technical debt (TD) is a metaphor used to communicate the consequences of poor software development practices to non-technical stakeholders. The purpose of this study is to analyze and synthesize the state of the art of TD, and its causes, consequences, and management strategies in the context of agile software development (ASD)
  arXiv  Detail & Related papers  (2024-01-26T14:07:18Z)
• A Systematic Study of Performance Disparities in Multilingual Task-Oriented Dialogue Systems [68.76102493999134]
  We take stock of and empirically analyse task performance disparities that exist between multilingual task-oriented dialogue systems. We prove the existence of the adaptation and intrinsic biases in current ToD systems. Our analyses offer practical tips on how to approach ToD data collection and system development for new languages.
  arXiv  Detail & Related papers  (2023-10-19T16:41:44Z)
• Efficient Deep Reinforcement Learning Requires Regulating Overfitting [91.88004732618381]
  We show that high temporal-difference (TD) error on the validation set of transitions is the main culprit that severely affects the performance of deep RL algorithms. We show that a simple online model selection method that targets the validation TD error is effective across state-based DMC and Gym tasks.
  arXiv  Detail & Related papers  (2023-04-20T17:11:05Z)
• Conservative Data Sharing for Multi-Task Offline Reinforcement Learning [119.85598717477016]
  We argue that a natural use case of offline RL is in settings where we can pool large amounts of data collected in various scenarios for solving different tasks. We develop a simple technique for data-sharing in multi-task offline RL that routes data based on the improvement over the task-specific data.
  arXiv  Detail & Related papers  (2021-09-16T17:34:06Z)
• Digital Twins: State of the Art Theory and Practice, Challenges, and Open Research Questions [62.67593386796497]
  This work explores the various DT features and current approaches, the shortcomings and reasons behind the delay in the implementation and adoption of digital twin. The major reasons for this delay are the lack of a universal reference framework, domain dependence, security concerns of shared data, reliance of digital twin on other technologies, and lack of quantitative metrics.
  arXiv  Detail & Related papers  (2020-11-02T19:08:49Z)
• Knowledge Transfer in Multi-Task Deep Reinforcement Learning for Continuous Control [65.00425082663146]
  We present a Knowledge Transfer based Multi-task Deep Reinforcement Learning framework (KTM-DRL) for continuous control. In KTM-DRL, the multi-task agent first leverages an offline knowledge transfer algorithm to quickly learn a control policy from the experience of task-specific teachers. The experimental results well justify the effectiveness of KTM-DRL and its knowledge transfer and online learning algorithms, as well as its superiority over the state-of-the-art by a large margin.
  arXiv  Detail & Related papers  (2020-10-15T03:26:47Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.