Identifying relevant Factors of Requirements Quality: an industrial Case Study

• URL: http://arxiv.org/abs/2402.00594v2
• Date: Thu, 16 May 2024 09:41:36 GMT
• Title: Identifying relevant Factors of Requirements Quality: an industrial Case Study
• Authors: Julian Frattini,
• Abstract summary: We conduct a case study considering data from both interview transcripts and issue reports to identify relevant factors of requirements quality. The results contribute empirical evidence that (1) strengthens existing requirements engineering theories and (2) advances industry-relevant requirements quality research.
• Score: 0.5603839226601395
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: [Context and Motivation]: The quality of requirements specifications impacts subsequent, dependent software engineering activities. Requirements quality defects like ambiguous statements can result in incomplete or wrong features and even lead to budget overrun or project failure. [Problem]: Attempts at measuring the impact of requirements quality have been held back by the vast amount of interacting factors. Requirements quality research lacks an understanding of which factors are relevant in practice. [Principal Ideas and Results]: We conduct a case study considering data from both interview transcripts and issue reports to identify relevant factors of requirements quality. The results include 17 factors and 11 interaction effects relevant to the case company. [Contribution]: The results contribute empirical evidence that (1) strengthens existing requirements engineering theories and (2) advances industry-relevant requirements quality research.

Related papers

• From Pre-training Corpora to Large Language Models: What Factors Influence LLM Performance in Causal Discovery Tasks? [51.42906577386907]
  This study explores the factors influencing the performance of Large Language Models (LLMs) in causal discovery tasks. A higher frequency of causal mentions correlates with better model performance, suggesting that extensive exposure to causal information during training enhances the models' causal discovery capabilities.
  arXiv  Detail & Related papers  (2024-07-29T01:45:05Z)
• Extrinsic Evaluation of Cultural Competence in Large Language Models [53.626808086522985]
  We focus on extrinsic evaluation of cultural competence in two text generation tasks. We evaluate model outputs when an explicit cue of culture, specifically nationality, is perturbed in the prompts. We find weak correlations between text similarity of outputs for different countries and the cultural values of these countries.
  arXiv  Detail & Related papers  (2024-06-17T14:03:27Z)
• Measuring the Fitness-for-Purpose of Requirements: An initial Model of Activities and Attributes [4.147594239309427]
  We propose an initial model of requirements-affected activities and their attributes. Our long-term goal is to develop evidence-based decision support on how to optimize the fitness for purpose of the RE phase.
  arXiv  Detail & Related papers  (2024-05-16T08:31:44Z)
• Argument Quality Assessment in the Age of Instruction-Following Large Language Models [45.832808321166844]
  A critical task in any such application is the assessment of an argument's quality. We identify the diversity of quality notions and the subjectiveness of their perception as the main hurdles towards substantial progress on argument quality assessment. We argue that the capabilities of instruction-following large language models (LLMs) to leverage knowledge across contexts enable a much more reliable assessment.
  arXiv  Detail & Related papers  (2024-03-24T10:43:21Z)
• Qsnail: A Questionnaire Dataset for Sequential Question Generation [76.616068047362]
  We present the first dataset specifically constructed for the questionnaire generation task, which comprises 13,168 human-written questionnaires. We conduct experiments on Qsnail, and the results reveal that retrieval models and traditional generative models do not fully align with the given research topic and intents. Despite enhancements through the chain-of-thought prompt and finetuning, questionnaires generated by language models still fall short of human-written questionnaires.
  arXiv  Detail & Related papers  (2024-02-22T04:14:10Z)
• Applying Bayesian Data Analysis for Causal Inference about Requirements Quality: A Controlled Experiment [4.6068376339651635]
  It is commonly accepted that the quality of requirements specifications impacts subsequent software engineering activities. We aim to contribute empirical evidence to the effect that requirements quality defects have on a software engineering activity.
  arXiv  Detail & Related papers  (2024-01-02T11:08:39Z)
• Requirements Quality Research: a harmonized Theory, Evaluation, and Roadmap [4.147594239309427]
  High-quality requirements minimize the risk of propagating defects to later stages of the software development life cycle. This requires a clear definition and understanding of requirements quality.
  arXiv  Detail & Related papers  (2023-09-19T06:27:23Z)
• Inducing Causal Structure for Abstractive Text Summarization [76.1000380429553]
  We introduce a Structural Causal Model (SCM) to induce the underlying causal structure of the summarization data. We propose a Causality Inspired Sequence-to-Sequence model (CI-Seq2Seq) to learn the causal representations that can mimic the causal factors. Experimental results on two widely used text summarization datasets demonstrate the advantages of our approach.
  arXiv  Detail & Related papers  (2023-08-24T16:06:36Z)
• Requirements Quality Assurance in Industry: Why, What and How? [3.6142643912711794]
  We propose a taxonomy of requirements quality assurance complexity that characterizes cognitive load of verifying a quality aspect from the human perspective. Once this taxonomy is realized and validated, it can serve as the basis for a decision framework of automated requirements quality assurance support.
  arXiv  Detail & Related papers  (2023-08-24T14:31:52Z)
• Challenges in aligning requirements engineering and verification in a large-scale industrial context [7.92131557859946]
  This paper presents preliminary findings of interviews that identify key challenges in aligning requirements and verification processes. The findings of this study can be used by practitioners as a basis for investigating alignment in their organizations.
  arXiv  Detail & Related papers  (2023-07-23T20:08:49Z)
• Towards Causal Representation Learning [96.110881654479]
  The two fields of machine learning and graphical causality arose and developed separately. There is now cross-pollination and increasing interest in both fields to benefit from the advances of the other.
  arXiv  Detail & Related papers  (2021-02-22T15:26:57Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.