Characterizing Requirements Smells

• URL: http://arxiv.org/abs/2404.11106v1
• Date: Wed, 17 Apr 2024 06:43:02 GMT
• Title: Characterizing Requirements Smells
• Authors: Emanuele Gentili, Davide Falessi,
• Abstract summary: This paper aims to characterise 12 requirements smells in terms of frequency, severity, and effects. Interview shows that the smell types perceived as most severe are Ambiguity and Verifiability. We also provide a set of six lessons learnt about requirements smells, such as that effects of smells are expected to differ across smell types.
• Score: 1.565361244756411
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Context: Software specifications are usually written in natural language and may suffer from imprecision, ambiguity, and other quality issues, called thereafter, requirement smells. Requirement smells can hinder the development of a project in many aspects, such as delays, reworks, and low customer satisfaction. From an industrial perspective, we want to focus our time and effort on identifying and preventing the requirement smells that are of high interest. Aim: This paper aims to characterise 12 requirements smells in terms of frequency, severity, and effects. Method: We interviewed ten experienced practitioners from different divisions of a large international company in the safety-critical domain called MBDA Italy Spa. Results: Our interview shows that the smell types perceived as most severe are Ambiguity and Verifiability, while as most frequent are Ambiguity and Complexity. We also provide a set of six lessons learnt about requirements smells, such as that effects of smells are expected to differ across smell types. Conclusions: Our results help to increase awareness about the importance of requirement smells. Our results pave the way for future empirical investigations, ranging from a survey confirming our findings to controlled experiments measuring the effect size of specific requirement smells.

Related papers

• On the Impact of Requirements Smells in Prompts: The Case of Automated Traceability [45.24937784556523]
  We investigate the role of requirements smells-indicators of potential issues like ambiguity and inconsistency-when used in prompts for large language models (LLMs) Our results show mixed outcomes: while requirements smells had a small but significant effect when predicting whether a requirement was implemented in a piece of code (i.e., a trace link exists), no significant effect was observed when tracing the requirements with the associated lines of code. These findings suggest that requirements smells can affect LLM performance in certain SE tasks but may not uniformly impact all tasks.
  arXiv  Detail & Related papers  (2025-01-08T19:54:31Z)
• ProSA: Assessing and Understanding the Prompt Sensitivity of LLMs [72.13489820420726]
  ProSA is a framework designed to evaluate and comprehend prompt sensitivity in large language models. Our study uncovers that prompt sensitivity fluctuates across datasets and models, with larger models exhibiting enhanced robustness.
  arXiv  Detail & Related papers  (2024-10-16T09:38:13Z)
• Analyzing Human Questioning Behavior and Causal Curiosity through Natural Queries [91.70689724416698]
  We present NatQuest, a collection of 13,500 naturally occurring questions from three diverse sources. Our analysis reveals a significant presence of causal questions (up to 42%) within the dataset.
  arXiv  Detail & Related papers  (2024-05-30T17:55:28Z)
• Q-learning with temporal memory to navigate turbulence [47.28605705112213]
  We consider the problem of olfactory searches in a turbulent environment. We develop a reinforcement learning algorithm using a small set of interpretable olfactory states. We show that two salient features of odor traces, discretized in few olfactory states, are sufficient to learn navigation in a realistic odor plume.
  arXiv  Detail & Related papers  (2024-04-26T15:51:20Z)
• Data Science In Olfaction [1.4499463058550683]
  We conceptualize smell from a Data Science and AI perspective, that relates the properties of odorants to how they are sensed and analyzed in the olfactory system from the nose to the brain. Drawing distinctions to color vision, we argue that smell presents unique measurement challenges, including the complexity of stimuli, the high dimensionality of the sensory apparatus, as well as what constitutes ground truth. We present results using machine learning-based classification of neural responses to odors as they are recorded in the mouse olfactory bulb with calcium imaging.
  arXiv  Detail & Related papers  (2024-04-08T13:25:02Z)
• Identifying relevant Factors of Requirements Quality: an industrial Case Study [0.5603839226601395]
  We conduct a case study considering data from both interview transcripts and issue reports to identify relevant factors of requirements quality. The results contribute empirical evidence that (1) strengthens existing requirements engineering theories and (2) advances industry-relevant requirements quality research.
  arXiv  Detail & Related papers  (2024-02-01T13:45:06Z)
• Enhancing Uncertainty-Based Hallucination Detection with Stronger Focus [99.33091772494751]
  Large Language Models (LLMs) have gained significant popularity for their impressive performance across diverse fields. LLMs are prone to hallucinate untruthful or nonsensical outputs that fail to meet user expectations. We propose a novel reference-free, uncertainty-based method for detecting hallucinations in LLMs.
  arXiv  Detail & Related papers  (2023-11-22T08:39:17Z)
• A Comprehensive Survey of Forgetting in Deep Learning Beyond Continual Learning [58.107474025048866]
  Forgetting refers to the loss or deterioration of previously acquired knowledge. Forgetting is a prevalent phenomenon observed in various other research domains within deep learning.
  arXiv  Detail & Related papers  (2023-07-16T16:27:58Z)
• Towards Olfactory Information Extraction from Text: A Case Study on Detecting Smell Experiences in Novels [1.5641335104467975]
  We present two variations on a semi-supervised approach to identify smell experiences in English literature. The combined set of patterns offer significantly better performance than a keyword-based baseline.
  arXiv  Detail & Related papers  (2020-11-17T19:41:02Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.