An Industrial Case Study on Test Cases as Requirements

• URL: http://arxiv.org/abs/2308.06509v1
• Date: Sat, 12 Aug 2023 09:06:22 GMT
• Title: An Industrial Case Study on Test Cases as Requirements
• Authors: Elizabeth Bjarnason, Michael Unterkalmsteiner, Emelie Engstr\"om, Markus Borg
• Abstract summary: It is a conundrum that agile projects can succeed 'without requirements' when weak requirements engineering is a known cause for project failures. We have investigated this agile practice at three companies in order to understand how test cases can fill the role of requirements. The findings provide insights into how the role of requirements may be met in agile development including challenges to consider.
• Score: 5.71126361766062
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: It is a conundrum that agile projects can succeed 'without requirements' when weak requirements engineering is a known cause for project failures. While Agile development projects often manage well without extensive requirements documentation, test cases are commonly used as requirements. We have investigated this agile practice at three companies in order to understand how test cases can fill the role of requirements. We performed a case study based on twelve interviews performed in a previous study. The findings include a range of benefits and challenges in using test cases for eliciting, validating, verifying, tracing and managing requirements. In addition, we identified three scenarios for applying the practice, namely as a mature practice, as a de facto practice and as part of an agile transition. The findings provide insights into how the role of requirements may be met in agile development including challenges to consider.

Related papers

• Defining Requirements Strategies in Agile: A Design Science Research Study [4.110602799032192]
  Research shows that many of the challenges currently encountered with agile development are related to requirements engineering. This paper investigates critical challenges that arise in agile development from an undefined requirements strategy.
  arXiv  Detail & Related papers  (2024-05-29T07:57:32Z)
• Generating Test Scenarios from NL Requirements using Retrieval-Augmented LLMs: An Industrial Study [5.179738379203527]
  This paper presents an automated approach (RAGTAG) for test scenario generation using Retrieval-Augmented Generation (RAG) with Large Language Models (LLMs) We evaluate RAGTAG on two industrial projects from Austrian Post with bilingual requirements in German and English.
  arXiv  Detail & Related papers  (2024-04-19T10:27:40Z)
• A multi-case study of agile requirements engineering and the use of test cases as requirements [5.71126361766062]
  Test cases are commonly viewed as requirements and detailed requirements are documented as test cases. The use of test cases as requirements poses both benefits and challenges when eliciting, validating, verifying, and managing requirements. The identified variants of the practice of using test cases as requirements can be used to perform in-depth investigations into agile requirements engineering.
  arXiv  Detail & Related papers  (2023-08-22T19:13:45Z)
• Validation-Driven Development [54.50263643323]
  This paper introduces a validation-driven development (VDD) process that prioritizes validating requirements in formal development. The effectiveness of the VDD process is demonstrated through a case study in the aviation industry.
  arXiv  Detail & Related papers  (2023-08-11T09:15:26Z)
• Challenges and Practices in Aligning Requirements with Verification and Validation: A Case Study of Six Companies [10.508558932045032]
  Weak alignment of requirements engineering with verification and validation (VV) may lead to problems in delivering the required products in time with the right quality. We have performed a multi-unit case study to gain insight into issues around aligning RE and VV by interviewing 30 practitioners from 6 software developing companies. The results describe current industry challenges and practices in aligning RE with VV, ranging from quality of the individual RE and VV activities, through tracing and tools, to change control and sharing a common understanding at strategy, goal and design level.
  arXiv  Detail & Related papers  (2023-07-24T02:39:53Z)
• Challenges in aligning requirements engineering and verification in a large-scale industrial context [7.92131557859946]
  This paper presents preliminary findings of interviews that identify key challenges in aligning requirements and verification processes. The findings of this study can be used by practitioners as a basis for investigating alignment in their organizations.
  arXiv  Detail & Related papers  (2023-07-23T20:08:49Z)
• Reasoning or Reciting? Exploring the Capabilities and Limitations of Language Models Through Counterfactual Tasks [71.19560970717495]
  Recent language models show impressive performance across a wide range of tasks. Are these skills general and transferable, or specialized to specific tasks seen during pretraining? We propose an evaluation framework based on "counterfactual" task variants that deviate from the default assumptions underlying standard tasks.
  arXiv  Detail & Related papers  (2023-07-05T17:50:42Z)
• A Requirements-Driven Platform for Validating Field Operations of Small Uncrewed Aerial Vehicles [48.67061953896227]
  DroneReqValidator (DRV) allows sUAS developers to define the operating context, configure multi-sUAS mission requirements, specify safety properties, and deploy their own custom sUAS applications in a high-fidelity 3D environment. The DRV Monitoring system collects runtime data from sUAS and the environment, analyzes compliance with safety properties, and captures violations.
  arXiv  Detail & Related papers  (2023-07-01T02:03:49Z)
• Machine Learning with Requirements: a Manifesto [114.97965827971132]
  We argue that requirements definition and satisfaction can go a long way to make machine learning models even more fitting to the real world. We show how the requirements specification can be fruitfully integrated into the standard machine learning development pipeline.
  arXiv  Detail & Related papers  (2023-04-07T14:47:13Z)
• A Research Agenda for Artificial Intelligence in the Field of Flexible Production Systems [53.47496941841855]
  Production companies face problems when it comes to quickly adapting their production control to fluctuating demands or changing requirements. Control approaches aiming to encapsulate production functions in the sense of services have shown to be promising in order to increase flexibility of Cyber-Physical Production Systems. But an existing challenge of such approaches is finding production plans based on provided functionalities for a set of requirements, especially when there is no direct (i.e., syntactic) match between demanded and provided functions.
  arXiv  Detail & Related papers  (2021-12-31T14:38:31Z)
• Curriculum Learning for Reinforcement Learning Domains: A Framework and Survey [53.73359052511171]
  Reinforcement learning (RL) is a popular paradigm for addressing sequential decision tasks in which the agent has only limited environmental feedback. We present a framework for curriculum learning (CL) in RL, and use it to survey and classify existing CL methods in terms of their assumptions, capabilities, and goals.
  arXiv  Detail & Related papers  (2020-03-10T20:41:24Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.