Assessing requirements engineering and software test alignment -- Five
case studies
- URL: http://arxiv.org/abs/2308.07640v1
- Date: Tue, 15 Aug 2023 08:43:20 GMT
- Title: Assessing requirements engineering and software test alignment -- Five
case studies
- Authors: Michael Unterkalmsteiner, Tony Gorschek, Robert Feldt, Eriks Klotins
- Abstract summary: REST-bench is an assessment tool that illustrates the coordination in software development projects and identifies concrete improvement opportunities.
We applied REST-bench both in Agile and plan-driven environments, in projects lasting from weeks to years, and staffed as large as 1000 employees.
- Score: 8.960336770209476
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: The development of large, software-intensive systems is a complex undertaking
that we generally tackle by a divide and conquer strategy. Companies thereby
face the challenge of coordinating individual aspects of software development,
in particular between requirements engineering (RE) and software testing (ST).
A lack of REST alignment can not only lead to wasted effort but also to
defective software. However, before a company can improve the mechanisms of
coordination they need to be understood first. With REST-bench we aim at
providing an assessment tool that illustrates the coordination in software
development projects and identify concrete improvement opportunities. We have
developed REST-bench on the sound fundamentals of a taxonomy on REST alignment
methods and validated the method in five case studies. Following the principles
of technical action research, we collaborated with five companies, applying
REST-bench and iteratively improving the method based on the lessons we
learned. We applied REST-bench both in Agile and plan-driven environments, in
projects lasting from weeks to years, and staffed as large as 1000 employees.
The improvement opportunities we identified and the feedback we received
indicate that the assessment was effective and efficient. Furthermore,
participants confirmed that their understanding on the coordination between RE
and ST improved.
Related papers
- Agent-Driven Automatic Software Improvement [55.2480439325792]
This research proposal aims to explore innovative solutions by focusing on the deployment of agents powered by Large Language Models (LLMs)
The iterative nature of agents, which allows for continuous learning and adaptation, can help surpass common challenges in code generation.
We aim to use the iterative feedback in these systems to further fine-tune the LLMs underlying the agents, becoming better aligned to the task of automated software improvement.
arXiv Detail & Related papers (2024-06-24T15:45:22Z) - Teaching Scrum with a focus on compliance assessment [1.1060425537315088]
The aim of the course is to provide students with the skills to manage software development projects with Scrum.
The conduction of five editions of the course allowed us to identify several lessons learned about time budgeting and team compositions in agile student projects.
arXiv Detail & Related papers (2024-04-22T09:44:44Z) - When LLM-based Code Generation Meets the Software Development Process [50.82665351100067]
This paper introduces LCG, a code generation framework inspired by established software engineering practices.
LLM agents emulate various software process models, namely LCGWaterfall, LCGTDD, and LCGScrum.
We evaluate LCG across four code generation benchmarks: HumanEval, HumanEval-ET, MBPP, and MBPP-ET.
arXiv Detail & Related papers (2024-03-23T14:04:48Z) - Challenges and Practices in Aligning Requirements with Verification and
Validation: A Case Study of Six Companies [10.508558932045032]
Weak alignment of requirements engineering with verification and validation (VV) may lead to problems in delivering the required products in time with the right quality.
We have performed a multi-unit case study to gain insight into issues around aligning RE and VV by interviewing 30 practitioners from 6 software developing companies.
The results describe current industry challenges and practices in aligning RE with VV, ranging from quality of the individual RE and VV activities, through tracing and tools, to change control and sharing a common understanding at strategy, goal and design level.
arXiv Detail & Related papers (2023-07-24T02:39:53Z) - Comparing Software Developers with ChatGPT: An Empirical Investigation [0.0]
This paper conducts an empirical investigation, contrasting the performance of software engineers and AI systems, like ChatGPT, across different evaluation metrics.
The paper posits that a comprehensive comparison of software engineers and AI-based solutions, considering various evaluation criteria, is pivotal in fostering human-machine collaboration.
arXiv Detail & Related papers (2023-05-19T17:25:54Z) - A Reinforcement Learning-assisted Genetic Programming Algorithm for Team
Formation Problem Considering Person-Job Matching [70.28786574064694]
A reinforcement learning-assisted genetic programming algorithm (RL-GP) is proposed to enhance the quality of solutions.
The hyper-heuristic rules obtained through efficient learning can be utilized as decision-making aids when forming project teams.
arXiv Detail & Related papers (2023-04-08T14:32:12Z) - MARLIN: Soft Actor-Critic based Reinforcement Learning for Congestion
Control in Real Networks [63.24965775030673]
We propose a novel Reinforcement Learning (RL) approach to design generic Congestion Control (CC) algorithms.
Our solution, MARLIN, uses the Soft Actor-Critic algorithm to maximize both entropy and return.
We trained MARLIN on a real network with varying background traffic patterns to overcome the sim-to-real mismatch.
arXiv Detail & Related papers (2023-02-02T18:27:20Z) - Benchopt: Reproducible, efficient and collaborative optimization
benchmarks [67.29240500171532]
Benchopt is a framework to automate, reproduce and publish optimization benchmarks in machine learning.
Benchopt simplifies benchmarking for the community by providing an off-the-shelf tool for running, sharing and extending experiments.
arXiv Detail & Related papers (2022-06-27T16:19:24Z) - Empowered and Embedded: Ethics and Agile Processes [60.63670249088117]
We argue that ethical considerations need to be embedded into the (agile) software development process.
We put emphasis on the possibility to implement ethical deliberations in already existing and well established agile software development processes.
arXiv Detail & Related papers (2021-07-15T11:14:03Z) - Reinforcement Learning for Test Case Prioritization [0.24366811507669126]
This paper extends recent studies on applying Reinforcement Learning to optimize testing strategies.
We test its ability to adapt to new environments, by testing it on novel data extracted from a financial institution.
We also studied the impact of using Decision Tree (DT) Approximator as a model for memory representation.
arXiv Detail & Related papers (2020-12-18T11:08:20Z) - Ensemble Regression Models for Software Development Effort Estimation: A
Comparative Study [0.0]
This study determines which technique has better effort prediction accuracy and propose combined techniques that could provide better estimates.
The results have indicated that the proposed ensemble models, besides delivering high efficiency in contrast to its counterparts, and produces the best responses for software project effort estimation.
arXiv Detail & Related papers (2020-07-03T14:40:41Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.