Who cares about testing?: Co-creations of Socio-technical Software Testing Experiences

• URL: http://arxiv.org/abs/2504.07208v1
• Date: Wed, 09 Apr 2025 18:35:36 GMT
• Title: Who cares about testing?: Co-creations of Socio-technical Software Testing Experiences
• Authors: Mark Swillus, Rashina Hoda, Andy Zaidman,
• Abstract summary: This study investigates the lived experience of software developers to illuminate how their opinions about testing change.<n>We construct a theory by systematically analyzing data from 19 in-depth, semi-structured interviews with software developers.<n>We develop eleven categories of circumstances that act as conditions for the application and adaptation of testing practices.
• Score: 10.262884976304282
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Software testing is crucial for ensuring software quality, yet developers' engagement with it varies widely. Identifying the technical, organizational and social factors that lead to differences in engagement is required to remove barriers and utilize enablers for testing. Much research emphasizes the usefulness of testing strategies and technical solutions, less is known about why developers do (not) test. This study investigates the lived experience of software developers to illuminate how their opinions about testing change. Learning about personal evolutions of practice, we explore when and why testing is used. Employing socio-technical grounded theory (STGT), we construct a theory by systematically analyzing data from 19 in-depth, semi-structured interviews with software developers. Allowing interviewees to reflect on how and why they approach software testing, we explore perspectives that are rooted in their contextual experiences. We develop eleven categories of circumstances that act as conditions for the application and adaptation of testing practices and introduce three concepts that we then use to present a theory that explains why developers do (not) use testing practices. This study reveals a new perspective on the connection between testing artifacts and collective reflection of practitioners. It has direct implications for practice and contributes to the groundwork of socio-technical research which embraces testing as an experience in which human- and social aspects are entangled with organizational and technical circumstances.

Related papers

• On the Mistaken Assumption of Interchangeable Deep Reinforcement Learning Implementations [53.0667196725616]
  Deep Reinforcement Learning (DRL) is a paradigm of artificial intelligence where an agent uses a neural network to learn which actions to take in a given environment. DRL has recently gained traction from being able to solve complex environments like driving simulators, 3D robotic control, and multiplayer-online-battle-arena video games. Numerous implementations of the state-of-the-art algorithms responsible for training these agents, like the Deep Q-Network (DQN) and Proximal Policy Optimization (PPO) algorithms, currently exist.
  arXiv  Detail & Related papers  (2025-03-28T16:25:06Z)
• Testing Research Software: An In-Depth Survey of Practices, Methods, and Tools [3.831549883667425]
  Testing research software is challenging due to the software's complexity and to the unique culture of the research software community.<n>This study focuses on test case design, challenges with expected outputs, use of quality metrics, execution methods, tools, and desired tool features.
  arXiv  Detail & Related papers  (2025-01-29T16:27:13Z)
• Automated Soap Opera Testing Directed by LLMs and Scenario Knowledge: Feasibility, Challenges, and Road Ahead [43.15092098658384]
  Exploratory testing (ET) harnesses tester's knowledge, creativity, and experience to create varying tests that uncover unexpected bugs from the end-user's perspective.<n>We explore the feasibility, challenges and road ahead of automated scenario-based ET (a.k.a soap opera testing)
  arXiv  Detail & Related papers  (2024-12-11T17:57:23Z)
• Which Combination of Test Metrics Can Predict Success of a Software Project? A Case Study in a Year-Long Project Course [1.553083901660282]
  Testing plays an important role in securing the success of a software development project. We investigate whether we can quantify the effects various types of testing have on functional suitability.
  arXiv  Detail & Related papers  (2024-08-22T04:23:51Z)
• Elevating Software Quality in Agile Environments: The Role of Testing Professionals in Unit Testing [0.0]
  Testing is an essential quality activity in the software development process. This paper explores the participation of test engineers in unit testing within an industrial context.
  arXiv  Detail & Related papers  (2024-03-20T00:41:49Z)
• Overwhelmed software developers: An Interpretative Phenomenological Analysis [43.18707677931078]
  We interviewed two software developers who have experienced overwhelm recently. We uncover seven categories of overwhelm (communication, disturbance, organizational, variety, technical, temporal, and positive overwhelm) Participants reported that overwhelm can sometimes be experienced to be positive and pleasant, and it can increase their mental focus, self ambition, and productivity.
  arXiv  Detail & Related papers  (2024-01-05T12:39:08Z)
• Software Testing and Code Refactoring: A Survey with Practitioners [3.977213079821398]
  This study aims to explore how software testing professionals deal with code to understand the benefits and limitations of this practice in the context of software testing. We concluded that in the context of software testing, offers several benefits, such as supporting the maintenance of automated tests and improving the performance of the testing team. Our study raises discussions on the importance of having testing professionals implement in the code of automated tests, allowing them to improve their coding abilities.
  arXiv  Detail & Related papers  (2023-10-03T01:07:39Z)
• BiasTestGPT: Using ChatGPT for Social Bias Testing of Language Models [73.29106813131818]
  bias testing is currently cumbersome since the test sentences are generated from a limited set of manual templates or need expensive crowd-sourcing. We propose using ChatGPT for the controllable generation of test sentences, given any arbitrary user-specified combination of social groups and attributes. We present an open-source comprehensive bias testing framework (BiasTestGPT), hosted on HuggingFace, that can be plugged into any open-source PLM for bias testing.
  arXiv  Detail & Related papers  (2023-02-14T22:07:57Z)
• Towards Informed Design and Validation Assistance in Computer Games Using Imitation Learning [65.12226891589592]
  This paper proposes a new approach to automated game validation and testing. Our method leverages a data-driven imitation learning technique, which requires little effort and time and no knowledge of machine learning or programming.
  arXiv  Detail & Related papers  (2022-08-15T11:08:44Z)
• Benchopt: Reproducible, efficient and collaborative optimization benchmarks [67.29240500171532]
  Benchopt is a framework to automate, reproduce and publish optimization benchmarks in machine learning. Benchopt simplifies benchmarking for the community by providing an off-the-shelf tool for running, sharing and extending experiments.
  arXiv  Detail & Related papers  (2022-06-27T16:19:24Z)
• The Unpopularity of the Software Tester Role among Software Practitioners: A Case Study [10.028628621669293]
  This work attempts to understand the motivation/de-motivation of software practitioners to take up and sustain testing careers. One hundred and forty four software practitioners from several Cuban software insti-tutes were surveyed. Individuals were asked the PROs (advantages or motiva-tors) and CONs (disadvantages or de-motivators) of taking up a career in soft-ware testing and their chances of doing so.
  arXiv  Detail & Related papers  (2020-07-16T14:52:36Z)
• Dynamic Causal Effects Evaluation in A/B Testing with a Reinforcement Learning Framework [68.96770035057716]
  A/B testing is a business strategy to compare a new product with an old one in pharmaceutical, technological, and traditional industries. This paper introduces a reinforcement learning framework for carrying A/B testing in online experiments.
  arXiv  Detail & Related papers  (2020-02-05T10:25:02Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.