Seeking Enlightenment: Incorporating Evidence-Based Practice Techniques in a Research Software Engineering Team
- URL: http://arxiv.org/abs/2403.16827v1
- Date: Mon, 25 Mar 2024 14:52:18 GMT
- Title: Seeking Enlightenment: Incorporating Evidence-Based Practice Techniques in a Research Software Engineering Team
- Abstract summary: Evidence-based practice (EBP) in software engineering aims to improve decision-making in software development by complementing practitioners' professional judgment with high-quality evidence from research.
We believe the use of EBP techniques may be helpful for research software engineers (RSEs) in their work to bring software engineering best practices to scientific software development.
We present an experience report on the use of a particular EBP technique, rapid reviews, within an RSE team at Sandia National Laboratories, and present practical recommendations for how to address barriers to EBP adoption within the RSE community.
- Score: 0.7340017786387767
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Evidence-based practice (EBP) in software engineering aims to improve decision-making in software development by complementing practitioners' professional judgment with high-quality evidence from research. We believe the use of EBP techniques may be helpful for research software engineers (RSEs) in their work to bring software engineering best practices to scientific software development. In this study, we present an experience report on the use of a particular EBP technique, rapid reviews, within an RSE team at Sandia National Laboratories, and present practical recommendations for how to address barriers to EBP adoption within the RSE community.
Related papers
- Practical Feasibility of Sustainable Software Engineering Tools and Techniques [0.5097809301149341]
This study investigates how software practitioners perceive the feasibility of existing Sustainable Software Engineering tools and techniques.<n>We identified prominent categories of SSE tools targeting energy consumption, green, and workload management, and evaluated them along three practitioner-relevant dimensions.<n>Our findings suggest that the practitioners strongly favored tools that integrate into existing pipelines, require minimal and locally scoped data access, and provide interpretable, actionable outputs.
arXiv Detail & Related papers (2026-03-30T22:47:26Z) - Empirical Studies on Adversarial Reverse Engineering with Students [24.226009059127374]
This paper explores the use of students as participants in empirical reverse engineering experiments.<n>It examines their suitability and the necessary training; the design of appropriate challenges; strategies for ensuring the rigor and validity of the research.<n>We present a systematic literature review of existing reverse engineering experiments and user studies.
arXiv Detail & Related papers (2026-03-04T09:27:46Z) - Usage, Effects and Requirements for AI Coding Assistants in the Enterprise: An Empirical Study [4.01226690413941]
We surveyed 57 developers about their experience with AI coding assistants and CodeLLMs.<n>We reviewed 35 user surveys on the usage, experience and expectations of professionals and students using AI coding assistants and CodeLLMs.
arXiv Detail & Related papers (2026-01-27T22:57:20Z) - Understanding the Role of Large Language Models in Software Engineering: Evidence from an Industry Survey [0.6660458629649825]
This paper reports an empirical study of Large Language Models (LLMs) adoption in software engineering, based on a survey of 46 industry professionals.<n>Results reveal positive perceptions of LLMs, particularly regarding faster resolution of technical questions, improved documentation support, and enhanced source code standardization.<n> respondents also expressed concerns about cognitive dependence, security risks, and the potential erosion of technical autonomy.
arXiv Detail & Related papers (2025-12-19T20:57:19Z) - Using LLMs and Essence to Support Software Practice Adoption [0.3609538870261841]
This study explores the integration of Essence, a standard and thinking framework for managing software engineering practices, with large language models (LLMs)<n>The proposed system consistently outperforms its baseline counterpart in domain-specific tasks.
arXiv Detail & Related papers (2025-08-22T14:59:35Z) - Greening AI-enabled Systems with Software Engineering: A Research Agenda for Environmentally Sustainable AI Practices [70.24403396375277]
The "Greening AI with Software Engineering" CECAM-Lorentz workshop was held February 3-7, 2025 in Lausanne, Switzerland.<n>This report presents a research agenda emerging from the workshop.<n>It outlines open research directions and practical recommendations to guide the development of environmentally sustainable AI-enabled systems.
arXiv Detail & Related papers (2025-06-02T15:19:49Z) - A pragmatic look at education and training of software test engineers: Further cooperation of academia and industry is needed [1.516251872371896]
It is important for both university educators and trainers in industry to be aware of the status of software testing education in academia.
This paper provides a pragmatic overview of the issue, presents several recommendations, and hopes to trigger further discussions.
arXiv Detail & Related papers (2024-08-12T13:39:52Z) - Exploring the Evidence-Based Beliefs and Behaviors of LLM-Based Programming Assistants [2.3480418671346164]
This study investigates the beliefs and behaviors of large language models (LLMs) used to support software development tasks.
Our findings show that LLM-based programming assistants have ambiguous beliefs regarding research claims, lack credible evidence to support responses, and are incapable of adopting practices demonstrated by empirical SE research to support development tasks.
arXiv Detail & Related papers (2024-07-18T21:06:39Z) - Bridging Theory to Practice in Software Testing Teaching through Team-based Learning (TBL) and Open Source Software (OSS) Contribution [3.190574537106449]
This paper presents a teaching approach for a software testing course that integrates theory and practical experience.
The paper reports on our experience implementing the pedagogical approach over four consecutive semesters of a Software Testing course within an undergraduate Software Engineering program.
arXiv Detail & Related papers (2024-04-16T21:16:17Z) - Charting a Path to Efficient Onboarding: The Role of Software
Visualization [49.1574468325115]
The present study aims to explore the familiarity of managers, leaders, and developers with software visualization tools.
This approach incorporated quantitative and qualitative analyses of data collected from practitioners using questionnaires and semi-structured interviews.
arXiv Detail & Related papers (2024-01-17T21:30:45Z) - A Case Study on Test Case Construction with Large Language Models:
Unveiling Practical Insights and Challenges [2.7029792239733914]
This paper examines the application of Large Language Models in the construction of test cases within the context of software engineering.
Through a blend of qualitative and quantitative analyses, this study assesses the impact of LLMs on test case comprehensiveness, accuracy, and efficiency.
arXiv Detail & Related papers (2023-12-19T20:59:02Z) - Using Machine Learning To Identify Software Weaknesses From Software
Requirement Specifications [49.1574468325115]
This research focuses on finding an efficient machine learning algorithm to identify software weaknesses from requirement specifications.
Keywords extracted using latent semantic analysis help map the CWE categories to PROMISE_exp. Naive Bayes, support vector machine (SVM), decision trees, neural network, and convolutional neural network (CNN) algorithms were tested.
arXiv Detail & Related papers (2023-08-10T13:19:10Z) - PerfDetectiveAI -- Performance Gap Analysis and Recommendation in
Software Applications [0.0]
PerfDetectiveAI, a conceptual framework for performance gap analysis and suggestion in software applications is introduced in this research.
Modern machine learning (ML) and artificial intelligence (AI) techniques are used in PerfDetectiveAI to monitor performance measurements and identify areas of underperformance in software applications.
arXiv Detail & Related papers (2023-06-11T02:53:04Z) - Constrained Reinforcement Learning for Robotics via Scenario-Based
Programming [64.07167316957533]
It is crucial to optimize the performance of DRL-based agents while providing guarantees about their behavior.
This paper presents a novel technique for incorporating domain-expert knowledge into a constrained DRL training loop.
Our experiments demonstrate that using our approach to leverage expert knowledge dramatically improves the safety and the performance of the agent.
arXiv Detail & Related papers (2022-06-20T07:19:38Z) - An Uncommon Task: Participatory Design in Legal AI [64.54460979588075]
We examine a notable yet understudied AI design process in the legal domain that took place over a decade ago.
We show how an interactive simulation methodology allowed computer scientists and lawyers to become co-designers.
arXiv Detail & Related papers (2022-03-08T15:46:52Z) - Recommender Systems for Configuration Knowledge Engineering [55.41644538483948]
We show how recommender systems can support knowledge base development and maintenance processes.
We report the results of empirical studies which show the importance of user-centered configuration knowledge organization.
arXiv Detail & Related papers (2021-02-16T12:29:54Z) - Software engineering for artificial intelligence and machine learning
software: A systematic literature review [6.681725960709127]
This study aims to investigate how software engineering has been applied in the development of AI/ML systems.
Main challenges faced by professionals are in areas of testing, AI software quality, and data management.
arXiv Detail & Related papers (2020-11-07T11:06:28Z) - Machine Learning for Software Engineering: A Systematic Mapping [73.30245214374027]
The software development industry is rapidly adopting machine learning for transitioning modern day software systems towards highly intelligent and self-learning systems.
No comprehensive study exists that explores the current state-of-the-art on the adoption of machine learning across software engineering life cycle stages.
This study introduces a machine learning for software engineering (MLSE) taxonomy classifying the state-of-the-art machine learning techniques according to their applicability to various software engineering life cycle stages.
arXiv Detail & Related papers (2020-05-27T11:56:56Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.