Insights Towards Better Case Study Reporting in Software Engineering

• URL: http://arxiv.org/abs/2402.08411v1
• Date: Tue, 13 Feb 2024 12:29:26 GMT
• Title: Insights Towards Better Case Study Reporting in Software Engineering
• Authors: Sergio Rico
• Abstract summary: This paper aims to share insights that can enhance the quality and impact of case study reporting. We emphasize the need to follow established guidelines, accurate classification, and detailed context descriptions in case studies. We aim to encourage researchers to adopt more rigorous and communicative strategies, ensuring that case studies are methodologically sound.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Case studies are a popular and noteworthy type of research study in software engineering, offering significant potential to impact industry practices by investigating phenomena in their natural contexts. This potential to reach a broad audience beyond the academic community is often undermined by deficiencies in reporting, particularly in the context description, study classification, generalizability, and the handling of validity threats. This paper presents a reflective analysis aiming to share insights that can enhance the quality and impact of case study reporting. We emphasize the need to follow established guidelines, accurate classification, and detailed context descriptions in case studies. Additionally, particular focus is placed on articulating generalizable findings and thoroughly discussing generalizability threats. We aim to encourage researchers to adopt more rigorous and communicative strategies, ensuring that case studies are methodologically sound, resonate with, and apply to software engineering practitioners and the broader academic community. The reflections and recommendations offered in this paper aim to ensure that insights from case studies are transparent, understandable, and tailored to meet the needs of both academic researchers and industry practitioners. In doing so, we seek to enhance the real-world applicability of academic research, bridging the gap between theoretical research and practical implementation in industry.

Related papers

• A Survey on Knowledge Organization Systems of Research Fields: Resources and Challenges [0.0]
  Knowledge Organization Systems (KOSs) play a fundamental role in categorising, managing, and retrieving information. This paper aims to present a comprehensive survey of the current KOS for academic disciplines. We analysed 45 KOSs according to five main dimensions: scope, structure, usage, and links to other KOSs.
  arXiv  Detail & Related papers  (2024-09-06T17:54:43Z)
• The use of the open innovation paradigm in the public sector: a systematic review of published studies [3.6203549269055237]
  The use of the open innovation paradigm has been, over the past years, getting special attention in the public sector. It was possible to verify that the use of this paradigm started to be reported with a higher frequency in the literature since 2013. It was also possible to verify that the use of open innovation through social media was one of the pioneer techniques of engagement between the public sector and citizens.
  arXiv  Detail & Related papers  (2024-04-02T01:33:34Z)
• LLM as a Mastermind: A Survey of Strategic Reasoning with Large Language Models [75.89014602596673]
  Strategic reasoning requires understanding and predicting adversary actions in multi-agent settings while adjusting strategies accordingly. We explore the scopes, applications, methodologies, and evaluation metrics related to strategic reasoning with Large Language Models. It underscores the importance of strategic reasoning as a critical cognitive capability and offers insights into future research directions and potential improvements.
  arXiv  Detail & Related papers  (2024-04-01T16:50:54Z)
• Privacy Impact Assessments in the Wild: A Scoping Review [1.7677916783208343]
  Privacy Impact Assessments (PIAs) offer a systematic process for assessing the privacy impacts of a project or system. PIAs are heralded as one of the main approaches to privacy by design, supporting the early identification of threats and controls. There is still a significant need for more primary research on the topic, both qualitative and quantitative.
  arXiv  Detail & Related papers  (2024-02-17T05:07:10Z)
• A Large Language Model Supported Synthesis of Contemporary Academic Integrity Research Trends [0.0]
  This paper reports on qualitative content analysis undertaken using ChatGPT, a Large Language Model (LLM) The analysis identified 7 research themes and 13 key areas for exploration.
  arXiv  Detail & Related papers  (2024-01-07T13:23:29Z)
• Repeatability, Reproducibility, Replicability, Reusability (4R) in Journals' Policies and Software/Data Management in Scientific Publications: A Survey, Discussion, and Perspectives [1.446375009535228]
  We have found a large gap between the citation-oriented practices, journal policies, recommendations, artifact Description/Evaluation guidelines, submission guides, technological evolution. The relationship between authors and scientific journals in their mutual efforts to jointly improve scientific results is analyzed. We propose recommendations for the journal policies, as well as a unified and standardized Reproducibility Guide for the submission of scientific articles for authors.
  arXiv  Detail & Related papers  (2023-12-18T09:02:28Z)
• Responsible AI Considerations in Text Summarization Research: A Review of Current Practices [89.85174013619883]
  We focus on text summarization, a common NLP task largely overlooked by the responsible AI community. We conduct a multi-round qualitative analysis of 333 summarization papers from the ACL Anthology published between 2020-2022. We focus on how, which, and when responsible AI issues are covered, which relevant stakeholders are considered, and mismatches between stated and realized research goals.
  arXiv  Detail & Related papers  (2023-11-18T15:35:36Z)
• A Comprehensive Survey of Continual Learning: Theory, Method and Application [64.23253420555989]
  We present a comprehensive survey of continual learning, seeking to bridge the basic settings, theoretical foundations, representative methods, and practical applications. We summarize the general objectives of continual learning as ensuring a proper stability-plasticity trade-off and an adequate intra/inter-task generalizability in the context of resource efficiency.
  arXiv  Detail & Related papers  (2023-01-31T11:34:56Z)
• Fairness in Recommender Systems: Research Landscape and Future Directions [119.67643184567623]
  We review the concepts and notions of fairness that were put forward in the area in the recent past. We present an overview of how research in this field is currently operationalized. Overall, our analysis of recent works points to certain research gaps.
  arXiv  Detail & Related papers  (2022-05-23T08:34:25Z)
• Individual Explanations in Machine Learning Models: A Survey for Practitioners [69.02688684221265]
  The use of sophisticated statistical models that influence decisions in domains of high societal relevance is on the rise. Many governments, institutions, and companies are reluctant to their adoption as their output is often difficult to explain in human-interpretable ways. Recently, the academic literature has proposed a substantial amount of methods for providing interpretable explanations to machine learning models.
  arXiv  Detail & Related papers  (2021-04-09T01:46:34Z)
• A Survey on Causal Inference [64.45536158710014]
  Causal inference is a critical research topic across many domains, such as statistics, computer science, education, public policy and economics. Various causal effect estimation methods for observational data have sprung up.
  arXiv  Detail & Related papers  (2020-02-05T21:35:29Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.