Leveraging Sustainable Systematic Literature Reviews

• URL: http://arxiv.org/abs/2501.01819v1
• Date: Fri, 03 Jan 2025 14:03:15 GMT
• Title: Leveraging Sustainable Systematic Literature Reviews
• Authors: Vinicius dos Santos, Rick Kazman, Elisa Yumi Nakagawa,
• Abstract summary: This paper presents concrete directions towards sustainable SLRs. We first identified 18 green drivers'' (GD) that could directly impact SLR sustainability. We distilled 25 sustainability indicators (SI) associated with the GD to assess SLRs regarding their sustainability.
• Score: 8.18445480530188
• License:
• Abstract: Systematic Literature Reviews (SLRs) are a widely employed research method in software engineering. However, there are several problems with SLRs, including the enormous time and effort to conduct them and the lack of obvious impacts of SLR results on software engineering practices and industry projects. To address these problems, the concepts of \textit{sustainability} and \textit{sustainable SLR} have been proposed, aiming to raise awareness among researchers about the importance of dealing with SLR problems in a consistent way; however, practical and concrete actions are still lacking. This paper presents concrete directions towards sustainable SLRs. We first identified 18 ``green drivers'' (GD) that could directly impact SLR sustainability, and we distilled 25 sustainability indicators (SI) associated with the GD to assess SLRs regarding their sustainability. A preliminary evaluation was conducted on the ten top-cited SLRs in software engineering published over the last decade. From this analysis, we synthesized our insights into 12 leverage points for sustainability. Our results indicate that even in high-quality reviews, there are threats to sustainability, such as: flaws in the search process, lack of essential details in the documentation, weak collaboration with stakeholders, poor knowledge management, lack of use of supporting tools, and a dearth of practical insights for software engineering practitioners. The good news is that moving towards sustainable SLRs only requires some simple actions, which can pave the way for a profound change in the software engineering community's mindset about how to create and sustain SLRs.

Related papers

• Adversarial Alignment for LLMs Requires Simpler, Reproducible, and More Measurable Objectives [52.863024096759816]
  Misaligned research objectives have hindered progress in adversarial robustness research over the past decade. We argue that realigned objectives are necessary for meaningful progress in adversarial alignment.
  arXiv  Detail & Related papers  (2025-02-17T15:28:40Z)
• Exploring Automatic Cryptographic API Misuse Detection in the Era of LLMs [60.32717556756674]
  This paper introduces a systematic evaluation framework to assess Large Language Models in detecting cryptographic misuses. Our in-depth analysis of 11,940 LLM-generated reports highlights that the inherent instabilities in LLMs can lead to over half of the reports being false positives. The optimized approach achieves a remarkable detection rate of nearly 90%, surpassing traditional methods and uncovering previously unknown misuses in established benchmarks.
  arXiv  Detail & Related papers  (2024-07-23T15:31:26Z)
• A Thorough Performance Benchmarking on Lightweight Embedding-based Recommender Systems [67.52782366565658]
  State-of-the-art recommender systems (RSs) depend on categorical features, which ecoded by embedding vectors, resulting in excessively large embedding tables. Despite the prosperity of lightweight embedding-based RSs, a wide diversity is seen in evaluation protocols. This study investigates various LERS' performance, efficiency, and cross-task transferability via a thorough benchmarking process.
  arXiv  Detail & Related papers  (2024-06-25T07:45:00Z)
• MR-Ben: A Meta-Reasoning Benchmark for Evaluating System-2 Thinking in LLMs [55.20845457594977]
  Large language models (LLMs) have shown increasing capability in problem-solving and decision-making. We present a process-based benchmark MR-Ben that demands a meta-reasoning skill. Our meta-reasoning paradigm is especially suited for system-2 slow thinking.
  arXiv  Detail & Related papers  (2024-06-20T03:50:23Z)
• Clearing the Path for Software Sustainability [0.0]
  This paper outlines key challenges identified in literature based on findings from a tertiary study. Confusion regarding the definition of software sustainability, uncertainty about when to consider sustainability in software development, lack of assessment metrics and tools, narrow perspectives on sustainability in software systems, insufficient awareness and education, and a lack of serious considerations in practice.
  arXiv  Detail & Related papers  (2024-05-24T15:24:24Z)
• Learning Planning-based Reasoning by Trajectories Collection and Process Reward Synthesizing [61.98556945939045]
  We propose a framework to learn planning-based reasoning through Direct Preference Optimization (DPO) on collected trajectories. Our results on challenging logical reasoning benchmarks demonstrate the effectiveness of our learning framework.
  arXiv  Detail & Related papers  (2024-02-01T15:18:33Z)
• Advancing Requirements Engineering through Generative AI: Assessing the Role of LLMs [10.241642683713467]
  Large-language models (LLMs) have shown significant promise in diverse domains, including natural language processing, code generation, and program understanding. This chapter explores the potential of LLMs in driving Requirements Engineering processes, aiming to improve the efficiency and accuracy of requirements-related tasks.
  arXiv  Detail & Related papers  (2023-10-21T11:29:31Z)
• CHATREPORT: Democratizing Sustainability Disclosure Analysis through LLM-based Tools [10.653984116770234]
  ChatReport is a novel LLM-based system to automate the analysis of corporate sustainability reports. We make our methodology, annotated datasets, and generated analyses of 1015 reports publicly available.
  arXiv  Detail & Related papers  (2023-07-28T18:58:16Z)
• Sentiment Analysis in the Era of Large Language Models: A Reality Check [69.97942065617664]
  This paper investigates the capabilities of large language models (LLMs) in performing various sentiment analysis tasks. We evaluate performance across 13 tasks on 26 datasets and compare the results against small language models (SLMs) trained on domain-specific datasets.
  arXiv  Detail & Related papers  (2023-05-24T10:45:25Z)
• A Comprehensive Review of Sign Language Recognition: Different Types, Modalities, and Datasets [0.0]
  SLR usage has increased in many applications, but the environment, background image resolution, modalities, and datasets affect the performance a lot. This review paper facilitates a comprehensive overview of SLR and discusses the needs, challenges, and problems associated with SLR. Research progress and existing state-of-the-art SLR models over the past decade have been reviewed.
  arXiv  Detail & Related papers  (2022-04-07T09:49:12Z)
• On how Cognitive Computing will plan your next Systematic Review [3.0816257225447763]
  We report on the insights from 24 SLR authors on planning practices, its challenges and feedback on support strategies. We frame our findings under the cognitive augmentation framework, and report on a prototype implementation and evaluation.
  arXiv  Detail & Related papers  (2020-12-15T09:56:09Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.