Anachronic Tertiary Studies in Software Engineering: An Exploratory
Quaternary Study
- URL: http://arxiv.org/abs/2311.00211v1
- Date: Wed, 1 Nov 2023 00:54:55 GMT
- Title: Anachronic Tertiary Studies in Software Engineering: An Exploratory
Quaternary Study
- Authors: Valdemar Vicente Graciano Neto and C\'elia La\'is Rodrigues and
Fernando Kenji Kamei and Juliano Lopes de Oliveira and Eliomar Ara\'ujo de
Lima and Mohamad Kassab and Roberto Oliveira
- Abstract summary: This paper presents an analysis of 34 software engineering tertiary studies published between 2009 and 2021.
Results indicate that over 60% of the studies demonstrate varying degrees of anachronism due to the publication of primary and secondary studies.
- Score: 39.125366249242646
- License: http://creativecommons.org/licenses/by-sa/4.0/
- Abstract: Systematic literature reviews tentativelydescribe the state of the art in a
given research area. However, the continuous publication of new primary and
secondary studies following the release of a tertiary study can make the
communication of results not integrally representative in regards to the
advances achieved by that time. Consequently, using such a study as a reference
within specific bodies of knowledge may introduce imprecision, both in terms of
its subareas and with respect to new methodologies, languages, and tools. Thus,
a review of tertiary studies (what could be understood as a quaternary study)
could contribute to show the representativeness of the reported findings in
comparison to the state of the art and also to compile a set of perceptions
that could not be previously achieved. In that direction, the main contribution
of this paper is presenting the findings from an analysis of 34 software
engineering tertiary studies published between 2009 and 2021. The results
indicate that over 60% of the studies demonstrate varying degrees of
anachronism due to the publication of primary and secondary studies following
the publication of the tertiary study or even due to a time elapse between its
conduction and its publication.
Related papers
- Transforming Science with Large Language Models: A Survey on AI-assisted Scientific Discovery, Experimentation, Content Generation, and Evaluation [58.064940977804596]
A plethora of new AI models and tools has been proposed, promising to empower researchers and academics worldwide to conduct their research more effectively and efficiently.
Ethical concerns regarding shortcomings of these tools and potential for misuse take a particularly prominent place in our discussion.
arXiv Detail & Related papers (2025-02-07T18:26:45Z) - A Call for Critically Rethinking and Reforming Data Analysis in Empirical Software Engineering [5.687882380471718]
Concerns about the correct application of empirical methodologies have existed since the 2006 Dagstuhl seminar on Empirical Software Engineering.
We conducted a literature survey of 27,000 empirical studies, using LLMs to classify statistical methodologies as adequate or inadequate.
We selected 30 primary studies and held a workshop with 33 ESE experts to assess their ability to identify and resolve statistical issues.
arXiv Detail & Related papers (2025-01-22T09:05:01Z) - Software analytics for software engineering: A tertiary review [2.7386485828693576]
We identify five secondary studies on the use of software analytics (SA) for software engineering (SE)
Despite the overlapping objectives and search time frames of these secondary studies, there is negligible overlap of primary studies between these secondary studies.
We conclude that an overview of the literature identified by these secondary studies would be useful in providing a more comprehensive overview of the topic.
arXiv Detail & Related papers (2024-10-08T08:28:03Z) - A Literature Review of Literature Reviews in Pattern Analysis and Machine Intelligence [55.33653554387953]
Pattern Analysis and Machine Intelligence (PAMI) has led to numerous literature reviews aimed at collecting and fragmented information.
This paper presents a thorough analysis of these literature reviews within the PAMI field.
We try to address three core research questions: (1) What are the prevalent structural and statistical characteristics of PAMI literature reviews; (2) What strategies can researchers employ to efficiently navigate the growing corpus of reviews; and (3) What are the advantages and limitations of AI-generated reviews compared to human-authored ones.
arXiv Detail & Related papers (2024-02-20T11:28:50Z) - De-identification of clinical free text using natural language
processing: A systematic review of current approaches [48.343430343213896]
Natural language processing has repeatedly demonstrated its feasibility in automating the de-identification process.
Our study aims to provide systematic evidence on how the de-identification of clinical free text has evolved in the last thirteen years.
arXiv Detail & Related papers (2023-11-28T13:20:41Z) - Machine Learning Research Trends in Africa: A 30 Years Overview with
Bibliometric Analysis Review [2.6774008509840996]
The presented bibliometric analysis study consists of 2761 machine learning-related documents, of which 98% were articles with at least 482 citations published in 903 journals during the past 30 years.
The collated documents were retrieved from the Science Citation Index EXPANDED, comprising research publications from 54 African countries between 1993 and 2021.
arXiv Detail & Related papers (2023-04-15T12:27:43Z) - Image-text Retrieval: A Survey on Recent Research and Development [58.060687870247996]
Cross-modal image-text retrieval (ITR) has experienced increased interest in the research community due to its excellent research value and broad real-world application.
This paper presents a comprehensive and up-to-date survey on the ITR approaches from four perspectives.
arXiv Detail & Related papers (2022-03-28T13:00:01Z) - Topic Space Trajectories: A case study on machine learning literature [0.0]
We present topic space trajectories, a structure that allows for the comprehensible tracking of research topics.
We show the applicability of our approach on a publication corpus spanning 50 years of machine learning research from 32 publication venues.
Our novel analysis method may be employed for paper classification, for the prediction of future research topics, and for the recommendation of fitting conferences and journals for submitting unpublished work.
arXiv Detail & Related papers (2020-10-23T10:53:42Z) - Secondary Studies in the Academic Context: A Systematic Mapping and
Survey [4.122293798697967]
The main goal of this study is to provide an overview on the use of secondary studies in an academic context.
We conducted an SM to identify the available and relevant studies on the use of secondary studies as a research methodology for conducting SE research projects.
Secondly, a survey was performed with 64 SE researchers to identify their perception related to the value of performing secondary studies to support their research projects.
arXiv Detail & Related papers (2020-07-10T20:01:26Z) - A Survey on Causal Inference [64.45536158710014]
Causal inference is a critical research topic across many domains, such as statistics, computer science, education, public policy and economics.
Various causal effect estimation methods for observational data have sprung up.
arXiv Detail & Related papers (2020-02-05T21:35:29Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.