The impact and applications of ChatGPT: a systematic review of
literature reviews
- URL: http://arxiv.org/abs/2305.18086v1
- Date: Mon, 8 May 2023 17:57:34 GMT
- Title: The impact and applications of ChatGPT: a systematic review of
literature reviews
- Authors: Irene S. Gabashvili
- Abstract summary: ChatGPT has become one of the most widely used natural language processing tools.
With thousands of published papers demonstrating its applications across various industries and fields, ChatGPT has sparked significant interest in the research community.
An overview of the available evidence from multiple reviews and studies could provide further insights, minimize redundancy, and identify areas where further research is needed.
- Score: 0.0
- License: http://creativecommons.org/licenses/by-sa/4.0/
- Abstract: The conversational artificial-intelligence (AI) technology ChatGPT has become
one of the most widely used natural language processing tools. With thousands
of published papers demonstrating its applications across various industries
and fields, ChatGPT has sparked significant interest in the research community.
Reviews of primary data have also begun to emerge. An overview of the available
evidence from multiple reviews and studies could provide further insights,
minimize redundancy, and identify areas where further research is needed.
Objective: To evaluate the existing reviews and literature related to ChatGPT's
applications and its potential impact on different fields by conducting a
systematic review of reviews and bibliometric analysis of primary literature.
Methods: PubMed, EuropePMC, Dimensions AI, medRxiv, bioRxiv, arXiv, and Google
Scholar were searched for ChatGPT-related publications from 2022 to 4/30/2023.
Studies including secondary data related to the application of ChatGPT were
considered. Reporting and risk of bias assesment was performed using PRISMA
guidelines. Results: A total of 305 unique records with potential relevance to
the review were identified from a pool of over 2,000 original articles. After
multi-step screening process, 11 reviews were selected, consisting of 9 reviews
specifically focused on ChatGPT and 2 reviews on broader AI topics that also
included discussions on ChatGPT. We also conducted bibliometric analysis of
primary data. Conclusions: While AI has the potential to revolutionize various
industries, further interdisciplinary research, customized integrations, and
ethical innovation are necessary to address existing concerns and ensure its
responsible use. Protocol Registration: PROSPERO registration no.
CRD42023417336, DOI 10.17605/OSF.IO/87U6Q.
Related papers
- RelevAI-Reviewer: A Benchmark on AI Reviewers for Survey Paper Relevance [0.8089605035945486]
We propose RelevAI-Reviewer, an automatic system that conceptualizes the task of survey paper review as a classification problem.
We introduce a novel dataset comprised of 25,164 instances. Each instance contains one prompt and four candidate papers, each varying in relevance to the prompt.
We develop a machine learning (ML) model capable of determining the relevance of each paper and identifying the most pertinent one.
arXiv Detail & Related papers (2024-06-13T06:42:32Z) - A Literature Review of Literature Reviews in Pattern Analysis and Machine Intelligence [58.6354685593418]
This paper proposes several article-level, field-normalized, and large language model-empowered bibliometric indicators to evaluate reviews.
The newly emerging AI-generated literature reviews are also appraised.
This work offers insights into the current challenges of literature reviews and envisions future directions for their development.
arXiv Detail & Related papers (2024-02-20T11:28:50Z) - DEMASQ: Unmasking the ChatGPT Wordsmith [63.8746084667206]
We propose an effective ChatGPT detector named DEMASQ, which accurately identifies ChatGPT-generated content.
Our method addresses two critical factors: (i) the distinct biases in text composition observed in human- and machine-generated content and (ii) the alterations made by humans to evade previous detection methods.
arXiv Detail & Related papers (2023-11-08T21:13:05Z) - Harnessing ChatGPT for thematic analysis: Are we ready? [0.0]
ChatGPT is an advanced natural language processing tool with growing applications across various disciplines in medical research.
This viewpoint explores the utilization of ChatGPT in three core phases of thematic analysis within a medical context.
arXiv Detail & Related papers (2023-10-23T03:55:13Z) - Decoding ChatGPT: A Taxonomy of Existing Research, Current Challenges,
and Possible Future Directions [2.5427838419316946]
Chat Generative Pre-trained Transformer (ChatGPT) has gained significant interest and attention since its launch in November 2022.
We present a comprehensive review of over 100 Scopus-indexed publications on ChatGPT.
arXiv Detail & Related papers (2023-07-26T11:10:04Z) - Ethical Aspects of ChatGPT in Software Engineering Research [4.0594888788503205]
ChatGPT can improve Software Engineering (SE) research practices by offering efficient, accessible information analysis and synthesis based on natural language interactions.
However, ChatGPT could bring ethical challenges, encompassing plagiarism, privacy, data security, and the risk of generating biased or potentially detrimental data.
This research aims to fill the given gap by elaborating on the key elements: motivators, demotivators, and ethical principles of using ChatGPT in SE research.
arXiv Detail & Related papers (2023-06-13T06:13:21Z) - On the Detectability of ChatGPT Content: Benchmarking, Methodology, and Evaluation through the Lens of Academic Writing [10.534162347659514]
We develop a deep neural framework named CheckGPT to better capture the subtle and deep semantic and linguistic patterns in ChatGPT written literature.
To evaluate the detectability of ChatGPT content, we conduct extensive experiments on the transferability, prompt engineering, and robustness of CheckGPT.
arXiv Detail & Related papers (2023-06-07T12:33:24Z) - Scientific Opinion Summarization: Paper Meta-review Generation Dataset, Methods, and Evaluation [55.00687185394986]
We propose the task of scientific opinion summarization, where research paper reviews are synthesized into meta-reviews.
We introduce the ORSUM dataset covering 15,062 paper meta-reviews and 57,536 paper reviews from 47 conferences.
Our experiments show that (1) human-written summaries do not always satisfy all necessary criteria such as depth of discussion, and identifying consensus and controversy for the specific domain, and (2) the combination of task decomposition and iterative self-refinement shows strong potential for enhancing the opinions.
arXiv Detail & Related papers (2023-05-24T02:33:35Z) - On the Possibilities of AI-Generated Text Detection [76.55825911221434]
We argue that as machine-generated text approximates human-like quality, the sample size needed for detection bounds increases.
We test various state-of-the-art text generators, including GPT-2, GPT-3.5-Turbo, Llama, Llama-2-13B-Chat-HF, and Llama-2-70B-Chat-HF, against detectors, including oBERTa-Large/Base-Detector, GPTZero.
arXiv Detail & Related papers (2023-04-10T17:47:39Z) - To ChatGPT, or not to ChatGPT: That is the question! [78.407861566006]
This study provides a comprehensive and contemporary assessment of the most recent techniques in ChatGPT detection.
We have curated a benchmark dataset consisting of prompts from ChatGPT and humans, including diverse questions from medical, open Q&A, and finance domains.
Our evaluation results demonstrate that none of the existing methods can effectively detect ChatGPT-generated content.
arXiv Detail & Related papers (2023-04-04T03:04:28Z) - Tag-Aware Document Representation for Research Paper Recommendation [68.8204255655161]
We propose a hybrid approach that leverages deep semantic representation of research papers based on social tags assigned by users.
The proposed model is effective in recommending research papers even when the rating data is very sparse.
arXiv Detail & Related papers (2022-09-08T09:13:07Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.