Will ChatGPT get you caught? Rethinking of Plagiarism Detection
- URL: http://arxiv.org/abs/2302.04335v1
- Date: Wed, 8 Feb 2023 20:59:18 GMT
- Title: Will ChatGPT get you caught? Rethinking of Plagiarism Detection
- Authors: Mohammad Khalil and Erkan Er
- Abstract summary: The rise of Artificial Intelligence (AI) technology and its impact on education has been a topic of growing concern in recent years.
The use of chatbots, particularly ChatGPT, for generating academic essays has sparked fears among scholars.
This study aims to explore the originality of contents produced by one of the most popular AI chatbots, ChatGPT.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: The rise of Artificial Intelligence (AI) technology and its impact on
education has been a topic of growing concern in recent years. The new
generation AI systems such as chatbots have become more accessible on the
Internet and stronger in terms of capabilities. The use of chatbots,
particularly ChatGPT, for generating academic essays at schools and colleges
has sparked fears among scholars. This study aims to explore the originality of
contents produced by one of the most popular AI chatbots, ChatGPT. To this end,
two popular plagiarism detection tools were used to evaluate the originality of
50 essays generated by ChatGPT on various topics. Our results manifest that
ChatGPT has a great potential to generate sophisticated text outputs without
being well caught by the plagiarism check software. In other words, ChatGPT can
create content on many topics with high originality as if they were written by
someone. These findings align with the recent concerns about students using
chatbots for an easy shortcut to success with minimal or no effort. Moreover,
ChatGPT was asked to verify if the essays were generated by itself, as an
additional measure of plagiarism check, and it showed superior performance
compared to the traditional plagiarism-detection tools. The paper discusses the
need for institutions to consider appropriate measures to mitigate potential
plagiarism issues and advise on the ongoing debate surrounding the impact of AI
technology on education. Further implications are discussed in the paper.
Related papers
- Chatbot-supported Thesis Writing: An Autoethnographic Report [0.0]
ChatGPT might be applied to formats that require learners to generate text, such as bachelor theses or student research papers.
ChatGPT is to be valued as a beneficial tool in thesis writing.
However, writing a conclusive thesis still requires the learner's meaningful engagement.
arXiv Detail & Related papers (2023-10-14T09:09:26Z) - PaperCard for Reporting Machine Assistance in Academic Writing [48.33722012818687]
ChatGPT, a question-answering system released by OpenAI in November 2022, has demonstrated a range of capabilities that could be utilised in producing academic papers.
This raises critical questions surrounding the concept of authorship in academia.
We propose a framework we name "PaperCard", a documentation for human authors to transparently declare the use of AI in their writing process.
arXiv Detail & Related papers (2023-10-07T14:28:04Z) - Identifying and Mitigating the Security Risks of Generative AI [179.2384121957896]
This paper reports the findings of a workshop held at Google on the dual-use dilemma posed by GenAI.
GenAI can be used just as well by attackers to generate new attacks and increase the velocity and efficacy of existing attacks.
We discuss short-term and long-term goals for the community on this topic.
arXiv Detail & Related papers (2023-08-28T18:51:09Z) - Is ChatGPT Involved in Texts? Measure the Polish Ratio to Detect
ChatGPT-Generated Text [48.36706154871577]
We introduce a novel dataset termed HPPT (ChatGPT-polished academic abstracts)
It diverges from extant corpora by comprising pairs of human-written and ChatGPT-polished abstracts instead of purely ChatGPT-generated texts.
We also propose the "Polish Ratio" method, an innovative measure of the degree of modification made by ChatGPT compared to the original human-written text.
arXiv Detail & Related papers (2023-07-21T06:38:37Z) - Transformative Effects of ChatGPT on Modern Education: Emerging Era of
AI Chatbots [36.760677949631514]
ChatGPT was released to provide coherent and useful replies based on analysis of large volumes of data.
Our preliminary evaluation concludes that ChatGPT performed differently in each subject area including finance, coding and maths.
There are clear drawbacks in its use, such as the possibility of producing inaccurate or false data.
Academic regulations and evaluation practices need to be updated, should ChatGPT be used as a tool in education.
arXiv Detail & Related papers (2023-05-25T17:35:57Z) - Perception, performance, and detectability of conversational artificial
intelligence across 32 university courses [15.642614735026106]
We compare the performance of ChatGPT against students on 32 university-level courses.
We find that ChatGPT's performance is comparable, if not superior, to that of students in many courses.
We find an emerging consensus among students to use the tool, and among educators to treat this as plagiarism.
arXiv Detail & Related papers (2023-05-07T10:37:51Z) - AI, write an essay for me: A large-scale comparison of human-written
versus ChatGPT-generated essays [66.36541161082856]
ChatGPT and similar generative AI models have attracted hundreds of millions of users.
This study compares human-written versus ChatGPT-generated argumentative student essays.
arXiv Detail & Related papers (2023-04-24T12:58:28Z) - To ChatGPT, or not to ChatGPT: That is the question! [78.407861566006]
This study provides a comprehensive and contemporary assessment of the most recent techniques in ChatGPT detection.
We have curated a benchmark dataset consisting of prompts from ChatGPT and humans, including diverse questions from medical, open Q&A, and finance domains.
Our evaluation results demonstrate that none of the existing methods can effectively detect ChatGPT-generated content.
arXiv Detail & Related papers (2023-04-04T03:04:28Z) - A Complete Survey on Generative AI (AIGC): Is ChatGPT from GPT-4 to
GPT-5 All You Need? [112.12974778019304]
generative AI (AIGC, a.k.a AI-generated content) has made headlines everywhere because of its ability to analyze and create text, images, and beyond.
In the era of AI transitioning from pure analysis to creation, it is worth noting that ChatGPT, with its most recent language model GPT-4, is just a tool out of numerous AIGC tasks.
This work focuses on the technological development of various AIGC tasks based on their output type, including text, images, videos, 3D content, etc.
arXiv Detail & Related papers (2023-03-21T10:09:47Z) - On the Educational Impact of ChatGPT: Is Artificial Intelligence Ready
to Obtain a University Degree? [0.0]
We evaluate the influence of ChatGPT on university education.
We discuss how computer science higher education should adapt to tools like ChatGPT.
arXiv Detail & Related papers (2023-03-20T14:27:37Z) - ChatGPT: The End of Online Exam Integrity? [0.0]
This study evaluated the ability of ChatGPT, a recently developed artificial intelligence (AI) agent, to perform high-level cognitive tasks.
It raises concerns about the potential use of ChatGPT as a tool for academic misconduct in online exams.
arXiv Detail & Related papers (2022-12-19T08:15:16Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.