Waiting, Banning, and Embracing: An Empirical Analysis of Adapting
Policies for Generative AI in Higher Education
- URL: http://arxiv.org/abs/2305.18617v1
- Date: Thu, 25 May 2023 02:01:56 GMT
- Title: Waiting, Banning, and Embracing: An Empirical Analysis of Adapting
Policies for Generative AI in Higher Education
- Authors: Ping Xiao, Yuanyuan Chen, and Weining Bao
- Abstract summary: This study aims to understand how universities establish policies regarding the use of AI tools.
We analyzed the top 500 universities according to the 2022 World University Rankings.
- Score: 7.623773809868841
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: Generative AI tools such as ChatGPT have recently gained significant
attention in higher education. This study aims to understand how universities
establish policies regarding the use of AI tools and explore the factors that
influence their decisions. Our study examines ChatGPT policies implemented at
universities around the world, including their existence, content, and issuance
dates. Specifically, we analyzed the top 500 universities according to the 2022
QS World University Rankings. Our findings indicate that there is significant
variation in university policies. Less than one-third of the universities
included in the study had implemented ChatGPT policies. Of the universities
with ChatGPT policies, approximately 67 percent embraced ChatGPT in teaching
and learning, more than twice the number of universities that banned it. The
majority of the universities that ban the use of ChatGPT in assessments allow
individual instructors to deviate from this restrictive policy. Our empirical
analysis identifies several factors that are significantly and positively
correlated with a university's likelihood of having a ChatGPT policy, including
the university's academic reputation score, being in an English-speaking
country, and the general public attitudes toward ChatGPT. In addition, we found
that a university's likelihood of having a ban policy is positively associated
with faculty student ratio, citations, and the English-speaking country dummy,
while negatively associated with the number of peer universities within the
same country that have banned ChatGPT. We discuss the challenges faced by
universities based our empirical findings.
Related papers
- The use of ChatGPT in higher education: The advantages and disadvantages [0.0]
ChatGPT is an artificial intelligence technology developed by OpenAI.
This study examines the application of ChatGPT in higher education to comprehend and produce high-level instruction.
arXiv Detail & Related papers (2024-03-28T09:00:05Z) - Comprehensive Assessment of Toxicity in ChatGPT [49.71090497696024]
We evaluate the toxicity in ChatGPT by utilizing instruction-tuning datasets.
prompts in creative writing tasks can be 2x more likely to elicit toxic responses.
Certain deliberately toxic prompts, designed in earlier studies, no longer yield harmful responses.
arXiv Detail & Related papers (2023-11-03T14:37:53Z) - Primacy Effect of ChatGPT [69.49920102917598]
We study the primacy effect of ChatGPT: the tendency of selecting the labels at earlier positions as the answer.
We hope that our experiments and analyses provide additional insights into building more reliable ChatGPT-based solutions.
arXiv Detail & Related papers (2023-10-20T00:37:28Z) - "ChatGPT, a Friend or Foe for Education?" Analyzing the User's
Perspectives on the Latest AI Chatbot Via Reddit [0.0]
This study has analyzed 247 Reddit top posts related to the educational use of ChatGPT.
Results show that the majority of the users took a neutral viewpoint.
There was more positive perception than negative regarding the usefulness of ChatGPT in education.
arXiv Detail & Related papers (2023-09-27T23:59:44Z) - AI, write an essay for me: A large-scale comparison of human-written
versus ChatGPT-generated essays [66.36541161082856]
ChatGPT and similar generative AI models have attracted hundreds of millions of users.
This study compares human-written versus ChatGPT-generated argumentative student essays.
arXiv Detail & Related papers (2023-04-24T12:58:28Z) - To ChatGPT, or not to ChatGPT: That is the question! [78.407861566006]
This study provides a comprehensive and contemporary assessment of the most recent techniques in ChatGPT detection.
We have curated a benchmark dataset consisting of prompts from ChatGPT and humans, including diverse questions from medical, open Q&A, and finance domains.
Our evaluation results demonstrate that none of the existing methods can effectively detect ChatGPT-generated content.
arXiv Detail & Related papers (2023-04-04T03:04:28Z) - On the Educational Impact of ChatGPT: Is Artificial Intelligence Ready
to Obtain a University Degree? [0.0]
We evaluate the influence of ChatGPT on university education.
We discuss how computer science higher education should adapt to tools like ChatGPT.
arXiv Detail & Related papers (2023-03-20T14:27:37Z) - ChatGPT Participates in a Computer Science Exam [16.665883787432858]
We ask ChatGPT to participate in an undergraduate computer science exam on ''Algorithms and Data Structures''
We hand-copied its answers onto an exam sheet, which was subsequently graded in a blind setup alongside those of 200 participating students.
We find that ChatGPT narrowly passed the exam, obtaining 20.5 out of 40 points.
arXiv Detail & Related papers (2023-03-08T15:46:14Z) - Is ChatGPT a General-Purpose Natural Language Processing Task Solver? [113.22611481694825]
Large language models (LLMs) have demonstrated the ability to perform a variety of natural language processing (NLP) tasks zero-shot.
Recently, the debut of ChatGPT has drawn a great deal of attention from the natural language processing (NLP) community.
It is not yet known whether ChatGPT can serve as a generalist model that can perform many NLP tasks zero-shot.
arXiv Detail & Related papers (2023-02-08T09:44:51Z) - A Categorical Archive of ChatGPT Failures [47.64219291655723]
ChatGPT, developed by OpenAI, has been trained using massive amounts of data and simulates human conversation.
It has garnered significant attention due to its ability to effectively answer a broad range of human inquiries.
However, a comprehensive analysis of ChatGPT's failures is lacking, which is the focus of this study.
arXiv Detail & Related papers (2023-02-06T04:21:59Z) - The political ideology of conversational AI: Converging evidence on
ChatGPT's pro-environmental, left-libertarian orientation [0.0]
OpenAI introduced ChatGPT, a state-of-the-art dialogue model that can converse with its human counterparts.
This paper focuses on one of democratic society's most important decision-making processes: political elections.
We uncover ChatGPT's pro-environmental, left-libertarian ideology.
arXiv Detail & Related papers (2023-01-05T07:13:13Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.