Impact of ChatGPT on the writing style of condensed matter physicists

• URL: http://arxiv.org/abs/2408.17325v1
• Date: Fri, 30 Aug 2024 14:37:10 GMT
• Title: Impact of ChatGPT on the writing style of condensed matter physicists
• Authors: Shaojun Xu, Xiaohui Ye, Mengqi Zhang, Pei Wang,
• Abstract summary: We estimate the impact of ChatGPT's release on the writing style of condensed matter papers on arXiv. Our analysis reveals a statistically significant improvement in the English quality of abstracts written by non-native English speakers.
• Score: 6.653378613306849
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We apply a state-of-the-art difference-in-differences approach to estimate the impact of ChatGPT's release on the writing style of condensed matter papers on arXiv. Our analysis reveals a statistically significant improvement in the English quality of abstracts written by non-native English speakers. Importantly, this improvement remains robust even after accounting for other potential factors, confirming that it can be attributed to the release of ChatGPT. This indicates widespread adoption of the tool. Following the release of ChatGPT, there is a significant increase in the use of unique words, while the frequency of rare words decreases. Across language families, the changes in writing style are significant for authors from the Latin and Ural-Altaic groups, but not for those from the Germanic or other Indo-European groups.

Related papers

• Is ChatGPT Transforming Academics' Writing Style? [0.0]
  Based on one million arXiv papers submitted from May 2018 to January 2024, we assess the textual density of ChatGPT's writing style in their abstracts. We find that ChatGPT is having an increasing impact on arXiv abstracts, especially in the field of computer science. We conclude with an analysis of both positive and negative aspects of the penetration of ChatGPT into academics' writing style.
  arXiv  Detail & Related papers  (2024-04-12T17:41:05Z)
• Syntactic Language Change in English and German: Metrics, Parsers, and Convergences [56.47832275431858]
  The current paper looks at diachronic trends in syntactic language change in both English and German, using corpora of parliamentary debates from the last c. 160 years. We base our observations on five dependencys, including the widely used Stanford Core as well as 4 newer alternatives. We show that changes in syntactic measures seem to be more frequent at the tails of sentence length distributions.
  arXiv  Detail & Related papers  (2024-02-18T11:46:16Z)
• (Chat)GPT v BERT: Dawn of Justice for Semantic Change Detection [1.9226023650048942]
  Transformer-based language models like BERT and (Chat)GPT have emerged as lexical superheroes with great power to solve open research problems. We evaluate their ability to solve two diachronic extensions of the Word-in-Context (WiC) task: TempoWiC and HistoWiC.
  arXiv  Detail & Related papers  (2024-01-25T09:36:58Z)
• Emergent AI-Assisted Discourse: Case Study of a Second Language Writer Authoring with ChatGPT [5.8131604120288385]
  This study investigates the role of ChatGPT in facilitating academic writing, especially among language learners. Using a case study approach, this study examines the experiences of Kailing, a doctoral student, who integrates ChatGPT throughout their academic writing process.
  arXiv  Detail & Related papers  (2023-10-17T00:22:10Z)
• Exploring the effectiveness of ChatGPT-based feedback compared with teacher feedback and self-feedback: Evidence from Chinese to English translation [1.25097469793837]
  ChatGPT, a cutting-edge AI-powered,can quickly generate responses on given commands. This study compared the revised Chinese to English translation texts produced by Chinese Master of Translation and Interpretation (MTI) students.
  arXiv  Detail & Related papers  (2023-09-04T14:54:39Z)
• Is ChatGPT Involved in Texts? Measure the Polish Ratio to Detect ChatGPT-Generated Text [48.36706154871577]
  We introduce a novel dataset termed HPPT (ChatGPT-polished academic abstracts) It diverges from extant corpora by comprising pairs of human-written and ChatGPT-polished abstracts instead of purely ChatGPT-generated texts. We also propose the "Polish Ratio" method, an innovative measure of the degree of modification made by ChatGPT compared to the original human-written text.
  arXiv  Detail & Related papers  (2023-07-21T06:38:37Z)
• ChatGPT Beyond English: Towards a Comprehensive Evaluation of Large Language Models in Multilingual Learning [70.57126720079971]
  Large language models (LLMs) have emerged as the most important breakthroughs in natural language processing (NLP) This paper evaluates ChatGPT on 7 different tasks, covering 37 diverse languages with high, medium, low, and extremely low resources. Compared to the performance of previous models, our extensive experimental results demonstrate a worse performance of ChatGPT for different NLP tasks and languages.
  arXiv  Detail & Related papers  (2023-04-12T05:08:52Z)
• To ChatGPT, or not to ChatGPT: That is the question! [78.407861566006]
  This study provides a comprehensive and contemporary assessment of the most recent techniques in ChatGPT detection. We have curated a benchmark dataset consisting of prompts from ChatGPT and humans, including diverse questions from medical, open Q&A, and finance domains. Our evaluation results demonstrate that none of the existing methods can effectively detect ChatGPT-generated content.
  arXiv  Detail & Related papers  (2023-04-04T03:04:28Z)
• Is ChatGPT A Good Keyphrase Generator? A Preliminary Study [51.863368917344864]
  ChatGPT has recently garnered significant attention from the computational linguistics community. We evaluate its performance in various aspects, including keyphrase generation prompts, keyphrase generation diversity, and long document understanding. We find that ChatGPT performs exceptionally well on all six candidate prompts, with minor performance differences observed across the datasets.
  arXiv  Detail & Related papers  (2023-03-23T02:50:38Z)
• Chinese Intermediate English Learners outdid ChatGPT in deep cohesion: Evidence from English narrative writing [5.747170211018015]
  This study compared the writing performance on a narrative topic by ChatGPT and Chinese intermediate English (CIE) learners. Data were analyzed in terms of five discourse components using Coh-Metrix.
  arXiv  Detail & Related papers  (2023-03-21T12:55:54Z)
• Can ChatGPT Understand Too? A Comparative Study on ChatGPT and Fine-tuned BERT [103.57103957631067]
  ChatGPT has attracted great attention, as it can generate fluent and high-quality responses to human inquiries. We evaluate ChatGPT's understanding ability by evaluating it on the most popular GLUE benchmark, and comparing it with 4 representative fine-tuned BERT-style models. We find that: 1) ChatGPT falls short in handling paraphrase and similarity tasks; 2) ChatGPT outperforms all BERT models on inference tasks by a large margin; 3) ChatGPT achieves comparable performance compared with BERT on sentiment analysis and question answering tasks.
  arXiv  Detail & Related papers  (2023-02-19T12:29:33Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.