Effects of Varying LLM Access on Essay Writing Behavior

• URL: http://arxiv.org/abs/2606.00250v1
• Date: Fri, 29 May 2026 18:30:30 GMT
• Title: Effects of Varying LLM Access on Essay Writing Behavior
• Abstract summary: This study examined how varying levels of large language models (LLMs) affect writing performance, engagement, and perceived authorship.<n>Overall essay quality was statistically indistinguishable across groups. Yet writing behavior and perceived authorship diverged sharply.<n>Our findings suggest that constraining, rather than banning, LLM access may preserve authorship confidence while retaining the scaffolding benefits of AI assistance.
• Score: 19.737546860572465
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Investigating the degree to which large language models (LLMs) affect teaching and learning in universities can help identify strategies for integrating LLMs in a way that supports, rather than undermines, student learning outcomes. This study examined how varying levels of LLM assistance affect writing performance, engagement, and perceived authorship. We report a pilot study in which 24 college students were randomly assigned to write a short essay with no LLM access, limited access (<=3 prompts, responses capped at 100 words), or unlimited access. Overall essay quality was statistically indistinguishable across groups. Yet writing behavior and perceived authorship diverged sharply: students with limited access reported higher ownership (62.5% would submit the essay as independent work, vs. 25% in the unlimited group), stronger organizational gains, and more strategic, revision-focused prompting. The unlimited group spent more time writing, produced essays more similar to LLM output, and reported reduced creative expression. Our findings suggest that constraining, rather than banning, LLM access may preserve authorship confidence while retaining the scaffolding benefits of AI assistance.

Related papers

• SWIM: Student Writing Simulation via Proficiency-Conditioned Generation [54.69949380133243]
  This work explores if language models can realistically simulate student writing, and introduce SWIM.<n>We evaluate prompting, supervised fine-tuning, and reinforcement learning methods for writing simulation using automated essay scoring as a measure of profile alignment.<n>Our findings suggest that explicit supervision enables substantially stronger profile alignment than prompting alone, while authentic low-proficiency writing remains challenging to reproduce.
  arXiv  Detail & Related papers  (2026-09-02T23:10:51Z)
• The Crutch or the Ceiling? How Different Generations of LLMs Shape EFL Student Writings [0.26097841018267615]
  This study explores the extent and limitations of Large Language Models (LLMs) in assisting secondary-level English as a Foreign Language (EFL) students with their writing tasks.<n>Our results indicate that advanced LLMs boost assessment scores and lexical diversity for lower-proficiency learners.<n>To transform AI-assisted practice into genuine learning, pedagogy must shift from focusing on output quality to verifying the learning process.
  arXiv  Detail & Related papers  (2026-04-16T18:19:46Z)
• How LLMs Distort Our Written Language [11.98582470524476]
  Large language models (LLMs) are used by over a billion people globally, most often to assist with writing.<n>We demonstrate that LLMs not only alter the voice and tone of human writing, but also consistently alter the intended meaning.
  arXiv  Detail & Related papers  (2026-03-18T18:01:52Z)
• The Digital Divide in Generative AI: Evidence from Large Language Model Use in College Admissions Essays [12.696416066678731]
  Large language models (LLMs) have become popular writing tools among students.<n>LLMs may expand access to high-quality feedback for students with less access to traditional writing support.<n>This study examines how adoption of LLM-assisted writing varies across socioeconomic groups.
  arXiv  Detail & Related papers  (2026-02-19T19:47:49Z)
• LLM or Human? Perceptions of Trust and Information Quality in Research Summaries [4.14522715241162]
  Large Language Models (LLMs) are increasingly used to generate and edit scientific abstracts.<n>Despite growing adoption, little is known about how readers perceive LLM-generated summaries.
  arXiv  Detail & Related papers  (2026-01-22T00:53:38Z)
• A Meta-Analysis of LLM Effects on Students across Qualification, Socialisation, and Subjectification [14.218377341186892]
  Large language models (LLMs) are increasingly positioned as solutions for education, yet evaluations often reduce their impact to narrow performance metrics.<n>This paper reframes the question by asking "what kind of impact should LLMs have in education?"<n>We present a meta-analysis of 133 experimental and quasi-experimental studies (k = 188)
  arXiv  Detail & Related papers  (2025-09-25T04:11:19Z)
• Mind the Gap! Choice Independence in Using Multilingual LLMs for Persuasive Co-Writing Tasks in Different Languages [51.96666324242191]
  We analyze whether user utilization of novel writing assistants in a charity advertisement writing task is affected by the AI's performance in a second language.<n>We quantify the extent to which these patterns translate into the persuasiveness of generated charity advertisements.
  arXiv  Detail & Related papers  (2025-02-13T17:49:30Z)
• Are We There Yet? Revealing the Risks of Utilizing Large Language Models in Scholarly Peer Review [66.73247554182376]
  Large language models (LLMs) have led to their integration into peer review.<n>The unchecked adoption of LLMs poses significant risks to the integrity of the peer review system.<n>We show that manipulating 5% of the reviews could potentially cause 12% of the papers to lose their position in the top 30% rankings.
  arXiv  Detail & Related papers  (2024-12-02T16:55:03Z)
• Embracing AI in Education: Understanding the Surge in Large Language Model Use by Secondary Students [53.20318273452059]
  Large language models (LLMs) like OpenAI's ChatGPT have opened up new avenues in education.<n>Despite school restrictions, our survey of over 300 middle and high school students revealed that a remarkable 70% of students have utilized LLMs.<n>We propose a few ideas to address such issues, including subject-specific models, personalized learning, and AI classrooms.
  arXiv  Detail & Related papers  (2024-11-27T19:19:34Z)
• LLMs Assist NLP Researchers: Critique Paper (Meta-)Reviewing [106.45895712717612]
  Large language models (LLMs) have shown remarkable versatility in various generative tasks. This study focuses on the topic of LLMs assist NLP Researchers. To our knowledge, this is the first work to provide such a comprehensive analysis.
  arXiv  Detail & Related papers  (2024-06-24T01:30:22Z)
• Toward Self-Improvement of LLMs via Imagination, Searching, and Criticizing [56.75702900542643]
  We introduce AlphaLLM for the self-improvements of Large Language Models.<n>It integrates Monte Carlo Tree Search (MCTS) with LLMs to establish a self-improving loop.<n>Our experimental results show that AlphaLLM significantly enhances the performance of LLMs without additional annotations.
  arXiv  Detail & Related papers  (2024-04-18T15:21:34Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.