Examining Student Interactions with a Pedagogical AI-Assistant for Essay Writing and their Impact on Students Writing Quality

• URL: http://arxiv.org/abs/2512.08596v1
• Date: Tue, 09 Dec 2025 13:34:33 GMT
• Title: Examining Student Interactions with a Pedagogical AI-Assistant for Essay Writing and their Impact on Students Writing Quality
• Authors: Wicaksono Febriantoro, Qi Zhou, Wannapon Suraworachet, Sahan Bulathwela, Andrea Gauthier, Eva Millan, Mutlu Cukurova,
• Abstract summary: The dynamic nature of interactions between students and GenAI, as well as their relationship to writing quality, remains underexplored.<n>We evaluated a GenAI-driven essay-writing assistant (EWA) designed to support higher education students in argumentative writing.
• Score: 4.112932467662682
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: The dynamic nature of interactions between students and GenAI, as well as their relationship to writing quality, remains underexplored. While most research has examined how general-purpose GenAI can support writing, fewer studies have investigated how students interact with pedagogically designed systems across different phases of the writing process. To address this gap, we evaluated a GenAI-driven essay-writing assistant (EWA) designed to support higher education students in argumentative writing. Drawing on 1,282 interaction logs from 32 undergraduates during a two-hour writing session, Sequential Pattern Mining and K-Means clustering were used to identify behavioral patterns. Two clusters emerged: Cluster 1 emphasized outline planning and essay structure, while Cluster 2 focused on content development. A Mann-Whitney U test revealed a moderate effect size (r = 0.36) in the essay Organization dimension, with Cluster 1 showing higher scores. Qualitative analysis indicated that students with better performance actively wrote and shared essay sections with EWA for feedback, rather than interacted passively by asking questions. These findings suggest implications for teaching and system design. Teachers can encourage active engagement, while future EWAs may integrate automatic labeling and monitoring to prompt students to move from questioning to writing, enabling fuller benefits from GenAI-supported learning.

Related papers

• Exposía: Academic Writing Assessment of Exposés and Peer Feedback [56.428320613219306]
  We present Exposa, the first public dataset that connects writing and feedback assessment in higher education.<n>We use Exposa to benchmark state-of-the-art open-source large language models (LLMs) for two tasks: automated scoring of (1) the proposals and (2) the student reviews.
  arXiv  Detail & Related papers  (2026-01-10T11:33:26Z)
• UCO: A Multi-Turn Interactive Reinforcement Learning Method for Adaptive Teaching with Large Language Models [59.693733170193944]
  Large language models (LLMs) are shifting from answer providers to intelligent tutors in educational settings.<n>Recent reinforcement learning approaches address this limitation but face two critical challenges.<n>We propose the Unidirectional Cognitive Optimization (UCO) method to address these challenges.
  arXiv  Detail & Related papers  (2025-11-12T01:27:02Z)
• Human or AI? Comparing Design Thinking Assessments by Teaching Assistants and Bots [0.38233569758620045]
  This study investigates the reliability and perceived accuracy of AI-assisted assessment compared to TA-assisted assessment in evaluating student posters in design thinking education.<n>Results showed low statistical agreement between instructor and AI scores for empathy and pain points, with slightly higher alignment for visual communication.<n>The study underscores the need for hybrid assessment models that integrate computational efficiency with human insights.
  arXiv  Detail & Related papers  (2025-10-17T07:09:21Z)
• Assessing prompting frameworks for enhancing literature reviews among university students using ChatGPT [0.0]
  Writing literature reviews is a common component of university curricula, yet it often poses challenges for students.<n>Since generative artificial intelligence (GenAI) tools have been made publicly accessible, students have been employing them for academic writing tasks.<n>This study explores how university students use one of the most popular GenAI tools, ChatGPT, to write literature reviews.
  arXiv  Detail & Related papers  (2025-09-01T04:47:34Z)
• The Agency Gap: How Generative AI Literacy Shapes Independent Writing after AI Support [4.013708138746962]
  This study investigates the extent to which GenAI literacy predicts student writing performance in contexts that require self-initiation and regulation.<n>Writing was evaluated across insightfulness, visual data integration, organisation, linguistic quality, and critical thinking.
  arXiv  Detail & Related papers  (2025-07-06T14:01:06Z)
• From Recall to Reasoning: Automated Question Generation for Deeper Math Learning through Large Language Models [44.99833362998488]
  We investigated the first steps for optimizing content creation for advanced math.<n>We looked at the ability of GenAI to produce high-quality practice problems that are relevant to the course content.
  arXiv  Detail & Related papers  (2025-05-17T08:30:10Z)
• Evaluating the AI-Lab Intervention: Impact on Student Perception and Use of Generative AI in Early Undergraduate Computer Science Courses [0.0]
  Generative AI (GenAI) is rapidly entering computer science education.<n>Concerns about overreliance coexist with a gap in research on structured scaffolding to guide tool use in formal courses.<n>This study examines the impact of a dedicated "AI-Lab" intervention on undergraduate students.
  arXiv  Detail & Related papers  (2025-04-30T18:12:42Z)
• Modifying AI, Enhancing Essays: How Active Engagement with Generative AI Boosts Writing Quality [4.517077427559346]
  Students are increasingly relying on Generative AI (GAI) to support their writing.<n>This study aimed to help teachers better assess and support student learning in GAI-assisted writing.
  arXiv  Detail & Related papers  (2024-12-10T05:32:57Z)
• StuGPTViz: A Visual Analytics Approach to Understand Student-ChatGPT Interactions [35.927734064685886]
  We present a visual analytics system, StuGPTViz, that tracks and compares temporal patterns in student prompts and the quality of ChatGPT's responses at multiple scales. The results confirmed StuGPTViz's capacity to enhance educators' insights into the pedagogical value of ChatGPT.
  arXiv  Detail & Related papers  (2024-07-17T09:20:44Z)
• LLM-as-a-tutor in EFL Writing Education: Focusing on Evaluation of Student-LLM Interaction [40.76665188171691]
  In the context of English as a Foreign Language (EFL) writing education, LLM-as-a-tutor can assist students by providing real-time feedback on their essays. To bridge this gap, we integrate pedagogical principles to assess student-LLM interaction.
  arXiv  Detail & Related papers  (2023-10-08T15:00:04Z)
• Distantly-Supervised Named Entity Recognition with Adaptive Teacher Learning and Fine-grained Student Ensemble [56.705249154629264]
  Self-training teacher-student frameworks are proposed to improve the robustness of NER models. In this paper, we propose an adaptive teacher learning comprised of two teacher-student networks. Fine-grained student ensemble updates each fragment of the teacher model with a temporal moving average of the corresponding fragment of the student, which enhances consistent predictions on each model fragment against noise.
  arXiv  Detail & Related papers  (2022-12-13T12:14:09Z)
• Automated Graph Self-supervised Learning via Multi-teacher Knowledge Distillation [43.903582264697974]
  This paper studies the problem of how to automatically, adaptively, and dynamically learn instance-level self-supervised learning strategies for each node. We propose a novel multi-teacher knowledge distillation framework for Automated Graph Self-Supervised Learning (AGSSL) Experiments on eight datasets show that AGSSL can benefit from multiple pretext tasks, outperforming the corresponding individual tasks.
  arXiv  Detail & Related papers  (2022-10-05T08:39:13Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.