Tracing GenAI Literacy: Uncovering Student-AI Interaction Patterns in Academic Writing through Epistemic Network Analysis
- URL: http://arxiv.org/abs/2606.00040v1
- Date: Tue, 28 Apr 2026 08:16:31 GMT
- Title: Tracing GenAI Literacy: Uncovering Student-AI Interaction Patterns in Academic Writing through Epistemic Network Analysis
- Abstract summary: Generative AI (GenAI) becomes integral to education, fostering GenAI literacy is critical.<n>Current assessments largely rely on self-reported scales, lacking insights into how literacy manifests in actual learning processes.<n>We collected interaction logs from 162 university students engaged in a GenAI-assisted abstract writing task.<n>Preliminary results reveal distinct interaction signatures: high-literacy students engage in iterative refinement and strategic questioning, while low-literacy students rely on direct generation commands.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: As Generative AI (GenAI) becomes integral to education, fostering GenAI literacy is critical. However, current assessments largely rely on self-reported scales, lacking insights into how literacy manifests in actual learning processes. This study leverages Learning Analytics (LA) to bridge this gap. We collected interaction logs from 162 university students engaged in a GenAI-assisted abstract writing task. Using Epistemic Network Analysis (ENA), we modeled and compared the questioning strategies of students with varying GenAI literacy levels. Preliminary results reveal distinct interaction signatures: high-literacy students engage in iterative refinement and strategic questioning, while low-literacy students rely on direct generation commands. This work contributes to the workshop by demonstrating how process data can characterize GenAI literacy, paving the way for data-driven literacy assessment and real-time interventions.
Related papers
- Is Solving Better Than Evaluating GenAI Solutions? [45.714140455691485]
This study compares evaluating GenAI-generated solutions with traditional problem solving in a junior-level algorithms course.<n>We found no statistically significant differences between groups in midterm scores, final exam scores, overall course grades, or exam problems structurally aligned with the homework interventions.<n>Students received significantly higher homework scores when evaluating GenAI-generated solutions, but this localized advantage did not translate into downstream gains.
arXiv Detail & Related papers (2026-07-30T02:08:29Z) - Patterns of Learner-AI Interaction and Academic Performance in an Object-Oriented Programming Course [0.0]
This research paper examines how different forms of learner-AI interaction relate to learning outcomes in object-oriented programming (OOP) courses.<n>Survey data were collected from 210 undergraduate students enrolled in a first-year OOP course.
arXiv Detail & Related papers (2026-05-26T07:48:00Z) - Exploring Student Perception on Gen AI Adoption in Higher Education: A Descriptive Study [1.978884131103313]
This study examines how students perceive, use, and evaluate Generative Artificial Intelligence (GenAI)<n>Data were collected through a questionnaire administered to 436 postgraduate Computer Science students at the University of Hertfordshire.
arXiv Detail & Related papers (2026-03-29T17:19:39Z) - AI Literacy, Safety Awareness, and STEM Career Aspirations of Australian Secondary Students: Evaluating the Impact of Workshop Interventions [38.350232667249095]
Deepfakes and other forms of synthetic media pose growing safety risks for adolescents.<n>This study evaluates the impact of Day of AI Australia's workshop-based intervention on Australian secondary students.
arXiv Detail & Related papers (2026-01-30T02:55:53Z) - Investigating Self-regulated Learning Sequences within a Generative AI-based Intelligent Tutoring System [14.046963768734114]
This study extracted students' interaction patterns with GenAI from trace data as they completed a problem-solving task within a GenAI-assisted intelligent tutoring system.<n>Students' purpose of using GenAI was also analyzed from the perspective of information processing.
arXiv Detail & Related papers (2026-01-13T20:37:19Z) - Examining Student Interactions with a Pedagogical AI-Assistant for Essay Writing and their Impact on Students Writing Quality [4.112932467662682]
The dynamic nature of interactions between students and GenAI, as well as their relationship to writing quality, remains underexplored.<n>We evaluated a GenAI-driven essay-writing assistant (EWA) designed to support higher education students in argumentative writing.
arXiv Detail & Related papers (2025-12-09T13:34:33Z) - Generative AI Practices, Literacy, and Divides: An Empirical Analysis in the Italian Context [32.495879271249414]
This study presents the first comprehensive empirical mapping of GenAI adoption, usage patterns, and literacy in Italy.<n>Our findings reveal widespread adoption for both work and personal use, including sensitive tasks like emotional support and medical advice.<n>We identify a significant gender divide where women are half as likely to adopt GenAI and use it less frequently than men.
arXiv Detail & Related papers (2025-12-03T11:01:28Z) - The Agency Gap: How Generative AI Literacy Shapes Independent Writing after AI Support [4.013708138746962]
This study investigates the extent to which GenAI literacy predicts student writing performance in contexts that require self-initiation and regulation.<n>Writing was evaluated across insightfulness, visual data integration, organisation, linguistic quality, and critical thinking.
arXiv Detail & Related papers (2025-07-06T14:01:06Z) - From Recall to Reasoning: Automated Question Generation for Deeper Math Learning through Large Language Models [44.99833362998488]
We investigated the first steps for optimizing content creation for advanced math.<n>We looked at the ability of GenAI to produce high-quality practice problems that are relevant to the course content.
arXiv Detail & Related papers (2025-05-17T08:30:10Z) - Early Adoption of Generative Artificial Intelligence in Computing Education: Emergent Student Use Cases and Perspectives in 2023 [38.83649319653387]
There is limited prior research on computing students' use and perceptions of GenAI.
We surveyed all computer science majors in a small engineering-focused R1 university.
We discuss the impact of our findings on the emerging conversation around GenAI and education.
arXiv Detail & Related papers (2024-11-17T20:17:47Z) - Evolving Knowledge Distillation with Large Language Models and Active
Learning [46.85430680828938]
Large language models (LLMs) have demonstrated remarkable capabilities across various NLP tasks.
Previous research has attempted to distill the knowledge of LLMs into smaller models by generating annotated data.
We propose EvoKD: Evolving Knowledge Distillation, which leverages the concept of active learning to interactively enhance the process of data generation using large language models.
arXiv Detail & Related papers (2024-03-11T03:55:24Z) - Charting the Future of AI in Project-Based Learning: A Co-Design
Exploration with Students [35.05435052195561]
The increasing use of Artificial Intelligence (AI) by students in learning presents new challenges for assessing their learning outcomes.
This paper introduces a co-design study to explore the potential of students' AI usage data as a novel material for assessment.
arXiv Detail & Related papers (2024-01-26T14:49:29Z) - Active Learning for Abstractive Text Summarization [50.79416783266641]
We propose the first effective query strategy for Active Learning in abstractive text summarization.
We show that using our strategy in AL annotation helps to improve the model performance in terms of ROUGE and consistency scores.
arXiv Detail & Related papers (2023-01-09T10:33:14Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.