Patterns of Learner-AI Interaction and Academic Performance in an Object-Oriented Programming Course
- URL: http://arxiv.org/abs/2607.24755v1
- Date: Tue, 26 May 2026 07:48:00 GMT
- Title: Patterns of Learner-AI Interaction and Academic Performance in an Object-Oriented Programming Course
- Abstract summary: This research paper examines how different forms of learner-AI interaction relate to learning outcomes in object-oriented programming (OOP) courses.<n>Survey data were collected from 210 undergraduate students enrolled in a first-year OOP course.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: This full research paper examines how different forms of learner-AI interaction relate to learning outcomes in object-oriented programming (OOP) courses. Generative artificial intelligence (GenAI) tools are increasingly used by students in programming education, yet evidence on their educational impact remains mixed. In particular, little is known about how students integrate GenAI tools when learning OOP, and how different patterns of use relate to students' learning experiences and outcomes. This study investigates patterns of students' self-directed GenAI use and their relationship with academic performance, perceived difficulty, understanding, and trust. Survey data were collected from 210 undergraduate students enrolled in a first-year OOP course in which the use of GenAI tools was permitted for coursework but prohibited in assessments. Results show that students used GenAI significantly more often for explanation seeking and debugging than for code generation. Cluster analysis identified five distinct learner-AI interaction profiles, including a "smart" high-usage pattern characterized by low reliance on code generation and high use for conceptual support and debugging. While usage patterns were associated with differences in perceived assignment difficulty, self-assessed understanding, trust in AI-generated code, and norm-related attitudes, no significant differences in assessment performance were found across clusters. These findings suggest that self-directed GenAI use alone does not lead to measurable learning gains, underscoring the need for pedagogically guided and process-aware AI support. The study contributes empirical evidence on learner-AI interaction patterns and highlights the importance of pedagogically guided AI use in programming education.
Related papers
- Quick Build, Careful Check? Generative AI Use in Hackathons [83.0493885475068]
We report an exploratory interview study with participants at an AI-themed hackathon in central Europe.<n>We found that participants used GenAI for purposes beyond coding, including learning unfamiliar topics, brainstorming, and preparing documentation.<n>We also found that all participants converged on an unwritten practice of checking GenAI output before using it, yet their ability to actually verify was constrained by time pressure and limited domain knowledge.
arXiv Detail & Related papers (2026-07-31T08:59:18Z) - Is Solving Better Than Evaluating GenAI Solutions? [45.714140455691485]
This study compares evaluating GenAI-generated solutions with traditional problem solving in a junior-level algorithms course.<n>We found no statistically significant differences between groups in midterm scores, final exam scores, overall course grades, or exam problems structurally aligned with the homework interventions.<n>Students received significantly higher homework scores when evaluating GenAI-generated solutions, but this localized advantage did not translate into downstream gains.
arXiv Detail & Related papers (2026-07-30T02:08:29Z) - Implementing GenAI-Supported Learning in Software Engineering and Computer Science Education using Bloom's Taxonomy [0.4306143768014156]
Generative AI adoption in software engineering education raises opportunities for learning support alongside concerns about superficial learning and academic integrity.<n>This study investigates how explicit instructional guidance aligned with Bloom's taxonomy supports responsible GenAI use in SE/CS education.
arXiv Detail & Related papers (2026-06-24T10:44:07Z) - Exploring Student Perception on Gen AI Adoption in Higher Education: A Descriptive Study [1.978884131103313]
This study examines how students perceive, use, and evaluate Generative Artificial Intelligence (GenAI)<n>Data were collected through a questionnaire administered to 436 postgraduate Computer Science students at the University of Hertfordshire.
arXiv Detail & Related papers (2026-03-29T17:19:39Z) - Investigating Self-regulated Learning Sequences within a Generative AI-based Intelligent Tutoring System [14.046963768734114]
This study extracted students' interaction patterns with GenAI from trace data as they completed a problem-solving task within a GenAI-assisted intelligent tutoring system.<n>Students' purpose of using GenAI was also analyzed from the perspective of information processing.
arXiv Detail & Related papers (2026-01-13T20:37:19Z) - Examining the Usage of Generative AI Models in Student Learning Activities for Software Programming [3.2383459424229835]
This study investigates how GenAI assistance compares to conventional online resources in supporting knowledge gains across different proficiency levels.<n>We conducted a controlled user experiment with 24 undergraduate students of two different levels of programming experience.<n>Our findings reveal that generating complete solutions with GenAI significantly improves task performance, especially for beginners, but does not consistently result in knowledge gains.
arXiv Detail & Related papers (2025-11-17T11:42:24Z) - Encouraging Students' Responsible Use of GenAI in Software Engineering Education: A Causal Model and Two Institutional Applications [0.4306143768014156]
As generative AI (GenAI) tools become pervasive in education, concerns are rising about students using them to complete rather than learn.<n>This paper proposes and empirically applies a causal model to help educators scaffold responsible GenAI use in Software Engineering (SE) education.
arXiv Detail & Related papers (2025-05-31T19:27:40Z) - From Recall to Reasoning: Automated Question Generation for Deeper Math Learning through Large Language Models [44.99833362998488]
We investigated the first steps for optimizing content creation for advanced math.<n>We looked at the ability of GenAI to produce high-quality practice problems that are relevant to the course content.
arXiv Detail & Related papers (2025-05-17T08:30:10Z) - Evaluating the AI-Lab Intervention: Impact on Student Perception and Use of Generative AI in Early Undergraduate Computer Science Courses [0.0]
Generative AI (GenAI) is rapidly entering computer science education.<n>Concerns about overreliance coexist with a gap in research on structured scaffolding to guide tool use in formal courses.<n>This study examines the impact of a dedicated "AI-Lab" intervention on undergraduate students.
arXiv Detail & Related papers (2025-04-30T18:12:42Z) - Early Adoption of Generative Artificial Intelligence in Computing Education: Emergent Student Use Cases and Perspectives in 2023 [38.83649319653387]
There is limited prior research on computing students' use and perceptions of GenAI.
We surveyed all computer science majors in a small engineering-focused R1 university.
We discuss the impact of our findings on the emerging conversation around GenAI and education.
arXiv Detail & Related papers (2024-11-17T20:17:47Z) - Hey GPT, Can You be More Racist? Analysis from Crowdsourced Attempts to Elicit Biased Content from Generative AI [41.96102438774773]
This work presents the findings from a university-level competition, which challenged participants to design prompts for eliciting biased outputs from GenAI tools.
We quantitatively and qualitatively analyze the competition submissions and identify a diverse set of biases in GenAI and strategies employed by participants to induce bias in GenAI.
arXiv Detail & Related papers (2024-10-20T18:44:45Z) - Toward enriched Cognitive Learning with XAI [44.99833362998488]
We introduce an intelligent system (CL-XAI) for Cognitive Learning which is supported by artificial intelligence (AI) tools.
The use of CL-XAI is illustrated with a game-inspired virtual use case where learners tackle problems to enhance problem-solving skills.
arXiv Detail & Related papers (2023-12-19T16:13:47Z) - Explainable Active Learning (XAL): An Empirical Study of How Local
Explanations Impact Annotator Experience [76.9910678786031]
We propose a novel paradigm of explainable active learning (XAL), by introducing techniques from the recently surging field of explainable AI (XAI) into an Active Learning setting.
Our study shows benefits of AI explanation as interfaces for machine teaching--supporting trust calibration and enabling rich forms of teaching feedback, and potential drawbacks--anchoring effect with the model judgment and cognitive workload.
arXiv Detail & Related papers (2020-01-24T22:52:18Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.