Scaffolding Metacognition in Programming Education: Understanding Student-AI Interactions and Design Implications
- URL: http://arxiv.org/abs/2511.04144v1
- Date: Thu, 06 Nov 2025 07:42:24 GMT
- Title: Scaffolding Metacognition in Programming Education: Understanding Student-AI Interactions and Design Implications
- Authors: Boxuan Ma, Huiyong Li, Gen Li, Li Chen, Cheng Tang, Yinjie Xie, Chenghao Gu, Atsushi Shimada, Shin'ichi Konomi,
- Abstract summary: Generative AI tools such as ChatGPT now provide novice programmers with unprecedented access to instant, personalized support.<n>While this holds clear promise, their influence on students' metacognitive processes remains underexplored.<n>This study addresses that gap by analyzing student-AI interactions through a metacognitive lens in university-level programming courses.
- Score: 10.81558535566768
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Generative AI tools such as ChatGPT now provide novice programmers with unprecedented access to instant, personalized support. While this holds clear promise, their influence on students' metacognitive processes remains underexplored. Existing work has largely focused on correctness and usability, with limited attention to whether and how students' use of AI assistants supports or bypasses key metacognitive processes. This study addresses that gap by analyzing student-AI interactions through a metacognitive lens in university-level programming courses. We examined more than 10,000 dialogue logs collected over three years, complemented by surveys of students and educators. Our analysis focused on how prompts and responses aligned with metacognitive phases and strategies. Synthesizing these findings across data sources, we distill design considerations for AI-powered coding assistants that aim to support rather than supplant metacognitive engagement. Our findings provide guidance for developing educational AI tools that strengthen students' learning processes in programming education.
Related papers
- From Co-Design to Metacognitive Laziness: Evaluating Generative AI in Vocational Education [0.0]
This study examines the development and deployment of a Generative AI proof-of-concept (POC) designed to support lecturers in a vocational education setting in Singapore.<n>The POC achieved its primary operational goals: lecturers reported streamlined, reduced cognitive load, and observed improved student confidence in navigating course content.<n>Despite enhanced teaching processes, performance data revealed no significant improvement in overall student assessment outcomes.<n>The study raises consequential design questions regarding how AI tools can be engineered to minimise dependency, metacognitive development, and calibrate support across varying ability levels.
arXiv Detail & Related papers (2025-12-13T12:26:25Z) - Learning to Code with Context: A Study-Based Approach [0.28675177318965045]
The rapid emergence of generative AI tools is transforming the way software is developed.<n>Project-based courses offer an effective environment to explore and evaluate the integration of AI assistance into real-world development practices.<n>This paper presents our approach and a user study conducted within a university programming project in which students collaboratively developed computer games.
arXiv Detail & Related papers (2025-12-04T20:40:36Z) - "Can you feel the vibes?": An exploration of novice programmer engagement with vibe coding [42.82674998306379]
"vibe coding" refers to creating software via natural language prompts rather than direct code authorship.<n>This paper reports on a one-day educational hackathon investigating how novice programmers and mixed-experience teams engage with vibe coding.
arXiv Detail & Related papers (2025-12-02T13:32:23Z) - Plan More, Debug Less: Applying Metacognitive Theory to AI-Assisted Programming Education [16.757426904379212]
This study investigates the potential of metacognitive theory to inform AI-assisted programming education.<n>A hint system is designed around the metacognitive phases of planning, monitoring, and evaluation.<n>Students perceive and engage with planning hints most highly, whereas optimization hints are rarely requested.
arXiv Detail & Related papers (2025-09-03T09:38:43Z) - New Kid in the Classroom: Exploring Student Perceptions of AI Coding Assistants [0.0]
This study investigates how AI tools are shaping the experiences of novice programmers in an introductory programming course.<n>Students perceived AI tools as helpful for grasping code concepts and boosting their confidence during the initial development phase.<n>However, a noticeable difficulty emerged when students were asked to work unaided, pointing to potential overreliance and gaps in foundational knowledge transfer.
arXiv Detail & Related papers (2025-06-26T05:59:23Z) - Methodological Foundations for AI-Driven Survey Question Generation [41.94295877935867]
This paper presents a methodological framework for using generative AI in educational survey research.<n>We explore how Large Language Models can generate adaptive, context-aware survey questions.<n>We examine ethical issues such as bias, privacy, and transparency.
arXiv Detail & Related papers (2025-05-02T09:50:34Z) - Supporting Students' Reading and Cognition with AI [12.029238454394445]
We analyzed text from 124 sessions with AI tools to understand users' reading processes and cognitive engagement.<n>We propose design implications for future AI reading-support systems, including structured scaffolds for lower-level cognitive tasks.<n>We advocate for adaptive, human-in-the-loop features that allow students and instructors to tailor their reading experiences with AI.
arXiv Detail & Related papers (2025-04-07T17:51:27Z) - Assistance or Disruption? Exploring and Evaluating the Design and Trade-offs of Proactive AI Programming Support [36.082282294551405]
We introduce and evaluate Codellaborator, a design probe agent that initiates programming assistance based on editor activities and task context.<n>We find that proactive agents increase efficiency compared to prompt-only paradigm, but also incur workflow disruptions.
arXiv Detail & Related papers (2025-02-25T21:37:25Z) - Effects of a Prompt Engineering Intervention on Undergraduate Students' AI Self-Efficacy, AI Knowledge and Prompt Engineering Ability: A Mixed Methods Study [36.48421439947282]
This study designed and implemented a prompt engineering intervention at a university in Hong Kong.
It examined students' AI self-efficacy, AI knowledge, and proficiency in creating effective prompts.
arXiv Detail & Related papers (2024-07-30T15:05:24Z) - Toward enriched Cognitive Learning with XAI [44.99833362998488]
We introduce an intelligent system (CL-XAI) for Cognitive Learning which is supported by artificial intelligence (AI) tools.
The use of CL-XAI is illustrated with a game-inspired virtual use case where learners tackle problems to enhance problem-solving skills.
arXiv Detail & Related papers (2023-12-19T16:13:47Z) - Empowering Private Tutoring by Chaining Large Language Models [87.76985829144834]
This work explores the development of a full-fledged intelligent tutoring system powered by state-of-the-art large language models (LLMs)
The system is into three inter-connected core processes-interaction, reflection, and reaction.
Each process is implemented by chaining LLM-powered tools along with dynamically updated memory modules.
arXiv Detail & Related papers (2023-09-15T02:42:03Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.