Plan More, Debug Less: Applying Metacognitive Theory to AI-Assisted Programming Education

• URL: http://arxiv.org/abs/2509.03171v1
• Date: Wed, 03 Sep 2025 09:38:43 GMT
• Title: Plan More, Debug Less: Applying Metacognitive Theory to AI-Assisted Programming Education
• Authors: Tung Phung, Heeryung Choi, Mengyan Wu, Adish Singla, Christopher Brooks,
• Abstract summary: This study investigates the potential of metacognitive theory to inform AI-assisted programming education.<n>A hint system is designed around the metacognitive phases of planning, monitoring, and evaluation.<n>Students perceive and engage with planning hints most highly, whereas optimization hints are rarely requested.
• Score: 16.757426904379212
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The growing adoption of generative AI in education highlights the need to integrate established pedagogical principles into AI-assisted learning environments. This study investigates the potential of metacognitive theory to inform AI-assisted programming education through a hint system designed around the metacognitive phases of planning, monitoring, and evaluation. Upon request, the system can provide three types of AI-generated hints--planning, debugging, and optimization--to guide students at different stages of problem-solving. Through a study with 102 students in an introductory data science programming course, we find that students perceive and engage with planning hints most highly, whereas optimization hints are rarely requested. We observe a consistent association between requesting planning hints and achieving higher grades across question difficulty and student competency. However, when facing harder tasks, students seek additional debugging but not more planning support. These insights contribute to the growing field of AI-assisted programming education by providing empirical evidence on the importance of pedagogical principles in AI-assisted learning.

Related papers

• An Experience Report on a Pedagogically Controlled, Curriculum-Constrained AI Tutor for SE Education [4.976713294177978]
  This paper presents the design and pilot evaluation of RockStartIT Tutor, an AI-powered assistant developed for a digital programming and computational thinking course within the RockStartIT initiative.<n> Powered by GPT-4 via OpenAI's Assistant API, the tutor employs a novel prompting strategy and a modular, semantically tagged knowledge base to deliver context-aware, personalized, and curriculum-constrained support for secondary school students.
  arXiv  Detail & Related papers  (2025-12-08T12:54:37Z)
• Scaffolding Metacognition in Programming Education: Understanding Student-AI Interactions and Design Implications [10.81558535566768]
  Generative AI tools such as ChatGPT now provide novice programmers with unprecedented access to instant, personalized support.<n>While this holds clear promise, their influence on students' metacognitive processes remains underexplored.<n>This study addresses that gap by analyzing student-AI interactions through a metacognitive lens in university-level programming courses.
  arXiv  Detail & Related papers  (2025-11-06T07:42:24Z)
• Beyond Statistical Learning: Exact Learning Is Essential for General Intelligence [59.07578850674114]
  Sound deductive reasoning is an indisputably desirable aspect of general intelligence.<n>It is well-documented that even the most advanced frontier systems regularly and consistently falter on easily-solvable reasoning tasks.<n>We argue that their unsound behavior is a consequence of the statistical learning approach powering their development.
  arXiv  Detail & Related papers  (2025-06-30T14:37:50Z)
• New Kid in the Classroom: Exploring Student Perceptions of AI Coding Assistants [0.0]
  The arrival of AI coding assistants in educational settings presents a paradigm shift.<n>This study addresses how these tools are shaping the experiences of novice programmers in an introductory programming course.
  arXiv  Detail & Related papers  (2025-06-26T05:59:23Z)
• Sakshm AI: Advancing AI-Assisted Coding Education for Engineering Students in India Through Socratic Tutoring and Comprehensive Feedback [1.9841192743072902]
  Existing AI tools for programming education struggle with key challenges, including the lack of Socratic guidance.<n>This study examines 1170 registered participants, analyzing platform logs, engagement trends, and problem-solving behavior to assess Sakshm AI's impact.
  arXiv  Detail & Related papers  (2025-03-16T12:13:29Z)
• Teaching Requirements Engineering for AI: A Goal-Oriented Approach in Software Engineering Courses [4.273966905160028]
  It is crucial to prepare software engineers with the abilities to specify high-quality requirements for AI-based systems. This research aims to evaluate the effectiveness and applicability of Goal-Oriented Requirements Engineering (GORE) in facilitating requirements elicitation.
  arXiv  Detail & Related papers  (2024-10-26T23:44:01Z)
• AI for non-programmers: Applied AI in the lectures for students without programming skills [0.0]
  This work presents a didactic planning script for applied AI. The didactic planning script is based on the AI application pipeline and links AI concepts with study-relevant topics. An example lecture series for master students in energy management shows how AI can be seamlessly integrated into discipline-specific lectures.
  arXiv  Detail & Related papers  (2024-02-06T17:26:24Z)
• Toward enriched Cognitive Learning with XAI [44.99833362998488]
  We introduce an intelligent system (CL-XAI) for Cognitive Learning which is supported by artificial intelligence (AI) tools. The use of CL-XAI is illustrated with a game-inspired virtual use case where learners tackle problems to enhance problem-solving skills.
  arXiv  Detail & Related papers  (2023-12-19T16:13:47Z)
• Towards Goal-oriented Intelligent Tutoring Systems in Online Education [65.17234980710386]
  We propose a new task, named Goal-oriented Intelligent Tutoring Systems (GITS)<n>GITS aims to enable the student's mastery of a designated concept by strategically planning a customized sequence of exercises and assessment.<n>We propose a novel graph-based reinforcement learning framework, named Planning-Assessment-Interaction (PAI)
  arXiv  Detail & Related papers  (2023-12-03T12:37:16Z)
• Artificial Intelligence-Enabled Intelligent Assistant for Personalized and Adaptive Learning in Higher Education [0.2812395851874055]
  This paper presents a novel framework, Artificial Intelligence-Enabled Intelligent Assistant (AIIA) for personalized and adaptive learning in higher education. The AIIA system leverages advanced AI and Natural Language Processing (NLP) techniques to create an interactive and engaging learning platform.
  arXiv  Detail & Related papers  (2023-09-19T19:31:15Z)
• Hierarchical Imitation Learning with Vector Quantized Models [77.67190661002691]
  We propose to use reinforcement learning to identify subgoals in expert trajectories. We build a vector-quantized generative model for the identified subgoals to perform subgoal-level planning. In experiments, the algorithm excels at solving complex, long-horizon decision-making problems outperforming state-of-the-art.
  arXiv  Detail & Related papers  (2023-01-30T15:04:39Z)
• Personalized Education in the AI Era: What to Expect Next? [76.37000521334585]
  The objective of personalized learning is to design an effective knowledge acquisition track that matches the learner's strengths and bypasses her weaknesses to meet her desired goal. In recent years, the boost of artificial intelligence (AI) and machine learning (ML) has unfolded novel perspectives to enhance personalized education.
  arXiv  Detail & Related papers  (2021-01-19T12:23:32Z)
• Distributed and Democratized Learning: Philosophy and Research Challenges [80.39805582015133]
  We propose a novel design philosophy called democratized learning (Dem-AI) Inspired by the societal groups of humans, the specialized groups of learning agents in the proposed Dem-AI system are self-organized in a hierarchical structure to collectively perform learning tasks more efficiently. We present a reference design as a guideline to realize future Dem-AI systems, inspired by various interdisciplinary fields.
  arXiv  Detail & Related papers  (2020-03-18T08:45:10Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.