Understanding Student Interaction with AI-Powered Next-Step Hints: Strategies and Challenges

• URL: http://arxiv.org/abs/2511.06362v1
• Date: Sun, 09 Nov 2025 12:56:34 GMT
• Title: Understanding Student Interaction with AI-Powered Next-Step Hints: Strategies and Challenges
• Authors: Anastasiia Birillo, Aleksei Rostovskii, Yaroslav Golubev, Hieke Keuning,
• Abstract summary: Next-step hint feedback provides students with actionable steps to progress towards solving programming tasks.<n>This study investigates how students interact with an AI-driven next-step hint system in an in-IDE learning environment.
• Score: 1.446446435461625
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Automated feedback generation plays a crucial role in enhancing personalized learning experiences in computer science education. Among different types of feedback, next-step hint feedback is particularly important, as it provides students with actionable steps to progress towards solving programming tasks. This study investigates how students interact with an AI-driven next-step hint system in an in-IDE learning environment. We gathered and analyzed a dataset from 34 students solving Kotlin tasks, containing detailed hint interaction logs. We applied process mining techniques and identified 16 common interaction scenarios. Semi-structured interviews with 6 students revealed strategies for managing unhelpful hints, such as adapting partial hints or modifying code to generate variations of the same hint. These findings, combined with our publicly available dataset, offer valuable opportunities for future research and provide key insights into student behavior, helping improve hint design for enhanced learning support.

Related papers

• Scaffolding Metacognition in Programming Education: Understanding Student-AI Interactions and Design Implications [10.81558535566768]
  Generative AI tools such as ChatGPT now provide novice programmers with unprecedented access to instant, personalized support.<n>While this holds clear promise, their influence on students' metacognitive processes remains underexplored.<n>This study addresses that gap by analyzing student-AI interactions through a metacognitive lens in university-level programming courses.
  arXiv  Detail & Related papers  (2025-11-06T07:42:24Z)
• Designing and Evaluating Hint Generation Systems for Science Education [21.96985881818661]
  We study the role of automatic hint generation as a pedagogical strategy to promote active engagement with the learning content.<n>We compare two distinct hinting strategies: static hints, pre-generated for each problem, and dynamic hints, adapted to learners' progress.
  arXiv  Detail & Related papers  (2025-10-24T02:00:16Z)
• Evaluating the Effectiveness of Large Language Models in Solving Simple Programming Tasks: A User-Centered Study [1.0467092641687232]
  This study investigates how different interaction styles with ChatGPT-4o affect user performance on simple programming tasks.<n>I conducted a within-subjects experiment where fifteen high school students completed three problems under three distinct versions of the model.
  arXiv  Detail & Related papers  (2025-07-05T13:52:31Z)
• An Empirical Study of Federated Prompt Learning for Vision Language Model [89.2963764404892]
  This paper systematically investigates the behavioral differences between language prompt learning (VPT) and vision prompt learning (VLM)<n>We evaluate the impact of various FL and prompt configurations, such as client scale, aggregation strategies, and prompt length, to assess the robustness of Federated Prompt Learning (FPL)
  arXiv  Detail & Related papers  (2025-05-29T03:09:15Z)
• Training a Generally Curious Agent [77.61142660542599]
  Paprika is a fine-tuning approach that enables language models to develop general decision-making capabilities.<n>Paprika teaches models to explore and adapt their behavior on a new task based on environment feedback in-context without more gradient updates.<n>Results suggest a promising path towards AI systems that can autonomously solve sequential decision-making problems.
  arXiv  Detail & Related papers  (2025-02-24T18:56:58Z)
• ChatGPT in Data Visualization Education: A Student Perspective [19.58123915686711]
  This work explores the impact of such technology on student learning in an interdisciplinary, project-oriented data visualization course. Students engaged with ChatGPT across four distinct projects, designing and implementing data visualizations using a variety of tools such as Tableau, D3, and Vega-lite. Our analysis examined the advantages and barriers of using ChatGPT, students' querying behavior, the types of assistance sought, and its impact on assignment outcomes and engagement.
  arXiv  Detail & Related papers  (2024-05-01T02:40:20Z)
• Generating Situated Reflection Triggers about Alternative Solution Paths: A Case Study of Generative AI for Computer-Supported Collaborative Learning [3.2721068185888127]
  We present a proof-of-concept application to offer students dynamic and contextualized feedback. Specifically, we augment an Online Programming Exercise bot for a college-level Cloud Computing course with ChatGPT. We demonstrate that LLMs can be used to generate highly situated reflection triggers that incorporate details of the collaborative discussion happening in context.
  arXiv  Detail & Related papers  (2024-04-28T17:56:14Z)
• Towards Goal-oriented Intelligent Tutoring Systems in Online Education [65.17234980710386]
  We propose a new task, named Goal-oriented Intelligent Tutoring Systems (GITS)<n>GITS aims to enable the student's mastery of a designated concept by strategically planning a customized sequence of exercises and assessment.<n>We propose a novel graph-based reinforcement learning framework, named Planning-Assessment-Interaction (PAI)
  arXiv  Detail & Related papers  (2023-12-03T12:37:16Z)
• ProtoTransformer: A Meta-Learning Approach to Providing Student Feedback [54.142719510638614]
  In this paper, we frame the problem of providing feedback as few-shot classification. A meta-learner adapts to give feedback to student code on a new programming question from just a few examples by instructors. Our approach was successfully deployed to deliver feedback to 16,000 student exam-solutions in a programming course offered by a tier 1 university.
  arXiv  Detail & Related papers  (2021-07-23T22:41:28Z)
• Visual Adversarial Imitation Learning using Variational Models [60.69745540036375]
  Reward function specification remains a major impediment for learning behaviors through deep reinforcement learning. Visual demonstrations of desired behaviors often presents an easier and more natural way to teach agents. We develop a variational model-based adversarial imitation learning algorithm.
  arXiv  Detail & Related papers  (2021-07-16T00:15:18Z)
• Learning an Effective Context-Response Matching Model with Self-Supervised Tasks for Retrieval-based Dialogues [88.73739515457116]
  We introduce four self-supervised tasks including next session prediction, utterance restoration, incoherence detection and consistency discrimination. We jointly train the PLM-based response selection model with these auxiliary tasks in a multi-task manner. Experiment results indicate that the proposed auxiliary self-supervised tasks bring significant improvement for multi-turn response selection.
  arXiv  Detail & Related papers  (2020-09-14T08:44:46Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.