Learner and Instructor Needs in AI-Supported Programming Learning Tools: Design Implications for Features and Adaptive Control

• URL: http://arxiv.org/abs/2503.00144v1
• Date: Fri, 28 Feb 2025 19:50:10 GMT
• Title: Learner and Instructor Needs in AI-Supported Programming Learning Tools: Design Implications for Features and Adaptive Control
• Authors: Zihan Wu, Yicheng Tang, Barbara Ericson,
• Abstract summary: We conducted a participatory design study with 15 undergraduate novice programmers and 10 instructors to gather insights on desired help features and control preferences.<n>Our findings show that learners prefer help that is encouraging, incorporates visual aids, and includes peer-related insights.<n>Our work contributes to the human-centered design of AI-supported learning environments by informing the development of systems that effectively balance autonomy and guidance.
• Score: 0.5524892698654027
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: AI-supported tools can help learners overcome challenges in programming education by providing adaptive assistance. However, existing research often focuses on individual tools rather than deriving broader design recommendations. A key challenge in designing these systems is balancing learner control with system-driven guidance. To explore user preferences for AI-supported programming learning tools, we conducted a participatory design study with 15 undergraduate novice programmers and 10 instructors to gather insights on their desired help features and control preferences, as well as a follow-up survey with 172 introductory programming students. Our qualitative findings show that learners prefer help that is encouraging, incorporates visual aids, and includes peer-related insights, whereas instructors prioritize scaffolding that reflects learners' progress and reinforces best practices. Both groups favor shared control, though learners generally prefer more autonomy, while instructors lean toward greater system guidance to prevent cognitive overload. Additionally, our interviews revealed individual differences in control preferences. Based on our findings, we propose design guidelines for AI-supported programming tools, particularly regarding user-centered help features and adaptive control mechanisms. Our work contributes to the human-centered design of AI-supported learning environments by informing the development of systems that effectively balance autonomy and guidance, enhancing AI-supported educational tools for programming and beyond.

Related papers

• Design of AI-Powered Tool for Self-Regulation Support in Programming Education [4.171227316909729]
  Large Language Model (LLM) tools have demonstrated their potential to deliver high-quality assistance. However, many of these tools operate independently from institutional Learning Management Systems. This isolation limits the ability to leverage learning materials and exercise context for generating tailored, context-aware feedback.
  arXiv  Detail & Related papers  (2025-04-03T22:47:33Z)
• Sakshm AI: Advancing AI-Assisted Coding Education for Engineering Students in India Through Socratic Tutoring and Comprehensive Feedback [1.9841192743072902]
  Existing AI tools for programming education struggle with key challenges, including the lack of Socratic guidance. This study examines 1170 registered participants, analyzing platform logs, engagement trends, and problem-solving behavior to assess Sakshm AI's impact.
  arXiv  Detail & Related papers  (2025-03-16T12:13:29Z)
• LLM-powered Multi-agent Framework for Goal-oriented Learning in Intelligent Tutoring System [54.71619734800526]
  GenMentor is a multi-agent framework designed to deliver goal-oriented, personalized learning within ITS.<n>It maps learners' goals to required skills using a fine-tuned LLM trained on a custom goal-to-skill dataset.<n>GenMentor tailors learning content with an exploration-drafting-integration mechanism to align with individual learner needs.
  arXiv  Detail & Related papers  (2025-01-27T03:29:44Z)
• Intelligent Tutors for Adult Learners: An Analysis of Needs and Challenges [0.4916390772672078]
  This work examines the sociotechnical factors that influence the adoption and usage of intelligent tutoring systems in self-directed learning contexts.<n>We present Apprentice Tutors, a novel intelligent tutoring system designed to address the unique needs of adult learners.
  arXiv  Detail & Related papers  (2024-11-19T19:05:04Z)
• Personalised Feedback Framework for Online Education Programmes Using Generative AI [0.0]
  This paper presents an alternative feedback framework which extends the capabilities of ChatGPT by integrating embeddings. As part of the study, we proposed and developed a proof of concept solution, achieving an efficacy rate of 90% and 100% for open-ended and multiple-choice questions.
  arXiv  Detail & Related papers  (2024-10-14T22:35:40Z)
• Towards Educator-Driven Tutor Authoring: Generative AI Approaches for Creating Intelligent Tutor Interfaces [0.31873871499564926]
  We introduce generative AI capabilities to assist educators in creating tutor interfaces. Our approach leverages Large Language Models (LLMs) and prompt engineering to generate tutor layout and contents. A small-scale comparison shows the potential of our approach to enhance the efficiency of tutor interface design.
  arXiv  Detail & Related papers  (2024-05-23T15:46:10Z)
• Charting a Path to Efficient Onboarding: The Role of Software Visualization [49.1574468325115]
  The present study aims to explore the familiarity of managers, leaders, and developers with software visualization tools. This approach incorporated quantitative and qualitative analyses of data collected from practitioners using questionnaires and semi-structured interviews.
  arXiv  Detail & Related papers  (2024-01-17T21:30:45Z)
• Artificial Intelligence-Enabled Intelligent Assistant for Personalized and Adaptive Learning in Higher Education [0.2812395851874055]
  This paper presents a novel framework, Artificial Intelligence-Enabled Intelligent Assistant (AIIA) for personalized and adaptive learning in higher education. The AIIA system leverages advanced AI and Natural Language Processing (NLP) techniques to create an interactive and engaging learning platform.
  arXiv  Detail & Related papers  (2023-09-19T19:31:15Z)
• Empowering Private Tutoring by Chaining Large Language Models [87.76985829144834]
  This work explores the development of a full-fledged intelligent tutoring system powered by state-of-the-art large language models (LLMs) The system is into three inter-connected core processes-interaction, reflection, and reaction. Each process is implemented by chaining LLM-powered tools along with dynamically updated memory modules.
  arXiv  Detail & Related papers  (2023-09-15T02:42:03Z)
• Tool Learning with Foundation Models [158.8640687353623]
  With the advent of foundation models, AI systems have the potential to be equally adept in tool use as humans. Despite its immense potential, there is still a lack of a comprehensive understanding of key challenges, opportunities, and future endeavors in this field.
  arXiv  Detail & Related papers  (2023-04-17T15:16:10Z)
• Learning Action Conditions from Instructional Manuals for Instruction Understanding [48.52663250368341]
  We propose a task dubbed action condition inference, and collecting a high-quality, human annotated dataset of preconditions and postconditions of actions in instructional manuals. We propose a weakly supervised approach to automatically construct large-scale training instances from online instructional manuals, and curate a densely human-annotated and validated dataset to study how well the current NLP models can infer action-condition dependencies in instruction texts.
  arXiv  Detail & Related papers  (2022-05-25T00:19:59Z)
• Teachable Reinforcement Learning via Advice Distillation [161.43457947665073]
  We propose a new supervision paradigm for interactive learning based on "teachable" decision-making systems that learn from structured advice provided by an external teacher. We show that agents that learn from advice can acquire new skills with significantly less human supervision than standard reinforcement learning algorithms.
  arXiv  Detail & Related papers  (2022-03-19T03:22:57Z)
• Self-directed Machine Learning [86.3709575146414]
  In education science, self-directed learning has been shown to be more effective than passive teacher-guided learning. We introduce the principal concept of Self-directed Machine Learning (SDML) and propose a framework for SDML. Our proposed SDML process benefits from self task selection, self data selection, self model selection, self optimization strategy selection and self evaluation metric selection.
  arXiv  Detail & Related papers  (2022-01-04T18:32:06Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.