AI instructional agent improves student's perceived learner control and learning outcome: empirical evidence from a randomized controlled trial

• URL: http://arxiv.org/abs/2505.22526v1
• Date: Wed, 28 May 2025 16:13:27 GMT
• Title: AI instructional agent improves student's perceived learner control and learning outcome: empirical evidence from a randomized controlled trial
• Authors: Fei Qin, Zhanxin Hao, Jifan Yu, Zhiyuan Liu, Yu Zhang,
• Abstract summary: This study examines the impact of an AI instructional agent on students' perceived learner control and academic performance in a medium demanding course with lecturing as the main teaching strategy.<n>Students in the AI instructional agent group reported significantly higher levels of perceived learner control compared to the other groups.
• Score: 29.45751702212421
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: This study examines the impact of an AI instructional agent on students' perceived learner control and academic performance in a medium demanding course with lecturing as the main teaching strategy. Based on a randomized controlled trial, three instructional conditions were compared: a traditional human teacher, a self-paced MOOC with chatbot support, and an AI instructional agent capable of delivering lectures and responding to questions in real time. Students in the AI instructional agent group reported significantly higher levels of perceived learner control compared to the other groups. They also completed the learning task more efficiently and engaged in more frequent interactions with the instructional system. Regression analyzes showed that perceived learner control positively predicted post-test performance, with behavioral indicators such as reduced learning time and higher interaction frequency supporting this relationship. These findings suggest that AI instructional agents, when designed to support personalized pace and responsive interaction, can enhance both students' learning experience and learning outcomes.

Related papers

• AI-Educational Development Loop (AI-EDL): A Conceptual Framework to Bridge AI Capabilities with Classical Educational Theories [8.500617875591633]
  This study introduces the AI-Educational Development Loop (AI-EDL), a theory-driven framework that integrates classical learning theories with human-in-the-loop artificial intelligence (AI)<n>The framework emphasizes transparency, self-regulated learning, and pedagogical oversight.
  arXiv  Detail & Related papers  (2025-08-01T15:44:19Z)
• Short-Term Gains, Long-Term Gaps: The Impact of GenAI and Search Technologies on Retention [1.534667887016089]
  This study investigates how GenAI (ChatGPT), search engines (Google), and e-textbooks influence student performance across tasks of varying cognitive complexity.<n>ChatGPT and Google groups outperformed the control group in immediate assessments for lower-order cognitive tasks.<n>While AI-driven tools facilitate immediate performance, they do not inherently reinforce long-term retention unless supported by structured learning strategies.
  arXiv  Detail & Related papers  (2025-07-10T00:44:50Z)
• ChatGPT produces more "lazy" thinkers: Evidence of cognitive engagement decline [0.0]
  This study investigates the impact of generative artificial intelligence (AI) tools on the cognitive engagement of students during academic writing tasks.<n>The results revealed significantly lower cognitive engagement scores in the ChatGPT group compared to the control group.<n>These findings suggest that AI assistance may lead to cognitive offloading.
  arXiv  Detail & Related papers  (2025-06-30T18:41:50Z)
• Alice: Proactive Learning with Teacher's Demonstrations for Weak-to-Strong Generalization [69.96794098855938]
  Weak-to-strong generalization (W2SG) offers a promising framework for supervising increasingly capable language models (LLMs)<n>Traditional W2SG methods rely on passive learning, where a weak teacher provides noisy demonstrations to train a strong student.<n>We introduce Alice, a framework that leverages complementary knowledge between teacher and student to enhance the learning process.
  arXiv  Detail & Related papers  (2025-04-09T22:33:06Z)
• Beware of Metacognitive Laziness: Effects of Generative Artificial Intelligence on Learning Motivation, Processes, and Performance [15.064064880549232]
  The concept of hybrid intelligence is still at a nascent stage.<n>How learners can benefit from a symbiotic relationship with various agents is still unknown.<n>ChatGPT may promote learners' dependence on technology and potentially trigger metacognitive laziness.
  arXiv  Detail & Related papers  (2024-12-12T14:32:39Z)
• Multi-agent cooperation through learning-aware policy gradients [53.63948041506278]
  Self-interested individuals often fail to cooperate, posing a fundamental challenge for multi-agent learning.<n>We present the first unbiased, higher-derivative-free policy gradient algorithm for learning-aware reinforcement learning.<n>We derive from the iterated prisoner's dilemma a novel explanation for how and when cooperation arises among self-interested learning-aware agents.
  arXiv  Detail & Related papers  (2024-10-24T10:48:42Z)
• YODA: Teacher-Student Progressive Learning for Language Models [82.0172215948963]
  This paper introduces YODA, a teacher-student progressive learning framework. It emulates the teacher-student education process to improve the efficacy of model fine-tuning. Experiments show that training LLaMA2 with data from YODA improves SFT with significant performance gain.
  arXiv  Detail & Related papers  (2024-01-28T14:32:15Z)
• Revealing Networks: Understanding Effective Teacher Practices in AI-Supported Classrooms using Transmodal Ordered Network Analysis [0.9187505256430948]
  The present study uses transmodal ordered network analysis to understand effective teacher practices in relationship to traditional metrics of in-system learning in a mathematics classroom working with AI tutors. Comparing teacher practices by student learning rates, we find that students with low learning rates exhibited more hint use after monitoring. Students with low learning rates showed learning behavior similar to their high learning rate peers, achieving repeated correct attempts in the tutor.
  arXiv  Detail & Related papers  (2023-12-17T21:50:02Z)
• Progressively Efficient Learning [58.6490456517954]
  We develop a novel learning framework named Communication-Efficient Interactive Learning (CEIL) CEIL leads to emergence of a human-like pattern where the learner and the teacher communicate efficiently by exchanging increasingly more abstract intentions. Agents trained with CEIL quickly master new tasks, outperforming non-hierarchical and hierarchical imitation learning by up to 50% and 20% in absolute success rate.
  arXiv  Detail & Related papers  (2023-10-13T07:52:04Z)
• Generative AI in the Classroom: Can Students Remain Active Learners? [23.487653534242092]
  Generative Artificial Intelligence (GAI) can be seen as a double-edged weapon in education. This article focuses on the effects on students' active learning strategies and related metacognitive skills. We present a framework for introducing pedagogical transparency in GAI-based educational applications.
  arXiv  Detail & Related papers  (2023-10-04T22:33:46Z)
• Empowering Private Tutoring by Chaining Large Language Models [87.76985829144834]
  This work explores the development of a full-fledged intelligent tutoring system powered by state-of-the-art large language models (LLMs) The system is into three inter-connected core processes-interaction, reflection, and reaction. Each process is implemented by chaining LLM-powered tools along with dynamically updated memory modules.
  arXiv  Detail & Related papers  (2023-09-15T02:42:03Z)
• Implementing Learning Principles with a Personal AI Tutor: A Case Study [2.94944680995069]
  This research demonstrates the ability of personal AI tutors to model human learning processes and effectively enhance academic performance. By integrating AI tutors into their programs, educators can offer students personalized learning experiences grounded in the principles of learning sciences.
  arXiv  Detail & Related papers  (2023-09-10T15:35:47Z)
• Leveraging Deep Reinforcement Learning for Metacognitive Interventions across Intelligent Tutoring Systems [7.253181280137071]
  This work compares two approaches to provide metacognitive interventions across Intelligent Tutoring Systems (ITSs) In two consecutive semesters, we conducted two classroom experiments: Exp. 1 used a classic artificial intelligence approach to classify students into different metacognitive groups and provide static interventions based on their classified groups. In Exp. 2, we leveraged Deep Reinforcement Learning (DRL) to provide adaptive interventions that consider the dynamic changes in the student's metacognitive levels.
  arXiv  Detail & Related papers  (2023-04-17T12:10:50Z)
• Distantly-Supervised Named Entity Recognition with Adaptive Teacher Learning and Fine-grained Student Ensemble [56.705249154629264]
  Self-training teacher-student frameworks are proposed to improve the robustness of NER models. In this paper, we propose an adaptive teacher learning comprised of two teacher-student networks. Fine-grained student ensemble updates each fragment of the teacher model with a temporal moving average of the corresponding fragment of the student, which enhances consistent predictions on each model fragment against noise.
  arXiv  Detail & Related papers  (2022-12-13T12:14:09Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.