Beyond Passive Viewing: A Pilot Study of a Hybrid Learning Platform Augmenting Video Lectures with Conversational AI

• URL: http://arxiv.org/abs/2604.15334v1
• Date: Tue, 10 Mar 2026 04:56:19 GMT
• Title: Beyond Passive Viewing: A Pilot Study of a Hybrid Learning Platform Augmenting Video Lectures with Conversational AI
• Abstract summary: Traditional video-based instruction, while cost-effective and scalable, demonstrates systematic failures in sustaining learner engagement.<n>We present a pilot study evaluating a novel hybrid learning platform that integrates real-time conversational AI tutors with traditional video lectures.
• Score: 4.500362688166346
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The exponential growth of AI education has brought millions of learners to online platforms, yet this massive scale has simultaneously exposed critical pedagogical shortcomings. Traditional video-based instruction, while cost-effective and scalable, demonstrates systematic failures in both sustaining learner engagement and facilitating the deep conceptual mastery essential for AI literacy. We present a pilot study evaluating a novel hybrid learning platform that integrates real-time conversational AI tutors with traditional video lectures. Our controlled experiment (N = 58, mean age M = 21.4, SD = 2.8) compared traditional video-based instruction with our AI-augmented video platform. This study employed a sequential within-subjects design where all participants first completed the traditional video condition followed by the AI-augmented condition, providing direct comparisons of learning outcomes. We measured learning effectiveness through immediate post-tests and delayed retention assessments (2-week delay). Results suggest improvements in learning performance: immediate post-test performance showed a large effect size (d = 1.505) with participants scoring 8.3 points higher after AI-augmented instruction (91.8 vs 83.5 out of 100, p < .001). Behavioral analytics revealed increased engagement duration (71.1% improvement with AI tutoring) in the experimental group. This pilot study provides preliminary evidence that conversational AI tutors may enhance traditional educational delivery, suggesting a potential avenue for developing scalable, adaptive learning systems.

Related papers

• A Survey on Self-Improving Test-Time Intelligence: Feedback-Driven Adapting, Learning, and Scaling at Inference [72.19201465132619]
  We present feedback-driven Test-Time Intelligence (TTI) as a unified perspective for understanding such deployment-time improvement.<n>We use this view to relate test-time adaptation, test-time learning, and test-time scaling, highlighting both their distinctions and their growing overlap in hybrid systems.<n>Our goal is to provide a coherent foundation and research roadmap for the study of self-improving AI systems at test time.
  arXiv  Detail & Related papers  (2026-09-01T11:41:39Z)
• Socrates went Nuclear: Comparing Interaction Strategies for AI systems in a Learning Context using Brain Sensing [66.03354630509942]
  This paper reports on a study where we compare three designs for user-AI interaction in a learning context.<n>Fifty study participants were tasked with learning about nuclear safety protocols.
  arXiv  Detail & Related papers  (2026-09-01T02:24:35Z)
• AI-Driven Assessment of Human Tutors: Linking Training Performance to Real-Life Practice [1.3597553728687461]
  We present an AI-driven system that assesses both open responses during training and authentic real-life tutoring.<n>We use Generative AI (Gemini-2.5-pro) to analyze transcriptions of authentic tutoring, measuring the transfer of tutor skills to real-life application.
  arXiv  Detail & Related papers  (2026-06-17T02:28:10Z)
• Regulating the AI Tutor: Intentions, Help-Seeking, and Self-Regulated Learning in Adolescent GenAI Use [2.024558551027881]
  This work-in-progress examines open-ended conversational data from 98 Grade-9 students across three German Gymnasium schools.<n>We collected pre-post domain knowledge, pre-chat learning needs, and self-reported cognitive load.<n>Although students overwhelmingly selected scaffolded support before the chat, their interactions were dominated by instrumental requests.
  arXiv  Detail & Related papers  (2026-06-07T10:47:52Z)
• Safeguarding Privacy: Privacy-Preserving Detection of Mind Wandering and Disengagement Using Federated Learning in Online Education [53.25191965774678]
  We propose a framework exploiting cross-device federated learning to address different manifestations of behavioral and cognitive disengagement during remote learning.<n>We fit video-based cognitive disengagement detection models using facial expressions and gaze features.<n>Our results show great promise for privacy-preserving educational technologies promoting learner engagement.
  arXiv  Detail & Related papers  (2026-02-10T15:40:01Z)
• AI instructional agent improves student's perceived learner control and learning outcome: empirical evidence from a randomized controlled trial [29.45751702212421]
  This study examines the impact of an AI instructional agent on students' perceived learner control and academic performance in a medium demanding course with lecturing as the main teaching strategy.<n>Students in the AI instructional agent group reported significantly higher levels of perceived learner control compared to the other groups.
  arXiv  Detail & Related papers  (2025-05-28T16:13:27Z)
• Revolutionising Distance Learning: A Comparative Study of Learning Progress with AI-Driven Tutoring [0.0]
  We present first evidence that generative AI can increase the speed of learning substantially in university students. We tested whether using the AI-powered teaching assistant Syntea affected the speed of learning of hundreds of distance learning students.
  arXiv  Detail & Related papers  (2024-02-21T12:15:58Z)
• YODA: Teacher-Student Progressive Learning for Language Models [82.0172215948963]
  This paper introduces YODA, a teacher-student progressive learning framework. It emulates the teacher-student education process to improve the efficacy of model fine-tuning. Experiments show that training LLaMA2 with data from YODA improves SFT with significant performance gain.
  arXiv  Detail & Related papers  (2024-01-28T14:32:15Z)
• Generative AI for learning: Investigating the potential of synthetic learning videos [0.6628807224384127]
  This research paper explores the utility of using AI-generated synthetic video to create viable educational content for online educational settings. We examined the impact of using AI-generated synthetic video in an online learning platform on both learners content acquisition and learning experience.
  arXiv  Detail & Related papers  (2023-04-07T12:57:42Z)
• PIVOT: Prompting for Video Continual Learning [50.80141083993668]
  We introduce PIVOT, a novel method that leverages extensive knowledge in pre-trained models from the image domain. Our experiments show that PIVOT improves state-of-the-art methods by a significant 27% on the 20-task ActivityNet setup.
  arXiv  Detail & Related papers  (2022-12-09T13:22:27Z)
• Human Decision Makings on Curriculum Reinforcement Learning with Difficulty Adjustment [52.07473934146584]
  We guide the curriculum reinforcement learning results towards a preferred performance level that is neither too hard nor too easy via learning from the human decision process. Our system is highly parallelizable, making it possible for a human to train large-scale reinforcement learning applications. It shows reinforcement learning performance can successfully adjust in sync with the human desired difficulty level.
  arXiv  Detail & Related papers  (2022-08-04T23:53:51Z)
• A New Era: Intelligent Tutoring Systems Will Transform Online Learning for Millions [41.647427931578335]
  AI-powered learning can provide millions of learners with a highly personalized, active and practical learning experience. We present the results of a comparative head-to-head study on learning outcomes for two popular online learning platforms.
  arXiv  Detail & Related papers  (2022-03-03T18:55:33Z)
• Explainable Active Learning (XAL): An Empirical Study of How Local Explanations Impact Annotator Experience [76.9910678786031]
  We propose a novel paradigm of explainable active learning (XAL), by introducing techniques from the recently surging field of explainable AI (XAI) into an Active Learning setting. Our study shows benefits of AI explanation as interfaces for machine teaching--supporting trust calibration and enabling rich forms of teaching feedback, and potential drawbacks--anchoring effect with the model judgment and cognitive workload.
  arXiv  Detail & Related papers  (2020-01-24T22:52:18Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.