Bridging Declarative, Procedural, and Conditional Metacognitive Knowledge Gap Using Deep Reinforcement Learning

• URL: http://arxiv.org/abs/2304.11739v1
• Date: Sun, 23 Apr 2023 20:07:07 GMT
• Title: Bridging Declarative, Procedural, and Conditional Metacognitive Knowledge Gap Using Deep Reinforcement Learning
• Authors: Mark Abdelshiheed, John Wesley Hostetter, Tiffany Barnes, Min Chi
• Abstract summary: In deductive domains, three metacognitive knowledge types in ascending order are declarative, procedural, and conditional learning. This work leverages Deep Reinforcement Learning (DRL) in providing adaptive metacognitive interventions to bridge the gap between the three knowledge types. Our results show that on both ITSs, DRL bridged the metacognitive knowledge gap between students and significantly improved their learning performance over their control peers.
• Score: 7.253181280137071
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: In deductive domains, three metacognitive knowledge types in ascending order are declarative, procedural, and conditional learning. This work leverages Deep Reinforcement Learning (DRL) in providing adaptive metacognitive interventions to bridge the gap between the three knowledge types and prepare students for future learning across Intelligent Tutoring Systems (ITSs). Students received these interventions that taught how and when to use a backward-chaining (BC) strategy on a logic tutor that supports a default forward-chaining strategy. Six weeks later, we trained students on a probability tutor that only supports BC without interventions. Our results show that on both ITSs, DRL bridged the metacognitive knowledge gap between students and significantly improved their learning performance over their control peers. Furthermore, the DRL policy adapted to the metacognitive development on the logic tutor across declarative, procedural, and conditional students, causing their strategic decisions to be more autonomous.

Related papers

• Adaptive Scaffolding for Cognitive Engagement in an Intelligent Tutoring System [13.249968490944243]
  The ICAP framework defines four cognitive engagement levels: Passive, Active, Constructive, and Interactive.<n>We develop and evaluate a system that adaptively scaffolds cognitive engagement by dynamically selecting worked examples in two different ICAP modes.
  arXiv  Detail & Related papers  (2026-02-07T01:51:46Z)
• From Co-Design to Metacognitive Laziness: Evaluating Generative AI in Vocational Education [0.0]
  This study examines the development and deployment of a Generative AI proof-of-concept (POC) designed to support lecturers in a vocational education setting in Singapore.<n>The POC achieved its primary operational goals: lecturers reported streamlined, reduced cognitive load, and observed improved student confidence in navigating course content.<n>Despite enhanced teaching processes, performance data revealed no significant improvement in overall student assessment outcomes.<n>The study raises consequential design questions regarding how AI tools can be engineered to minimise dependency, metacognitive development, and calibrate support across varying ability levels.
  arXiv  Detail & Related papers  (2025-12-13T12:26:25Z)
• UCO: A Multi-Turn Interactive Reinforcement Learning Method for Adaptive Teaching with Large Language Models [59.693733170193944]
  Large language models (LLMs) are shifting from answer providers to intelligent tutors in educational settings.<n>Recent reinforcement learning approaches address this limitation but face two critical challenges.<n>We propose the Unidirectional Cognitive Optimization (UCO) method to address these challenges.
  arXiv  Detail & Related papers  (2025-11-12T01:27:02Z)
• Directive, Metacognitive or a Blend of Both? A Comparison of AI-Generated Feedback Types on Student Engagement, Confidence, and Outcomes [1.8839714322633465]
  This study presents a semester-long randomised controlled trial with 329 students in an introductory design and programming course using an adaptive educational platform.<n>Participants were assigned to receive directive, metacognitive, or hybrid AI-generated feedback that blended elements of both directive and metacognitive feedback.<n>Results showed that revision behaviour differed across feedback conditions, with Hybrid prompting the most revisions compared to Directive and Metacognitive.
  arXiv  Detail & Related papers  (2025-10-22T15:31:21Z)
• ERA: Transforming VLMs into Embodied Agents via Embodied Prior Learning and Online Reinforcement Learning [73.35191368656224]
  We present textitEmbodied Reasoning Agent (ERA), a framework that integrates prior knowledge learning and online reinforcement learning.<n>ERA offers a practical path toward scalable embodied intelligence, providing methodological insights for future embodied AI systems.
  arXiv  Detail & Related papers  (2025-10-14T16:25:46Z)
• Unveiling the Learning Mind of Language Models: A Cognitive Framework and Empirical Study [50.065744358362345]
  Large language models (LLMs) have shown impressive capabilities across tasks such as mathematics, coding, and reasoning.<n>Yet their learning ability, which is crucial for adapting to dynamic environments and acquiring new knowledge, remains underexplored.
  arXiv  Detail & Related papers  (2025-06-16T13:24:50Z)
• TimeHC-RL: Temporal-aware Hierarchical Cognitive Reinforcement Learning for Enhancing LLMs' Social Intelligence [62.21106561772784]
  We introduce Temporal-aware Hierarchical Cognitive Reinforcement Learning (TimeHC-RL) for enhancing Large Language Models' social intelligence.<n> Experimental results reveal the superiority of our proposed TimeHC-RL method compared to the widely adopted System 2 RL method.<n>It gives the 7B backbone model wings, enabling it to rival the performance of advanced models like DeepSeek-R1 and OpenAI-O3.
  arXiv  Detail & Related papers  (2025-05-30T12:01:06Z)
• Enfoque Odychess: Un método dialéctico, constructivista y adaptativo para la enseñanza del ajedrez con inteligencias artificiales generativas [0.0]
  The Odychess Approach represents an effective pedagogical methodology for teaching chess.<n>The implications of this work are relevant for educators and institutions interested in adopting innovative pedagogical technologies.
  arXiv  Detail & Related papers  (2025-05-10T13:58:47Z)
• Synergizing Self-Regulation and Artificial-Intelligence Literacy Towards Future Human-AI Integrative Learning [92.34299949916134]
  Self-regulated learning (SRL) and Artificial-Intelligence (AI) literacy are becoming key competencies for successful human-AI interactive learning. This study analyzed data from 1,704 Chinese undergraduates using clustering methods to uncover four learner groups.
  arXiv  Detail & Related papers  (2025-03-31T13:41:21Z)
• Online inductive learning from answer sets for efficient reinforcement learning exploration [52.03682298194168]
  We exploit inductive learning of answer set programs to learn a set of logical rules representing an explainable approximation of the agent policy. We then perform answer set reasoning on the learned rules to guide the exploration of the learning agent at the next batch. Our methodology produces a significant boost in the discounted return achieved by the agent, even in the first batches of training.
  arXiv  Detail & Related papers  (2025-01-13T16:13:22Z)
• Chaos-based reinforcement learning with TD3 [3.04503073434724]
  Chaos-based reinforcement learning (CBRL) is a method in which the agent's internal chaotic dynamics drives exploration. This study introduced Twin Delayed Deep Deterministic Policy Gradients (TD3), which is one of the state-of-the-art deep reinforcement learning algorithms.
  arXiv  Detail & Related papers  (2024-05-15T04:47:31Z)
• RLIF: Interactive Imitation Learning as Reinforcement Learning [56.997263135104504]
  We show how off-policy reinforcement learning can enable improved performance under assumptions that are similar but potentially even more practical than those of interactive imitation learning. Our proposed method uses reinforcement learning with user intervention signals themselves as rewards. This relaxes the assumption that intervening experts in interactive imitation learning should be near-optimal and enables the algorithm to learn behaviors that improve over the potential suboptimal human expert.
  arXiv  Detail & Related papers  (2023-11-21T21:05:21Z)
• From Heuristic to Analytic: Cognitively Motivated Strategies for Coherent Physical Commonsense Reasoning [66.98861219674039]
  Heuristic-Analytic Reasoning (HAR) strategies drastically improve the coherence of rationalizations for model decisions. Our findings suggest that human-like reasoning strategies can effectively improve the coherence and reliability of PLM reasoning.
  arXiv  Detail & Related papers  (2023-10-24T19:46:04Z)
• Generative AI in the Classroom: Can Students Remain Active Learners? [23.487653534242092]
  Generative Artificial Intelligence (GAI) can be seen as a double-edged weapon in education. This article focuses on the effects on students' active learning strategies and related metacognitive skills. We present a framework for introducing pedagogical transparency in GAI-based educational applications.
  arXiv  Detail & Related papers  (2023-10-04T22:33:46Z)
• Leveraging Deep Reinforcement Learning for Metacognitive Interventions across Intelligent Tutoring Systems [7.253181280137071]
  This work compares two approaches to provide metacognitive interventions across Intelligent Tutoring Systems (ITSs) In two consecutive semesters, we conducted two classroom experiments: Exp. 1 used a classic artificial intelligence approach to classify students into different metacognitive groups and provide static interventions based on their classified groups. In Exp. 2, we leveraged Deep Reinforcement Learning (DRL) to provide adaptive interventions that consider the dynamic changes in the student's metacognitive levels.
  arXiv  Detail & Related papers  (2023-04-17T12:10:50Z)
• Mixing Backward- with Forward-Chaining for Metacognitive Skill Acquisition and Transfer [9.702049806385011]
  Students were trained on a logic tutor that supports a default forward-chaining (FC) and a backward-chaining (BC) strategy. We investigated the impact of mixing BC with FC on teaching strategy- and time-awareness for nonStrTime students.
  arXiv  Detail & Related papers  (2023-03-18T16:44:10Z)
• Implicit Offline Reinforcement Learning via Supervised Learning [83.8241505499762]
  Offline Reinforcement Learning (RL) via Supervised Learning is a simple and effective way to learn robotic skills from a dataset collected by policies of different expertise levels. We show how implicit models can leverage return information and match or outperform explicit algorithms to acquire robotic skills from fixed datasets.
  arXiv  Detail & Related papers  (2022-10-21T21:59:42Z)
• Contrastive UCB: Provably Efficient Contrastive Self-Supervised Learning in Online Reinforcement Learning [92.18524491615548]
  Contrastive self-supervised learning has been successfully integrated into the practice of (deep) reinforcement learning (RL) We study how RL can be empowered by contrastive learning in a class of Markov decision processes (MDPs) and Markov games (MGs) with low-rank transitions. Under the online setting, we propose novel upper confidence bound (UCB)-type algorithms that incorporate such a contrastive loss with online RL algorithms for MDPs or MGs.
  arXiv  Detail & Related papers  (2022-07-29T17:29:08Z)
• Rethinking Learning Dynamics in RL using Adversarial Networks [79.56118674435844]
  We present a learning mechanism for reinforcement learning of closely related skills parameterized via a skill embedding space. The main contribution of our work is to formulate an adversarial training regime for reinforcement learning with the help of entropy-regularized policy gradient formulation.
  arXiv  Detail & Related papers  (2022-01-27T19:51:09Z)
• MOLAM: A Mobile Multimodal Learning Analytics Conceptual Framework to Support Student Self-Regulated Learning [0.0]
  This chapter introduces a Mobile Multimodal Learning Analytics approach (MOLAM) I argue that the development of student Self-Regulated Learning would benefit from the adoption of this approach.
  arXiv  Detail & Related papers  (2020-12-18T18:55:33Z)
• Transfer Learning in Deep Reinforcement Learning: A Survey [64.36174156782333]
  Reinforcement learning is a learning paradigm for solving sequential decision-making problems. Recent years have witnessed remarkable progress in reinforcement learning upon the fast development of deep neural networks. transfer learning has arisen to tackle various challenges faced by reinforcement learning.
  arXiv  Detail & Related papers  (2020-09-16T18:38:54Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.