Understanding Gaming the System by Analyzing Self-Regulated Learning in Think-Aloud Protocols

• URL: http://arxiv.org/abs/2601.04487v1
• Date: Thu, 08 Jan 2026 01:45:56 GMT
• Title: Understanding Gaming the System by Analyzing Self-Regulated Learning in Think-Aloud Protocols
• Authors: Jiayi Zhang, Conrad Borchers, Canwen Wang, Vishal Kumar, Leah Teffera, Bruce M. McLaren, Ryan S. Baker,
• Abstract summary: This study explores whether students are cognitively disengaged or whether they engage in different self-regulated learning strategies when gaming largely unanswered.<n>We found that gaming does not simply reflect a lack of cognitive effort; during gaming, students often produced longer utterances.<n>With this understanding, future work can address gaming and its negative impacts by designing systems that target maladaptive self-regulation to promote better learning.
• Score: 8.578186551478067
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In digital learning systems, gaming the system refers to occasions when students attempt to succeed in an educational task by systematically taking advantage of system features rather than engaging meaningfully with the content. Often viewed as a form of behavioral disengagement, gaming the system is negatively associated with short- and long-term learning outcomes. However, little research has explored this phenomenon beyond its behavioral representation, leaving questions such as whether students are cognitively disengaged or whether they engage in different self-regulated learning (SRL) strategies when gaming largely unanswered. This study employs a mixed-methods approach to examine students' cognitive engagement and SRL processes during gaming versus non-gaming periods, using utterance length and SRL codes inferred from think-aloud protocols collected while students interacted with an intelligent tutoring system for chemistry. We found that gaming does not simply reflect a lack of cognitive effort; during gaming, students often produced longer utterances, were more likely to engage in processing information and realizing errors, but less likely to engage in planning, and exhibited reactive rather than proactive self-regulatory strategies. These findings provide empirical evidence supporting the interpretation that gaming may represent a maladaptive form of SRL. With this understanding, future work can address gaming and its negative impacts by designing systems that target maladaptive self-regulation to promote better learning.

Related papers

• How Far Are LLMs from Professional Poker Players? Revisiting Game-Theoretic Reasoning with Agentic Tool Use [52.394999779049606]
  Large Language Models (LLMs) are increasingly applied in high-stakes domains.<n>LLMs fail to compete against traditional algorithms.<n>We propose ToolPoker, a tool-integrated reasoning framework.
  arXiv  Detail & Related papers  (2026-01-31T05:45:25Z)
• Let Me Try Again: Examining Replay Behavior by Tracing Students' Latent Problem-Solving Pathways [4.802354861089266]
  Students' problem-solving pathways in game-based learning environments reflect conceptual understanding, procedural knowledge, and flexibility.<n>Replay behaviors, in particular, may indicate productive struggle or broader exploration, which in turn foster deeper learning.<n>This study addresses these gaps using Markov Chains and Hidden Markov Models on log data from 777 seventh graders playing the game-based learning platform of From Here to There!
  arXiv  Detail & Related papers  (2026-01-03T00:17:03Z)
• KnowRL: Exploring Knowledgeable Reinforcement Learning for Factuality [66.89190766278183]
  Large Language Models (LLMs) often exhibit severe hallucination, outputting incorrect content due to an inability to accurately recognize knowledge boundaries during reasoning.<n>We propose Knowledge-enhanced RL, KnowRL, to address the high hallucination in slow-thinking models.<n>KnowRL guides models to perform fact-based slow thinking by integrating a factuality reward, based on knowledge verification, into the RL training process.
  arXiv  Detail & Related papers  (2025-06-24T17:17:17Z)
• Playpen: An Environment for Exploring Learning Through Conversational Interaction [84.0413820245725]
  We investigate whether Dialogue Games can also serve as a source of feedback signals for learning.<n>We introduce Playpen, an environment for off- and online learning through Dialogue Game self-play.<n>We find that imitation learning through SFT improves performance on unseen instances, but negatively impacts other skills.
  arXiv  Detail & Related papers  (2025-04-11T14:49:33Z)
• Capturing the Complexity of Human Strategic Decision-Making with Machine Learning [4.308322597847064]
  We conduct the largest study to date of strategic decision-making in the context of initial play in two-player matrix games. We show that a deep neural network trained on these data predicts people's choices better than leading theories of strategic behavior.
  arXiv  Detail & Related papers  (2024-08-15T00:39:42Z)
• Empowering Private Tutoring by Chaining Large Language Models [87.76985829144834]
  This work explores the development of a full-fledged intelligent tutoring system powered by state-of-the-art large language models (LLMs) The system is into three inter-connected core processes-interaction, reflection, and reaction. Each process is implemented by chaining LLM-powered tools along with dynamically updated memory modules.
  arXiv  Detail & Related papers  (2023-09-15T02:42:03Z)
• Visualizing Self-Regulated Learner Profiles in Dashboards: Design Insights from Teachers [9.227158301570787]
  We design and implement FlippED, a dashboard for monitoring students' self-regulated learning (SRL) behavior. We evaluate the usability and actionability of the tool in semi-structured interviews with ten university teachers.
  arXiv  Detail & Related papers  (2023-05-26T12:03:11Z)
• Combining Gamification and Intelligent Tutoring Systems in a Serious Game for Engineering Education [2.792030485253753]
  We provide ongoing results from the development of a personalized learning system integrated into a serious game. Using computational intelligence, the system adaptively provides support to students based on data collected from both their in-game actions and by estimating their emotional state from webcam images. We demonstrate the system's educational efficacy through pre-post-test results from students who played the game with and without the personalized learning system.
  arXiv  Detail & Related papers  (2023-05-26T01:24:19Z)
• Bridging Declarative, Procedural, and Conditional Metacognitive Knowledge Gap Using Deep Reinforcement Learning [7.253181280137071]
  In deductive domains, three metacognitive knowledge types in ascending order are declarative, procedural, and conditional learning. This work leverages Deep Reinforcement Learning (DRL) in providing adaptive metacognitive interventions to bridge the gap between the three knowledge types. Our results show that on both ITSs, DRL bridged the metacognitive knowledge gap between students and significantly improved their learning performance over their control peers.
  arXiv  Detail & Related papers  (2023-04-23T20:07:07Z)
• Active Reinforcement Learning -- A Roadmap Towards Curious Classifier Systems for Self-Adaptation [0.456877715768796]
  Article aims to set up a research agenda towards what we call "active reinforcement learning" in intelligent systems. Traditional approaches separate the learning problem and make isolated use of techniques from different field of machine learning.
  arXiv  Detail & Related papers  (2022-01-11T13:50:26Z)
• Disturbing Reinforcement Learning Agents with Corrupted Rewards [62.997667081978825]
  We analyze the effects of different attack strategies based on reward perturbations on reinforcement learning algorithms. We show that smoothly crafting adversarial rewards are able to mislead the learner, and that using low exploration probability values, the policy learned is more robust to corrupt rewards.
  arXiv  Detail & Related papers  (2021-02-12T15:53:48Z)
• Bridging the Imitation Gap by Adaptive Insubordination [88.35564081175642]
  We show that when the teaching agent makes decisions with access to privileged information, this information is marginalized during imitation learning. We propose 'Adaptive Insubordination' (ADVISOR) to address this gap. ADVISOR dynamically weights imitation and reward-based reinforcement learning losses during training, enabling on-the-fly switching between imitation and exploration.
  arXiv  Detail & Related papers  (2020-07-23T17:59:57Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.