Generalisable Methods for Early Prediction in Interactive Simulations for Education

• URL: http://arxiv.org/abs/2207.01457v1
• Date: Mon, 4 Jul 2022 14:46:56 GMT
• Title: Generalisable Methods for Early Prediction in Interactive Simulations for Education
• Authors: Jade Ma\"i Cock and Mirko Marras and Christian Giang and Tanja K\"aser
• Abstract summary: Classifying students' interaction data in the simulations based on their expected performance has the potential to enable adaptive guidance. We first measure the students' conceptual understanding through their in-task performance. Then, we suggest a novel type of features that, starting from clickstream data, encodes both the state of the simulation and the action performed by the student.
• Score: 5.725477071353353
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Interactive simulations allow students to discover the underlying principles of a scientific phenomenon through their own exploration. Unfortunately, students often struggle to learn effectively in these environments. Classifying students' interaction data in the simulations based on their expected performance has the potential to enable adaptive guidance and consequently improve students' learning. Previous research in this field has mainly focused on a-posteriori analyses or investigations limited to one specific predictive model and simulation. In this paper, we investigate the quality and generalisability of models for an early prediction of conceptual understanding based on clickstream data of students across interactive simulations. We first measure the students' conceptual understanding through their in-task performance. Then, we suggest a novel type of features that, starting from clickstream data, encodes both the state of the simulation and the action performed by the student. We finally propose to feed these features into GRU-based models, with and without attention, for prediction. Experiments on two different simulations and with two different populations show that our proposed models outperform shallow learning baselines and better generalise to different learning environments and populations. The inclusion of attention into the model increases interpretability in terms of effective inquiry. The source code is available on Github (https://github.com/epfl-ml4ed/beerslaw-lab.git).

Related papers

• Classroom Simulacra: Building Contextual Student Generative Agents in Online Education for Learning Behavioral Simulation [10.209326669619273]
  We run a 6-week education workshop from N = 60 students to collect fine-grained data using a custom built online education system. We propose a transferable iterative reflection (TIR) module that augments both prompting-based and finetuning-based large language models.
  arXiv  Detail & Related papers  (2025-02-04T23:42:52Z)
• Accurate Multi-Category Student Performance Forecasting at Early Stages of Online Education Using Neural Networks [2.195766695109612]
  This study introduces a novel neural network-based approach capable of accurately predicting student performance. The proposed model predicts outcomes in Distinction, Fail, Pass, and Withdrawn categories. The results indicate that the prediction accuracy of the proposed method is about 25% more than the existing state-of-the-art.
  arXiv  Detail & Related papers  (2024-12-08T13:37:30Z)
• Toward In-Context Teaching: Adapting Examples to Students' Misconceptions [54.82965010592045]
  We introduce a suite of models and evaluation methods we call AdapT. AToM is a new probabilistic model for adaptive teaching that jointly infers students' past beliefs and optimize for the correctness of future beliefs. Our results highlight both the difficulty of the adaptive teaching task and the potential of learned adaptive models for solving it.
  arXiv  Detail & Related papers  (2024-05-07T17:05:27Z)
• EduAgent: Generative Student Agents in Learning [15.215078619481732]
  Student simulation in online education is important to address dynamic learning behaviors of students with diverse backgrounds. Existing simulation models based on deep learning usually need massive training data, lacking prior knowledge in educational contexts. This work proposes EduAgent, a novel generative agent framework incorporating cognitive prior knowledge.
  arXiv  Detail & Related papers  (2024-03-23T18:19:17Z)
• Leveraging generative artificial intelligence to simulate student learning behavior [13.171768256928509]
  We explore the feasibility of using large language models (LLMs) to simulate student learning behaviors. Unlike conventional machine learning based prediction, we leverage LLMs to instantiate virtual students with specific demographics. Our objective is not merely to predict learning outcomes but to replicate learning behaviors and patterns of real students.
  arXiv  Detail & Related papers  (2023-10-30T00:09:59Z)
• Modeling Student Performance in Game-Based Learning Environments [0.0]
  This study investigates game-based learning in the context of the educational game "Jo Wilder and the Capitol Case" The research aims to identify the features most predictive of student performance and correct question answering.
  arXiv  Detail & Related papers  (2023-09-23T16:53:07Z)
• User Behavior Simulation with Large Language Model based Agents [116.74368915420065]
  We propose an LLM-based agent framework and design a sandbox environment to simulate real user behaviors. Based on extensive experiments, we find that the simulated behaviors of our method are very close to the ones of real humans.
  arXiv  Detail & Related papers  (2023-06-05T02:58:35Z)
• Predictive Experience Replay for Continual Visual Control and Forecasting [62.06183102362871]
  We present a new continual learning approach for visual dynamics modeling and explore its efficacy in visual control and forecasting. We first propose the mixture world model that learns task-specific dynamics priors with a mixture of Gaussians, and then introduce a new training strategy to overcome catastrophic forgetting. Our model remarkably outperforms the naive combinations of existing continual learning and visual RL algorithms on DeepMind Control and Meta-World benchmarks with continual visual control tasks.
  arXiv  Detail & Related papers  (2023-03-12T05:08:03Z)
• Leveraging Demonstrations with Latent Space Priors [90.56502305574665]
  We propose to leverage demonstration datasets by combining skill learning and sequence modeling. We show how to acquire such priors from state-only motion capture demonstrations and explore several methods for integrating them into policy learning. Our experimental results confirm that latent space priors provide significant gains in learning speed and final performance in a set of challenging sparse-reward environments.
  arXiv  Detail & Related papers  (2022-10-26T13:08:46Z)
• A Graph-Enhanced Click Model for Web Search [67.27218481132185]
  We propose a novel graph-enhanced click model (GraphCM) for web search. We exploit both intra-session and inter-session information for the sparsity and cold-start problems.
  arXiv  Detail & Related papers  (2022-06-17T08:32:43Z)
• Towards Open-World Feature Extrapolation: An Inductive Graph Learning Approach [80.8446673089281]
  We propose a new learning paradigm with graph representation and learning. Our framework contains two modules: 1) a backbone network (e.g., feedforward neural nets) as a lower model takes features as input and outputs predicted labels; 2) a graph neural network as an upper model learns to extrapolate embeddings for new features via message passing over a feature-data graph built from observed data.
  arXiv  Detail & Related papers  (2021-10-09T09:02:45Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.