Student-centric Model of Learning Management System Activity and Academic Performance: from Correlation to Causation

• URL: http://arxiv.org/abs/2210.15430v3
• Date: Thu, 30 Mar 2023 01:08:17 GMT
• Title: Student-centric Model of Learning Management System Activity and Academic Performance: from Correlation to Causation
• Authors: Varun Mandalapu, Lujie Karen Chen, Sushruta Shetty, Zhiyuan Chen, Jiaqi Gong
• Abstract summary: In recent years, there is a lot of interest in modeling students' digital traces in Learning Management System (LMS) to understand students' learning behavior patterns. This paper explores a student-centric analytical framework for LMS activity data that can provide not only correlational but causal insights mined from observational data. We envision that those insights will provide convincing evidence for college student support groups to launch student-centered and targeted interventions.
• Score: 2.169383034643496
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: In recent years, there is a lot of interest in modeling students' digital traces in Learning Management System (LMS) to understand students' learning behavior patterns including aspects of meta-cognition and self-regulation, with the ultimate goal to turn those insights into actionable information to support students to improve their learning outcomes. In achieving this goal, however, there are two main issues that need to be addressed given the existing literature. Firstly, most of the current work is course-centered (i.e. models are built from data for a specific course) rather than student-centered; secondly, a vast majority of the models are correlational rather than causal. Those issues make it challenging to identify the most promising actionable factors for intervention at the student level where most of the campus-wide academic support is designed for. In this paper, we explored a student-centric analytical framework for LMS activity data that can provide not only correlational but causal insights mined from observational data. We demonstrated this approach using a dataset of 1651 computing major students at a public university in the US during one semester in the Fall of 2019. This dataset includes students' fine-grained LMS interaction logs and administrative data, e.g. demographics and academic performance. In addition, we expand the repository of LMS behavior indicators to include those that can characterize the time-of-the-day of login (e.g. chronotype). Our analysis showed that student login volume, compared with other login behavior indicators, is both strongly correlated and causally linked to student academic performance, especially among students with low academic performance. We envision that those insights will provide convincing evidence for college student support groups to launch student-centered and targeted interventions that are effective and scalable.

Related papers

• Aggregation Artifacts in Subjective Tasks Collapse Large Language Models' Posteriors [74.04775677110179]
  In-context Learning (ICL) has become the primary method for performing natural language tasks with Large Language Models (LLMs) In this work, we examine whether this is the result of the aggregation used in corresponding datasets, where trying to combine low-agreement, disparate annotations might lead to annotation artifacts that create detrimental noise in the prompt. Our results indicate that aggregation is a confounding factor in the modeling of subjective tasks, and advocate focusing on modeling individuals instead.
  arXiv  Detail & Related papers  (2024-10-17T17:16:00Z)
• A Comparative Analysis of Student Performance Predictions in Online Courses using Heterogeneous Knowledge Graphs [0.0]
  We analyze a heterogeneous knowledge graph consisting of students, course videos, formative assessments and their interactions to predict student performance. We then compare the models generated between 5 on-campus and 2 fully-online MOOC-style instances of the same course. The model developed achieved a 70-90% accuracy of predicting whether a student would pass a particular problem set based on content consumed, course instance, and modality.
  arXiv  Detail & Related papers  (2024-05-19T03:33:59Z)
• Student Data Paradox and Curious Case of Single Student-Tutor Model: Regressive Side Effects of Training LLMs for Personalized Learning [25.90420385230675]
  The pursuit of personalized education has led to the integration of Large Language Models (LLMs) in developing intelligent tutoring systems. Our research uncovers a fundamental challenge in this approach: the Student Data Paradox'' This paradox emerges when LLMs, trained on student data to understand learner behavior, inadvertently compromise their own factual knowledge and reasoning abilities.
  arXiv  Detail & Related papers  (2024-04-23T15:57:55Z)
• Enhancing Student Performance Prediction on Learnersourced Questions with SGNN-LLM Synergy [11.735587384038753]
  We introduce an innovative strategy that synergizes the potential of integrating Signed Graph Neural Networks (SGNNs) and Large Language Model (LLM) embeddings. Our methodology employs a signed bipartite graph to comprehensively model student answers, complemented by a contrastive learning framework that enhances noise resilience.
  arXiv  Detail & Related papers  (2023-09-23T23:37:55Z)
• Responsible Active Learning via Human-in-the-loop Peer Study [88.01358655203441]
  We propose a responsible active learning method, namely Peer Study Learning (PSL), to simultaneously preserve data privacy and improve model stability. We first introduce a human-in-the-loop teacher-student architecture to isolate unlabelled data from the task learner (teacher) on the cloud-side. During training, the task learner instructs the light-weight active learner which then provides feedback on the active sampling criterion.
  arXiv  Detail & Related papers  (2022-11-24T13:18:27Z)
• A Survey of Learning on Small Data: Generalization, Optimization, and Challenge [101.27154181792567]
  Learning on small data that approximates the generalization ability of big data is one of the ultimate purposes of AI. This survey follows the active sampling theory under a PAC framework to analyze the generalization error and label complexity of learning on small data. Multiple data applications that may benefit from efficient small data representation are surveyed.
  arXiv  Detail & Related papers  (2022-07-29T02:34:19Z)
• Identifying Critical LMS Features for Predicting At-risk Students [4.718094586237028]
  Learning management systems (LMSs) have become essential in higher education. We present an additional use of LMS by using its data logs to perform data-analytics and identify academically at-risk students.
  arXiv  Detail & Related papers  (2022-04-27T22:43:45Z)
• Disadvantaged students increase their academic performance through collective intelligence exposure in emergency remote learning due to COVID 19 [105.54048699217668]
  During the COVID-19 crisis, educational institutions worldwide shifted from face-to-face instruction to emergency remote teaching (ERT) modalities. We analyzed data on 7,528 undergraduate students and found that cooperative and consensus dynamics among students in discussion forums positively affect their final GPA. Using natural language processing, we show that first-year students with low academic performance during high school are exposed to more content-intensive posts in discussion forums.
  arXiv  Detail & Related papers  (2022-03-10T20:23:38Z)
• Jointly Modeling Heterogeneous Student Behaviors and Interactions Among Multiple Prediction Tasks [35.15654921278549]
  Prediction tasks about students have practical significance for both student and college. In this paper, we focus on modeling heterogeneous behaviors and making multiple predictions together. We design three motivating behavior prediction tasks based on a real-world dataset collected from a college.
  arXiv  Detail & Related papers  (2021-03-25T02:01:58Z)
• Revealing the Hidden Patterns: A Comparative Study on Profiling Subpopulations of MOOC Students [61.58283466715385]
  Massive Open Online Courses (MOOCs) exhibit a remarkable heterogeneity of students. The advent of complex "big data" from MOOC platforms is a challenging yet rewarding opportunity to deeply understand how students are engaged in MOOCs. We report on clustering analysis of student activities and comparative analysis on both behavioral patterns and demographical patterns between student subpopulations in the MOOC.
  arXiv  Detail & Related papers  (2020-08-12T10:38:50Z)
• Social Engagement versus Learning Engagement -- An Exploratory Study of FutureLearn Learners [61.58283466715385]
  Massive Open Online Courses (MOOCs) continue to see increasing enrolment, but only a small percent of enrolees completes the MOOCs. This study is particularly concerned with how learners interact with peers, along with their study progression in MOOCs. The study was conducted on the less explored FutureLearn platform, which employs a social constructivist approach and promotes collaborative learning.
  arXiv  Detail & Related papers  (2020-08-11T16:09:10Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.