Data Science Students Perspectives on Learning Analytics: An Application of Human-Led and LLM Content Analysis

• URL: http://arxiv.org/abs/2502.10409v1
• Date: Wed, 22 Jan 2025 17:16:01 GMT
• Title: Data Science Students Perspectives on Learning Analytics: An Application of Human-Led and LLM Content Analysis
• Authors: Raghda Zahran, Jianfei Xu, Huizhi Liang, Matthew Forshaw,
• Abstract summary: This study is part of a series of initiatives at a UK university designed to cultivate a deep understanding of students' perspectives on analytics.<n>It explores collaborative data processing undertaken by postgraduate students who examined an Open University Learning Analytics dataset.
• Score: 2.4561590439700076
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Objective This study is part of a series of initiatives at a UK university designed to cultivate a deep understanding of students' perspectives on analytics that resonate with their unique learning needs. It explores collaborative data processing undertaken by postgraduate students who examined an Open University Learning Analytics Dataset (OULAD). Methods A qualitative approach was adopted, integrating a Retrieval-Augmented Generation (RAG) and a Large Language Model (LLM) technique with human-led content analysis to gather information about students' perspectives based on their submitted work. The study involved 72 postgraduate students in 12 groups. Findings The analysis of group work revealed diverse insights into essential learning analytics from the students' perspectives. All groups adopted a structured data science methodology. The questions formulated by the groups were categorised into seven themes, reflecting their specific areas of interest. While there was variation in the selected variables to interpret correlations, a consensus was found regarding the general results. Conclusion A significant outcome of this study is that students specialising in data science exhibited a deeper understanding of learning analytics, effectively articulating their interests through inferences drawn from their analyses. While human-led content analysis provided a general understanding of students' perspectives, the LLM offered nuanced insights.

Related papers

• LLMs as Educational Analysts: Transforming Multimodal Data Traces into Actionable Reading Assessment Reports [6.523137821124204]
  This study investigates the use of multimodal data sources to derive meaningful reading insights. We employ unsupervised learning techniques to identify distinct reading behavior patterns. A large language model (LLM) synthesizes the derived information into actionable reports for educators.
  arXiv  Detail & Related papers  (2025-03-03T22:34:08Z)
• Student engagement in collaborative learning with AI agents in an LLM-empowered learning environment: A cluster analysis [28.54642275086147]
  The research involved 110 students from a university in China, who engaged with multiple LLM agents in an LLM-empowered learning environment. Data on the students' non-cognitive traits, course engagement, and AI interaction patterns were collected and analyzed. The findings underscore how different learner types engage with human-AI interactive learning and offer practical implications for the design of adaptive educational systems.
  arXiv  Detail & Related papers  (2025-03-03T16:08:28Z)
• XAI-FUNGI: Dataset resulting from the user study on comprehensibility of explainable AI algorithms [5.775094401949666]
  This paper introduces a dataset that is the result of a user study on the comprehensibility of explainable artificial intelligence (XAI) algorithms. The study participants were recruited from 149 candidates to form three groups representing experts in the domain of mycology (DE) The main part of the dataset contains 39 transcripts of interviews during which participants were asked to complete a series of tasks and questions related to the interpretation of decisions of a machine learning model trained to distinguish between edible and inedible mushrooms.
  arXiv  Detail & Related papers  (2024-10-21T11:37:58Z)
• A First Step in Using Machine Learning Methods to Enhance Interaction Analysis for Embodied Learning Environments [4.349901731099916]
  This study aims to simplify researchers' tasks, using Machine Learning and Multimodal Learning Analytics. We present an initial case study to determine the feasibility of visually representing students' states, actions, gaze, affect, and movement on a timeline. The timeline allows us to investigate the alignment of critical learning moments identified by multimodal and interaction analysis.
  arXiv  Detail & Related papers  (2024-05-10T02:40:24Z)
• Evaluating Pedagogical Incentives in Undergraduate Computing: A Mixed Methods Approach Using Learning Analytics [0.0]
  This paper assesses the impact of new pedagogical incentives implemented in a first-year undergraduate computing module at University College London. We employ a mixed methods approach, combining learning analytics with qualitative data to evaluate the effectiveness of these incentives on increasing student engagement. Our paper introduces an interpretable and actionable model for student engagement, which integrates objective, data-driven analysis with students' perspectives.
  arXiv  Detail & Related papers  (2024-03-13T16:39:38Z)
• A Literature Review of Literature Reviews in Pattern Analysis and Machine Intelligence [55.33653554387953]
  Pattern Analysis and Machine Intelligence (PAMI) has led to numerous literature reviews aimed at collecting and fragmented information.<n>This paper presents a thorough analysis of these literature reviews within the PAMI field.<n>We try to address three core research questions: (1) What are the prevalent structural and statistical characteristics of PAMI literature reviews; (2) What strategies can researchers employ to efficiently navigate the growing corpus of reviews; and (3) What are the advantages and limitations of AI-generated reviews compared to human-authored ones.
  arXiv  Detail & Related papers  (2024-02-20T11:28:50Z)
• Harnessing Transparent Learning Analytics for Individualized Support through Auto-detection of Engagement in Face-to-Face Collaborative Learning [3.0184625301151833]
  This paper proposes a transparent approach to automatically detect student's individual engagement in the process of collaboration. The proposed approach can reflect student's individual engagement and can be used as an indicator to distinguish students with different collaborative learning challenges.
  arXiv  Detail & Related papers  (2024-01-03T12:20:28Z)
• Integrating AI and Learning Analytics for Data-Driven Pedagogical Decisions and Personalized Interventions in Education [0.2812395851874055]
  This research study explores the conceptualization, development, and deployment of an innovative learning analytics tool. By analyzing critical data points such as students' stress levels, curiosity, confusion, agitation, topic preferences, and study methods, the tool provides a comprehensive view of the learning environment. This research underscores AI's role in shaping personalized, data-driven education.
  arXiv  Detail & Related papers  (2023-12-15T06:00:26Z)
• Investigating Fairness Disparities in Peer Review: A Language Model Enhanced Approach [77.61131357420201]
  We conduct a thorough and rigorous study on fairness disparities in peer review with the help of large language models (LMs) We collect, assemble, and maintain a comprehensive relational database for the International Conference on Learning Representations (ICLR) conference from 2017 to date. We postulate and study fairness disparities on multiple protective attributes of interest, including author gender, geography, author, and institutional prestige.
  arXiv  Detail & Related papers  (2022-11-07T16:19:42Z)
• Knowledge Graph Augmented Network Towards Multiview Representation Learning for Aspect-based Sentiment Analysis [96.53859361560505]
  We propose a knowledge graph augmented network (KGAN) to incorporate external knowledge with explicitly syntactic and contextual information. KGAN captures the sentiment feature representations from multiple perspectives, i.e., context-, syntax- and knowledge-based. Experiments on three popular ABSA benchmarks demonstrate the effectiveness and robustness of our KGAN.
  arXiv  Detail & Related papers  (2022-01-13T08:25:53Z)
• Personalized Education in the AI Era: What to Expect Next? [76.37000521334585]
  The objective of personalized learning is to design an effective knowledge acquisition track that matches the learner's strengths and bypasses her weaknesses to meet her desired goal. In recent years, the boost of artificial intelligence (AI) and machine learning (ML) has unfolded novel perspectives to enhance personalized education.
  arXiv  Detail & Related papers  (2021-01-19T12:23:32Z)
• Sentiment Analysis Based on Deep Learning: A Comparative Study [69.09570726777817]
  The study of public opinion can provide us with valuable information. The efficiency and accuracy of sentiment analysis is being hindered by the challenges encountered in natural language processing. This paper reviews the latest studies that have employed deep learning to solve sentiment analysis problems.
  arXiv  Detail & Related papers  (2020-06-05T16:28:10Z)
• Heterogeneous Representation Learning: A Review [66.12816399765296]
  Heterogeneous Representation Learning (HRL) brings some unique challenges. We present a unified learning framework which is able to model most existing learning settings with the heterogeneous inputs. We highlight the challenges that are less-touched in HRL and present future research directions.
  arXiv  Detail & Related papers  (2020-04-28T05:12:31Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.