A Prescriptive Learning Analytics Framework: Beyond Predictive Modelling
and onto Explainable AI with Prescriptive Analytics and ChatGPT
- URL: http://arxiv.org/abs/2208.14582v2
- Date: Tue, 31 Jan 2023 22:20:41 GMT
- Title: A Prescriptive Learning Analytics Framework: Beyond Predictive Modelling
and onto Explainable AI with Prescriptive Analytics and ChatGPT
- Authors: Teo Susnjak
- Abstract summary: This study proposes a novel framework that unifies both transparent machine learning as well as techniques for enabling prescriptive analytics.
This work practically demonstrates the proposed framework using predictive models for identifying at-risk learners of programme non-completion.
- Score: 0.0
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: A significant body of recent research in the field of Learning Analytics has
focused on leveraging machine learning approaches for predicting at-risk
students in order to initiate timely interventions and thereby elevate
retention and completion rates. The overarching feature of the majority of
these research studies has been on the science of prediction only. The
component of predictive analytics concerned with interpreting the internals of
the models and explaining their predictions for individual cases to
stakeholders has largely been neglected. Additionally, works that attempt to
employ data-driven prescriptive analytics to automatically generate
evidence-based remedial advice for at-risk learners are in their infancy.
eXplainable AI is a field that has recently emerged providing cutting-edge
tools which support transparent predictive analytics and techniques for
generating tailored advice for at-risk students. This study proposes a novel
framework that unifies both transparent machine learning as well as techniques
for enabling prescriptive analytics, while integrating the latest advances in
large language models. This work practically demonstrates the proposed
framework using predictive models for identifying at-risk learners of programme
non-completion. The study then further demonstrates how predictive modelling
can be augmented with prescriptive analytics on two case studies in order to
generate human-readable prescriptive feedback for those who are at risk using
ChatGPT.
Related papers
- Temporal receptive field in dynamic graph learning: A comprehensive analysis [15.161255747900968]
We present a comprehensive analysis of the temporal receptive field in dynamic graph learning.
Our results demonstrate that appropriately chosen temporal receptive field can significantly enhance model performance.
For some models, overly large windows may introduce noise and reduce accuracy.
arXiv Detail & Related papers (2024-07-17T07:46:53Z) - Heterogeneous Transfer Learning for Building High-Dimensional
Generalized Linear Models with Disparate Datasets [0.0]
We describe a transfer learning approach for building high-dimensional generalized linear models.
We show that the use of adaptive-Lasso penalty leads to the oracle property of underlying parameter estimates.
We illustrate a timely application of the proposed method for the development of risk prediction models for five common diseases.
arXiv Detail & Related papers (2023-12-20T06:11:59Z) - Pre-registration for Predictive Modeling [26.112782996222617]
We explore the possibility and potential benefits of introducing pre-registration to the field of predictive modeling.
We discuss current best practices in predictive modeling and their limitations, introduce a lightweight pre-registration template, and present a qualitative study with machine learning researchers.
We conclude by exploring the scope of problems that pre-registration can address in predictive modeling and acknowledging its limitations within this context.
arXiv Detail & Related papers (2023-11-30T18:52:10Z) - ASPEST: Bridging the Gap Between Active Learning and Selective
Prediction [56.001808843574395]
Selective prediction aims to learn a reliable model that abstains from making predictions when uncertain.
Active learning aims to lower the overall labeling effort, and hence human dependence, by querying the most informative examples.
In this work, we introduce a new learning paradigm, active selective prediction, which aims to query more informative samples from the shifted target domain.
arXiv Detail & Related papers (2023-04-07T23:51:07Z) - Informing clinical assessment by contextualizing post-hoc explanations
of risk prediction models in type-2 diabetes [50.8044927215346]
We consider a comorbidity risk prediction scenario and focus on contexts regarding the patients clinical state.
We employ several state-of-the-art LLMs to present contexts around risk prediction model inferences and evaluate their acceptability.
Our paper is one of the first end-to-end analyses identifying the feasibility and benefits of contextual explanations in a real-world clinical use case.
arXiv Detail & Related papers (2023-02-11T18:07:11Z) - A review of predictive uncertainty estimation with machine learning [0.0]
We review the topic of predictive uncertainty estimation with machine learning algorithms.
We discuss the related metrics (consistent scoring functions and proper scoring rules) for assessing probabilistic predictions.
The review expedites our understanding on how to develop new algorithms tailored to users' needs.
arXiv Detail & Related papers (2022-09-17T10:36:30Z) - What Should I Know? Using Meta-gradient Descent for Predictive Feature
Discovery in a Single Stream of Experience [63.75363908696257]
computational reinforcement learning seeks to construct an agent's perception of the world through predictions of future sensations.
An open challenge in this line of work is determining from the infinitely many predictions that the agent could possibly make which predictions might best support decision-making.
We introduce a meta-gradient descent process by which an agent learns what predictions to make, 2) the estimates for its chosen predictions, and 3) how to use those estimates to generate policies that maximize future reward.
arXiv Detail & Related papers (2022-06-13T21:31:06Z) - Learning Predictions for Algorithms with Predictions [49.341241064279714]
We introduce a general design approach for algorithms that learn predictors.
We apply techniques from online learning to learn against adversarial instances, tune robustness-consistency trade-offs, and obtain new statistical guarantees.
We demonstrate the effectiveness of our approach at deriving learning algorithms by analyzing methods for bipartite matching, page migration, ski-rental, and job scheduling.
arXiv Detail & Related papers (2022-02-18T17:25:43Z) - Test-time Collective Prediction [73.74982509510961]
Multiple parties in machine learning want to jointly make predictions on future test points.
Agents wish to benefit from the collective expertise of the full set of agents, but may not be willing to release their data or model parameters.
We explore a decentralized mechanism to make collective predictions at test time, leveraging each agent's pre-trained model.
arXiv Detail & Related papers (2021-06-22T18:29:58Z) - Deep Co-Attention Network for Multi-View Subspace Learning [73.3450258002607]
We propose a deep co-attention network for multi-view subspace learning.
It aims to extract both the common information and the complementary information in an adversarial setting.
In particular, it uses a novel cross reconstruction loss and leverages the label information to guide the construction of the latent representation.
arXiv Detail & Related papers (2021-02-15T18:46:44Z) - Introduction to Rare-Event Predictive Modeling for Inferential
Statisticians -- A Hands-On Application in the Prediction of Breakthrough
Patents [0.0]
We introduce a machine learning (ML) approach to quantitative analysis geared towards optimizing the predictive performance.
We discuss the potential synergies between the two fields against the backdrop of this, at first glance, target-incompatibility.
We are providing a hands-on predictive modeling introduction for a quantitative social science audience while aiming at demystifying computer science jargon.
arXiv Detail & Related papers (2020-03-30T13:06:25Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.