Cross-Institutional Transfer Learning for Educational Models: Implications for Model Performance, Fairness, and Equity

• URL: http://arxiv.org/abs/2305.00927v1
• Date: Mon, 1 May 2023 16:27:49 GMT
• Title: Cross-Institutional Transfer Learning for Educational Models: Implications for Model Performance, Fairness, and Equity
• Abstract summary: This study investigates cross-institutional learning via an empirical case study in higher education. We examine the feasibility of cross-institutional transfer under real-world data- and model-sharing constraints. We find no evidence of a fairness-accuracy tradeoff across dozens of models and transfer schemes evaluated.
• Score: 8.762925492954777
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Modern machine learning increasingly supports paradigms that are multi-institutional (using data from multiple institutions during training) or cross-institutional (using models from multiple institutions for inference), but the empirical effects of these paradigms are not well understood. This study investigates cross-institutional learning via an empirical case study in higher education. We propose a framework and metrics for assessing the utility and fairness of student dropout prediction models that are transferred across institutions. We examine the feasibility of cross-institutional transfer under real-world data- and model-sharing constraints, quantifying model biases for intersectional student identities, characterizing potential disparate impact due to these biases, and investigating the impact of various cross-institutional ensembling approaches on fairness and overall model performance. We perform this analysis on data representing over 200,000 enrolled students annually from four universities without sharing training data between institutions. We find that a simple zero-shot cross-institutional transfer procedure can achieve similar performance to locally-trained models for all institutions in our study, without sacrificing model fairness. We also find that stacked ensembling provides no additional benefits to overall performance or fairness compared to either a local model or the zero-shot transfer procedure we tested. We find no evidence of a fairness-accuracy tradeoff across dozens of models and transfer schemes evaluated. Our auditing procedure also highlights the importance of intersectional fairness analysis, revealing performance disparities at the intersection of sensitive identity groups that are concealed under one-dimensional analysis.

Related papers

• Fairness Audits of Institutional Risk Models in Deployed ML Pipelines [17.015521443271115]
  We present a replica-based audit of a deployed Early Warning System (EWS) using institutional training data and design specifications.<n>We evaluate disparities by gender, age, and residency status across the full pipeline.<n>Post-processing amplifies these disparities by collapsing heterogeneous probabilities into percentile-based risk tiers.
  arXiv  Detail & Related papers  (2026-04-21T13:50:43Z)
• Learning Fair Representations with Kolmogorov-Arnold Networks [0.08594140167290099]
  Predictive models often exhibit discriminatory behavior towards marginalized groups.<n>Existing fair learning models aim to mitigate bias, but achieving an optimal trade-off between fairness and accuracy remains a challenge.<n>We propose integrating Kolmogorov-Arnold Networks (KANs) within a fair adversarial learning framework.
  arXiv  Detail & Related papers  (2025-11-14T07:51:56Z)
• Provable Sample-Efficient Transfer Learning Conditional Diffusion Models via Representation Learning [27.7568230759712]
  We take the first step towards understanding the sample efficiency of transfer learning conditional diffusion models through the lens of representation learning. Our analysis shows that with a well-learned representation from source tasks, the samplecomplexity of target tasks can be reduced substantially.
  arXiv  Detail & Related papers  (2025-02-06T20:39:03Z)
• Towards Fair and Privacy-Aware Transfer Learning for Educational Predictive Modeling: A Case Study on Retention Prediction in Community Colleges [1.2801418445966537]
  This paper examines transfer learning strategies for retention prediction at U.S. two-year community colleges. We identify performance and fairness degradation when external models are deployed locally without adaptation. For developers under privacy regulations, sequential training selecting institutions based on demographic similarities enhances fairness without compromising performance.
  arXiv  Detail & Related papers  (2025-01-12T19:49:28Z)
• Cross-Modal Few-Shot Learning: a Generative Transfer Learning Framework [58.362064122489166]
  This paper introduces the Cross-modal Few-Shot Learning task, which aims to recognize instances from multiple modalities when only a few labeled examples are available. We propose a Generative Transfer Learning framework consisting of two stages: the first involves training on abundant unimodal data, and the second focuses on transfer learning to adapt to novel data. Our finds demonstrate that GTL has superior performance compared to state-of-the-art methods across four distinct multi-modal datasets.
  arXiv  Detail & Related papers  (2024-10-14T16:09:38Z)
• Data vs. Model Machine Learning Fairness Testing: An Empirical Study [23.535630175567146]
  We take the first steps towards evaluating a more holistic approach by testing for fairness both before and after model training. We evaluate the effectiveness of the proposed approach using an empirical analysis of the relationship between model dependent and independent fairness metrics. Our results indicate that testing for fairness prior to training can be a cheap'' and effective means of catching a biased data collection process early.
  arXiv  Detail & Related papers  (2024-01-15T14:14:16Z)
• Federated Learning with Projected Trajectory Regularization [65.6266768678291]
  Federated learning enables joint training of machine learning models from distributed clients without sharing their local data. One key challenge in federated learning is to handle non-identically distributed data across the clients. We propose a novel federated learning framework with projected trajectory regularization (FedPTR) for tackling the data issue.
  arXiv  Detail & Related papers  (2023-12-22T02:12:08Z)
• DualFair: Fair Representation Learning at Both Group and Individual Levels via Contrastive Self-supervision [73.80009454050858]
  This work presents a self-supervised model, called DualFair, that can debias sensitive attributes like gender and race from learned representations. Our model jointly optimize for two fairness criteria - group fairness and counterfactual fairness.
  arXiv  Detail & Related papers  (2023-03-15T07:13:54Z)
• Multi-Layer Personalized Federated Learning for Mitigating Biases in Student Predictive Analytics [8.642174401125263]
  We propose a Multi-Layer Personalized Federated Learning (MLPFL) methodology to optimize inference accuracy over different layers of student grouping criteria. In our approach, personalized models for individual student subgroups are derived from a global model. Experiments on three real-world online course datasets show significant improvements achieved by our approach over existing student modeling benchmarks.
  arXiv  Detail & Related papers  (2022-12-05T17:27:28Z)
• Mitigating Biases in Student Performance Prediction via Attention-Based Personalized Federated Learning [7.040747348755578]
  Traditional learning-based approaches to student modeling generalize poorly to underrepresented student groups due to biases in data availability. We propose a methodology for predicting student performance from their online learning activities that optimize inference accuracy over different demographic groups such as race and gender.
  arXiv  Detail & Related papers  (2022-08-02T00:22:20Z)
• DRFLM: Distributionally Robust Federated Learning with Inter-client Noise via Local Mixup [58.894901088797376]
  federated learning has emerged as a promising approach for training a global model using data from multiple organizations without leaking their raw data. We propose a general framework to solve the above two challenges simultaneously. We provide comprehensive theoretical analysis including robustness analysis, convergence analysis, and generalization ability.
  arXiv  Detail & Related papers  (2022-04-16T08:08:29Z)
• Fairness in Federated Learning for Spatial-Temporal Applications [9.333236221677046]
  Federated learning involves training statistical models over remote devices such as mobile phones. We discuss the current metrics and approaches that are available to measure and evaluate fairness in the context of spatial-temporal models. We propose how these metrics and approaches can be re-defined to address the challenges that are faced in the federated learning setting.
  arXiv  Detail & Related papers  (2022-01-17T19:23:15Z)
• FairIF: Boosting Fairness in Deep Learning via Influence Functions with Validation Set Sensitive Attributes [51.02407217197623]
  We propose a two-stage training algorithm named FAIRIF. It minimizes the loss over the reweighted data set where the sample weights are computed. We show that FAIRIF yields models with better fairness-utility trade-offs against various types of bias.
  arXiv  Detail & Related papers  (2022-01-15T05:14:48Z)
• Self-Supervised Models are Continual Learners [79.70541692930108]
  We show that self-supervised loss functions can be seamlessly converted into distillation mechanisms for Continual Learning. We devise a framework for Continual self-supervised visual representation Learning that significantly improves the quality of the learned representations.
  arXiv  Detail & Related papers  (2021-12-08T10:39:13Z)
• Auditing Fairness and Imputation Impact in Predictive Analytics for Higher Education [0.0]
  There are two major barriers to the adoption of predictive analytics in higher education. The lack of democratization in deployment and the potential to exacerbate inequalities are cited.
  arXiv  Detail & Related papers  (2021-09-13T05:08:40Z)
• Learning Diverse Representations for Fast Adaptation to Distribution Shift [78.83747601814669]
  We present a method for learning multiple models, incorporating an objective that pressures each to learn a distinct way to solve the task. We demonstrate our framework's ability to facilitate rapid adaptation to distribution shift.
  arXiv  Detail & Related papers  (2020-06-12T12:23:50Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.