A Machine Learning Approach to Assess Student Group Collaboration Using
Individual Level Behavioral Cues
- URL: http://arxiv.org/abs/2007.06667v4
- Date: Wed, 2 Sep 2020 22:09:32 GMT
- Title: A Machine Learning Approach to Assess Student Group Collaboration Using
Individual Level Behavioral Cues
- Authors: Anirudh Som, Sujeong Kim, Bladimir Lopez-Prado, Svati Dhamija, Nonye
Alozie, Amir Tamrakar
- Abstract summary: We propose using simple deep-learning-based machine learning models to automatically determine the overall collaboration quality of a group.
We come across the following challenges when building these models: 1) Limited training data, 2) Severe class label imbalance.
- Score: 8.840643644938156
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: K-12 classrooms consistently integrate collaboration as part of their
learning experiences. However, owing to large classroom sizes, teachers do not
have the time to properly assess each student and give them feedback. In this
paper we propose using simple deep-learning-based machine learning models to
automatically determine the overall collaboration quality of a group based on
annotations of individual roles and individual level behavior of all the
students in the group. We come across the following challenges when building
these models: 1) Limited training data, 2) Severe class label imbalance. We
address these challenges by using a controlled variant of Mixup data
augmentation, a method for generating additional data samples by linearly
combining different pairs of data samples and their corresponding class labels.
Additionally, the label space for our problem exhibits an ordered structure. We
take advantage of this fact and also explore using an ordinal-cross-entropy
loss function and study its effects with and without Mixup.
Related papers
- Data Similarity-Based One-Shot Clustering for Multi-Task Hierarchical Federated Learning [8.37314799155978]
We propose a one-shot clustering algorithm that can effectively identify and group users based on their data similarity.
Our proposed algorithm not only enhances the clustering process, but also overcomes challenges related to privacy concerns, communication overhead, and the need for prior knowledge about learning models or loss function behaviors.
arXiv Detail & Related papers (2024-10-03T17:51:21Z) - Federated Two Stage Decoupling With Adaptive Personalization Layers [5.69361786082969]
Federated learning has gained significant attention due to its ability to enable distributed learning while maintaining privacy constraints.
It inherently experiences significant learning degradation and slow convergence speed.
It is natural to employ the concept of clustering homogeneous clients into the same group, allowing only the model weights within each group to be aggregated.
arXiv Detail & Related papers (2023-08-30T07:46:32Z) - JEDI: Joint Expert Distillation in a Semi-Supervised Multi-Dataset
Student-Teacher Scenario for Video Action Recognition [29.67402932890899]
We propose JEDI, a multi-dataset semi-supervised learning method.
It efficiently combines knowledge from multiple experts, learned on different datasets, to train and improve the performance of individual, per dataset, student models.
arXiv Detail & Related papers (2023-08-09T13:09:07Z) - Fair and skill-diverse student group formation via constrained k-way
graph partitioning [65.29889537564455]
This work introduces an unsupervised algorithm for fair and skill-diverse student group formation.
The skill sets of students are determined using unsupervised dimensionality reduction of course mark data via the Laplacian eigenmap.
The problem is formulated as a constrained graph partitioning problem, whereby the diversity of skill sets in each group are maximised.
arXiv Detail & Related papers (2023-01-12T14:02:49Z) - Distantly-Supervised Named Entity Recognition with Adaptive Teacher
Learning and Fine-grained Student Ensemble [56.705249154629264]
Self-training teacher-student frameworks are proposed to improve the robustness of NER models.
In this paper, we propose an adaptive teacher learning comprised of two teacher-student networks.
Fine-grained student ensemble updates each fragment of the teacher model with a temporal moving average of the corresponding fragment of the student, which enhances consistent predictions on each model fragment against noise.
arXiv Detail & Related papers (2022-12-13T12:14:09Z) - Association Graph Learning for Multi-Task Classification with Category
Shifts [68.58829338426712]
We focus on multi-task classification, where related classification tasks share the same label space and are learned simultaneously.
We learn an association graph to transfer knowledge among tasks for missing classes.
Our method consistently performs better than representative baselines.
arXiv Detail & Related papers (2022-10-10T12:37:41Z) - Mitigating Biases in Student Performance Prediction via Attention-Based
Personalized Federated Learning [7.040747348755578]
Traditional learning-based approaches to student modeling generalize poorly to underrepresented student groups due to biases in data availability.
We propose a methodology for predicting student performance from their online learning activities that optimize inference accuracy over different demographic groups such as race and gender.
arXiv Detail & Related papers (2022-08-02T00:22:20Z) - Addressing Missing Sources with Adversarial Support-Matching [8.53946780558779]
We investigate a scenario in which the absence of certain data is linked to the second level of a two-level hierarchy in the data.
Inspired by the idea of protected groups from algorithmic fairness, we refer to the partitions carved by this second level as "subgroups"
We make use of an additional, diverse but unlabeled dataset, called the "deployment set", to learn a representation that is invariant to subgroup.
arXiv Detail & Related papers (2022-03-24T16:19:19Z) - Leveraging Ensembles and Self-Supervised Learning for Fully-Unsupervised
Person Re-Identification and Text Authorship Attribution [77.85461690214551]
Learning from fully-unlabeled data is challenging in Multimedia Forensics problems, such as Person Re-Identification and Text Authorship Attribution.
Recent self-supervised learning methods have shown to be effective when dealing with fully-unlabeled data in cases where the underlying classes have significant semantic differences.
We propose a strategy to tackle Person Re-Identification and Text Authorship Attribution by enabling learning from unlabeled data even when samples from different classes are not prominently diverse.
arXiv Detail & Related papers (2022-02-07T13:08:11Z) - Towards Group Robustness in the presence of Partial Group Labels [61.33713547766866]
spurious correlations between input samples and the target labels wrongly direct the neural network predictions.
We propose an algorithm that optimize for the worst-off group assignments from a constraint set.
We show improvements in the minority group's performance while preserving overall aggregate accuracy across groups.
arXiv Detail & Related papers (2022-01-10T22:04:48Z) - SLADE: A Self-Training Framework For Distance Metric Learning [75.54078592084217]
We present a self-training framework, SLADE, to improve retrieval performance by leveraging additional unlabeled data.
We first train a teacher model on the labeled data and use it to generate pseudo labels for the unlabeled data.
We then train a student model on both labels and pseudo labels to generate final feature embeddings.
arXiv Detail & Related papers (2020-11-20T08:26:10Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.