Students' Perception Accuracy of Partners' AI Use and its Relation to Collaboration Performance
- URL: http://arxiv.org/abs/2606.23237v1
- Date: Mon, 22 Jun 2026 12:23:41 GMT
- Title: Students' Perception Accuracy of Partners' AI Use and its Relation to Collaboration Performance
- Abstract summary: Generative AI tools, now widely used by undergraduate students, have introduced a consequential and largely invisible new dimension into collaboration: each student's use of AI.<n>We conducted a three-wave longitudinal study of 103 student pairs in an introductory software engineering course.<n>We found that greater misalignment between partners' beliefs about each other's AI use early in the project was associated with lower final project scores.
- Score: 12.900130585480523
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Collaborative assignments are a cornerstone of programming education. Effective collaboration during a programming project depends on the formation of reasonably accurate beliefs about how each partner works. Generative AI tools, now widely used by undergraduate students, have introduced a consequential and largely invisible new dimension into collaboration: each student's use of AI. When partners collaborate remotely, they interpret partners' ability and effort through their code. This raises the question of how accurately students perceive each other's AI use in collaborations, and if a misalignment in these perceptions relates to team performance. To address this question, we conducted a three-wave longitudinal study of 103 student pairs in an introductory software engineering course. We found that greater misalignment between partners' beliefs about each other's AI use early in the project was associated with lower final project scores. The effect of such misaligned perceptions is the strongest in teams with lower prior programming performance, suggesting that low performing students pay a higher cost of misaligned perceptions. The perception misalignment does not consistently decrease through face-to-face pair-programming sessions. This suggests that ways to foster transparency may be needed to support student teams in collaborative programming.
Related papers
- Framing, Judging, Steering: An Assessable Competency Model for Teach-ing Students to Reason With Generative AI [47.027290803102666]
We propose CoRe-3 (Co-Reasoning), a competency model factoring productive AI use into three assessable skills.<n>We ground the skills in theory, state five testable propositions, and instantiate them in CoReasoningLab.<n>Human-rater agreement and outcomes are next; we release the instrument, data, and protocol.
arXiv Detail & Related papers (2026-06-04T10:25:31Z) - Unpacking Vibe Coding: Help-Seeking Processes in Student-AI Interactions While Programming [1.3802799822705387]
Generative AI is reshaping higher education programming through vibe coding, where students collaborate with AI via natural language.<n>We analyze 19,418 interaction turns from 110 undergraduate students to compare top- and low-performing students.<n>Results reveal that top performers engaged in instrumental help-seeking, eliciting tutor-like AI responses.
arXiv Detail & Related papers (2026-04-29T19:35:10Z) - "Can you feel the vibes?": An exploration of novice programmer engagement with vibe coding [42.82674998306379]
"vibe coding" refers to creating software via natural language prompts rather than direct code authorship.<n>This paper reports on a one-day educational hackathon investigating how novice programmers and mixed-experience teams engage with vibe coding.
arXiv Detail & Related papers (2025-12-02T13:32:23Z) - Improving Question Embeddings with Cognitive Representation Optimization for Knowledge Tracing [77.14348157016518]
Research on KT modeling focuses on predicting future student performance based on existing, unupdated records of student learning interactions.<n>We propose a knowledge-tracking cognitive representation optimization (CRO-KT) model that uses dynamic programming algorithms to optimize the structure of cognitive representation.
arXiv Detail & Related papers (2025-04-05T09:32:03Z) - On the Mistaken Assumption of Interchangeable Deep Reinforcement Learning Implementations [58.60617136236957]
Deep Reinforcement Learning (DRL) is a paradigm of artificial intelligence where an agent uses a neural network to learn which actions to take in a given environment.<n>DRL has recently gained traction from being able to solve complex environments like driving simulators, 3D robotic control, and multiplayer-online-battle-arena video games.<n>Numerous implementations of the state-of-the-art algorithms responsible for training these agents, like the Deep Q-Network (DQN) and Proximal Policy Optimization (PPO) algorithms, currently exist.
arXiv Detail & Related papers (2025-03-28T16:25:06Z) - Gender Influence on Student Teams' Online Communication in Software Engineering Education [8.65285948382426]
This study examines an eight-week project involving 39 SE students across eight teams contributing to GitHub projects.<n>Using a mixed-methods approach, we analysed Slack communications to identify gender differences.<n>We found higher help-seeking and leadership behaviours in the all-woman team, while men responded more slowly.
arXiv Detail & Related papers (2025-02-20T15:43:54Z) - Code Collaborate: Dissecting Team Dynamics in First-Semester Programming Students [3.0294711465150006]
The study highlights the collaboration trends that emerge as first-semester students develop a 2D game project.
Results indicate that students often slightly overestimate their contributions, with more engaged individuals more likely to acknowledge mistakes.
Team performance shows no significant variation based on nationality or gender composition, though teams that disbanded frequently consisted of lone wolves.
arXiv Detail & Related papers (2024-10-28T11:42:05Z) - Giving Feedback on Interactive Student Programs with Meta-Exploration [74.5597783609281]
Developing interactive software, such as websites or games, is a particularly engaging way to learn computer science.
Standard approaches require instructors to manually grade student-implemented interactive programs.
Online platforms that serve millions, like Code.org, are unable to provide any feedback on assignments for implementing interactive programs.
arXiv Detail & Related papers (2022-11-16T10:00:23Z) - The Impact of Remote Pair Programming in an Upper-Level CS Course [0.0]
Pair programming has been highlighted as an active learning technique with several benefits to students.
This work analyzes the effect of pair programming in an upper-level computer science course.
arXiv Detail & Related papers (2022-04-06T20:01:01Z) - Enforcing Consistency in Weakly Supervised Semantic Parsing [68.2211621631765]
We explore the use of consistency between the output programs for related inputs to reduce the impact of spurious programs.
We find that a more consistent formalism leads to improved model performance even without consistency-based training.
arXiv Detail & Related papers (2021-07-13T03:48:04Z) - Distributed Deep Learning in Open Collaborations [49.240611132653456]
We propose a novel algorithmic framework designed specifically for collaborative training.
We demonstrate the effectiveness of our approach for SwAV and ALBERT pretraining in realistic conditions and achieve performance comparable to traditional setups at a fraction of the cost.
arXiv Detail & Related papers (2021-06-18T16:23:13Z) - Who does what? Work division and allocation strategies of computer
science student teams [5.863264019032882]
The aim of this research is to gain insight into the work division and allocation strategies applied by computer science students during group assignments.
Motivated primarily by grade and efficiency factors, students choose and allocate tasks based on their prior expertise and preferences.
Based on our findings, we argue that the setup of group assignments can limit student motivation for practicing new software engineering skills.
arXiv Detail & Related papers (2021-03-04T12:27:07Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.