PeerGPT: Probing the Roles of LLM-based Peer Agents as Team Moderators and Participants in Children's Collaborative Learning

• URL: http://arxiv.org/abs/2403.14227v1
• Date: Thu, 21 Mar 2024 08:37:15 GMT
• Title: PeerGPT: Probing the Roles of LLM-based Peer Agents as Team Moderators and Participants in Children's Collaborative Learning
• Authors: Jiawen Liu, Yuanyuan Yao, Pengcheng An, Qi Wang,
• Abstract summary: In children's collaborative learning, effective peer conversations can significantly enhance the quality of children's interactions. This study explores the integration of Large Language Model (LLM) agents into this setting, assessing impacts as team moderators and participants.
• Score: 10.315455451709026
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: In children's collaborative learning, effective peer conversations can significantly enhance the quality of children's collaborative interactions. The integration of Large Language Model (LLM) agents into this setting explores their novel role as peers, assessing impacts as team moderators and participants. We invited two groups of participants to engage in a collaborative learning workshop, where they discussed and proposed conceptual solutions to a design problem. The peer conversation transcripts were analyzed using thematic analysis. We discovered that peer agents, while managing discussions effectively as team moderators, sometimes have their instructions disregarded. As participants, they foster children's creative thinking but may not consistently provide timely feedback. These findings highlight potential design improvements and considerations for peer agents in both roles.

Related papers

• Exploring Teachers' Perspectives on Using Conversational AI Agents for Group Collaboration [3.581544399830961]
  This paper presents findings from an exploratory qualitative study with 33 K12 teachers.<n>We examine how teachers perceived the agent's behavior, its influence on group dynamics, and its classroom potential.<n>While many appreciated Phoenix's capacity to stimulate engagement, they also expressed concerns around autonomy, trust, anthropomorphism, and pedagogical alignment.
  arXiv  Detail & Related papers  (2026-02-06T19:29:13Z)
• Evaluating the Effectiveness of Large Language Models in Solving Simple Programming Tasks: A User-Centered Study [1.0467092641687232]
  This study investigates how different interaction styles with ChatGPT-4o affect user performance on simple programming tasks.<n>I conducted a within-subjects experiment where fifteen high school students completed three problems under three distinct versions of the model.
  arXiv  Detail & Related papers  (2025-07-05T13:52:31Z)
• Playpen: An Environment for Exploring Learning Through Conversational Interaction [81.67330926729015]
  We investigate whether Dialogue Games can also serve as a source of feedback signals for learning.<n>We introduce Playpen, an environment for off- and online learning through Dialogue Game self-play.<n>We find that imitation learning through SFT improves performance on unseen instances, but negatively impacts other skills.
  arXiv  Detail & Related papers  (2025-04-11T14:49:33Z)
• Assessing Teamwork Dynamics in Software Development Projects [2.823770863747379]
  This study investigates teamwork dynamics in student software development projects through a mixed-method approach. We analyzed individual contributions across six project phases, comparing self-reported and actual contributions to measure discrepancies. Findings reveal that teams with minimal contribution discrepancies achieved higher project grades and exam pass rates.
  arXiv  Detail & Related papers  (2025-01-21T08:23:46Z)
• Interactive Dialogue Agents via Reinforcement Learning on Hindsight Regenerations [58.65755268815283]
  Many real dialogues are interactive, meaning an agent's utterances will influence their conversational partner, elicit information, or change their opinion. We use this fact to rewrite and augment existing suboptimal data, and train via offline reinforcement learning (RL) an agent that outperforms both prompting and learning from unaltered human demonstrations. Our results in a user study with real humans show that our approach greatly outperforms existing state-of-the-art dialogue agents.
  arXiv  Detail & Related papers  (2024-11-07T21:37:51Z)
• Mutual Theory of Mind in Human-AI Collaboration: An Empirical Study with LLM-driven AI Agents in a Real-time Shared Workspace Task [56.92961847155029]
  Theory of Mind (ToM) significantly impacts human collaboration and communication as a crucial capability to understand others. Mutual Theory of Mind (MToM) arises when AI agents with ToM capability collaborate with humans. We find that the agent's ToM capability does not significantly impact team performance but enhances human understanding of the agent.
  arXiv  Detail & Related papers  (2024-09-13T13:19:48Z)
• "My Grade is Wrong!": A Contestable AI Framework for Interactive Feedback in Evaluating Student Essays [6.810086342993699]
  This paper introduces CAELF, a Contestable AI Empowered LLM Framework for automating interactive feedback. CAELF allows students to query, challenge, and clarify their feedback by integrating a multi-agent system with computational argumentation. A case study on 500 critical thinking essays with user studies demonstrates that CAELF significantly improves interactive feedback.
  arXiv  Detail & Related papers  (2024-09-11T17:59:01Z)
• AgentPeerTalk: Empowering Students through Agentic-AI-Driven Discernment of Bullying and Joking in Peer Interactions in Schools [0.0]
  This study examined the potential of large language models (LLMs) to empower students by discerning between bullying and joking in school peer interactions. ChatGPT-4 excelled in context-specific accuracy after implementing the agentic approach.
  arXiv  Detail & Related papers  (2024-07-27T05:50:02Z)
• Investigation of the effectiveness of applying ChatGPT in Dialogic Teaching Using Electroencephalography [6.34494999013996]
  Large language models (LLMs) possess the capability to interpret knowledge, answer questions, and consider context. This research recruited 34 undergraduate students as participants, who were randomly divided into two groups. The experimental group engaged in dialogic teaching using ChatGPT, while the control group interacted with human teachers.
  arXiv  Detail & Related papers  (2024-03-25T12:23:12Z)
• SAIE Framework: Support Alone Isn't Enough -- Advancing LLM Training with Adversarial Remarks [47.609417223514605]
  This work introduces the SAIE framework, which facilitates supportive and adversarial discussions between learner and partner models. Our empirical evaluation shows that models fine-tuned with the SAIE framework outperform those trained with conventional fine-tuning approaches.
  arXiv  Detail & Related papers  (2023-11-14T12:12:25Z)
• Building Cooperative Embodied Agents Modularly with Large Language Models [104.57849816689559]
  We address challenging multi-agent cooperation problems with decentralized control, raw sensory observations, costly communication, and multi-objective tasks instantiated in various embodied environments. We harness the commonsense knowledge, reasoning ability, language comprehension, and text generation prowess of LLMs and seamlessly incorporate them into a cognitive-inspired modular framework. Our experiments on C-WAH and TDW-MAT demonstrate that CoELA driven by GPT-4 can surpass strong planning-based methods and exhibit emergent effective communication.
  arXiv  Detail & Related papers  (2023-07-05T17:59:27Z)
• "You might think about slightly revising the title": identifying hedges in peer-tutoring interactions [1.0466434989449724]
  Hedges play an important role in the management of conversational interaction. We use a multimodal peer-tutoring dataset to construct a computational framework for identifying hedges. We employ a model explainability tool to explore the features that characterize hedges in peer-tutoring conversations.
  arXiv  Detail & Related papers  (2023-06-18T12:47:54Z)
• Exploring the Efficacy of ChatGPT in Analyzing Student Teamwork Feedback with an Existing Taxonomy [0.0]
  ChatGPT can achieve over 90% accuracy in labeling student comments. This study contributes to the growing body of research on the use of AI models in educational contexts.
  arXiv  Detail & Related papers  (2023-05-09T19:55:50Z)
• Computational Language Acquisition with Theory of Mind [84.2267302901888]
  We build language-learning agents equipped with Theory of Mind (ToM) and measure its effects on the learning process. We find that training speakers with a highly weighted ToM listener component leads to performance gains in our image referential game setting.
  arXiv  Detail & Related papers  (2023-03-02T18:59:46Z)
• On Emergent Communication in Competitive Multi-Agent Teams [116.95067289206919]
  We investigate whether competition for performance from an external, similar agent team could act as a social influence. Our results show that an external competitive influence leads to improved accuracy and generalization, as well as faster emergence of communicative languages.
  arXiv  Detail & Related papers  (2020-03-04T01:14:27Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.