Pensieve Discuss: Scalable Small-Group CS Tutoring System with AI

• URL: http://arxiv.org/abs/2407.17007v1
• Date: Wed, 24 Jul 2024 05:07:53 GMT
• Title: Pensieve Discuss: Scalable Small-Group CS Tutoring System with AI
• Authors: Yoonseok Yang, Jack Liu, J. D. Zamfirescu-Pereira, John DeNero,
• Abstract summary: Pensieve Discuss is a software platform that integrates synchronous editing for scaffolded programming problems with online human and AI tutors. Our semester-long deployment to 800 students in a CS1 course demonstrated consistently high collaboration rates.
• Score: 5.710205207397618
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Small-group tutoring in Computer Science (CS) is effective, but presents the challenge of providing a dedicated tutor for each group and encouraging collaboration among group members at scale. We present Pensieve Discuss, a software platform that integrates synchronous editing for scaffolded programming problems with online human and AI tutors, designed to improve student collaboration and experience during group tutoring sessions. Our semester-long deployment to 800 students in a CS1 course demonstrated consistently high collaboration rates, positive feedback about the AI tutor's helpfulness and correctness, increased satisfaction with the group tutoring experience, and a substantial increase in question volume. The use of our system was preferred over an interface lacking AI tutors and synchronous editing capabilities. Our experiences suggest that small-group tutoring sessions are an important avenue for future research in educational AI.

Related papers

• Code Collaborate: Dissecting Team Dynamics in First-Semester Programming Students [3.0294711465150006]
  The study highlights the collaboration trends that emerge as first-semester students develop a 2D game project. Results indicate that students often slightly overestimate their contributions, with more engaged individuals more likely to acknowledge mistakes. Team performance shows no significant variation based on nationality or gender composition, though teams that disbanded frequently consisted of lone wolves.
  arXiv  Detail & Related papers  (2024-10-28T11:42:05Z)
• The Impact of Group Discussion and Formation on Student Performance: An Experience Report in a Large CS1 Course [10.04958142789079]
  The impact of group discussion and formation mechanisms on student performance remains unclear. We employed both random and expertise-balanced grouping methods to examine the efficacy of different group mechanisms. Our analysis revealed that different grouping methods did not significantly influence discussion engagement or poor-performing students' improvement.
  arXiv  Detail & Related papers  (2024-08-26T20:07:44Z)
• Desirable Characteristics for AI Teaching Assistants in Programming Education [2.9131215715703385]
  Digital teaching assistants have emerged as an appealing and scalable way to provide instant, equitable, round-the-clock support. Our results highlight that students value such tools for their ability to provide instant, engaging support. They also expressed a strong preference for features that enable them to retain autonomy in their learning journey.
  arXiv  Detail & Related papers  (2024-05-23T05:03:49Z)
• MathDial: A Dialogue Tutoring Dataset with Rich Pedagogical Properties Grounded in Math Reasoning Problems [74.73881579517055]
  We propose a framework to generate such dialogues by pairing human teachers with a Large Language Model prompted to represent common student errors. We describe how we use this framework to collect MathDial, a dataset of 3k one-to-one teacher-student tutoring dialogues.
  arXiv  Detail & Related papers  (2023-05-23T21:44:56Z)
• Human Decision Makings on Curriculum Reinforcement Learning with Difficulty Adjustment [52.07473934146584]
  We guide the curriculum reinforcement learning results towards a preferred performance level that is neither too hard nor too easy via learning from the human decision process. Our system is highly parallelizable, making it possible for a human to train large-scale reinforcement learning applications. It shows reinforcement learning performance can successfully adjust in sync with the human desired difficulty level.
  arXiv  Detail & Related papers  (2022-08-04T23:53:51Z)
• The Impact of Remote Pair Programming in an Upper-Level CS Course [0.0]
  Pair programming has been highlighted as an active learning technique with several benefits to students. This work analyzes the effect of pair programming in an upper-level computer science course.
  arXiv  Detail & Related papers  (2022-04-06T20:01:01Z)
• Teachable Reinforcement Learning via Advice Distillation [161.43457947665073]
  We propose a new supervision paradigm for interactive learning based on "teachable" decision-making systems that learn from structured advice provided by an external teacher. We show that agents that learn from advice can acquire new skills with significantly less human supervision than standard reinforcement learning algorithms.
  arXiv  Detail & Related papers  (2022-03-19T03:22:57Z)
• Disadvantaged students increase their academic performance through collective intelligence exposure in emergency remote learning due to COVID 19 [105.54048699217668]
  During the COVID-19 crisis, educational institutions worldwide shifted from face-to-face instruction to emergency remote teaching (ERT) modalities. We analyzed data on 7,528 undergraduate students and found that cooperative and consensus dynamics among students in discussion forums positively affect their final GPA. Using natural language processing, we show that first-year students with low academic performance during high school are exposed to more content-intensive posts in discussion forums.
  arXiv  Detail & Related papers  (2022-03-10T20:23:38Z)
• Distributed Deep Learning in Open Collaborations [49.240611132653456]
  We propose a novel algorithmic framework designed specifically for collaborative training. We demonstrate the effectiveness of our approach for SwAV and ALBERT pretraining in realistic conditions and achieve performance comparable to traditional setups at a fraction of the cost.
  arXiv  Detail & Related papers  (2021-06-18T16:23:13Z)
• Towards Explainable Student Group Collaboration Assessment Models Using Temporal Representations of Individual Student Roles [12.945344702592557]
  We propose using simple temporal-CNN deep-learning models to assess student group collaboration. We check the applicability of dynamically changing feature representations for student group collaboration assessment. We also use Grad-CAM visualizations to better understand and interpret the important temporal indices that led to the deep-learning model's decision.
  arXiv  Detail & Related papers  (2021-06-17T16:00:08Z)
• Towards an AI assistant for human grid operators [59.535699822923]
  Power systems are becoming more complex to operate in the digital age. Real-time decision-making is getting more challenging as the human operator has to deal with more information. There is a great need for rethinking the human-machine interface under more unified and interactive frameworks.
  arXiv  Detail & Related papers  (2020-12-03T16:12:58Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.