Exploring Student-AI Interactions in Vibe Coding

• URL: http://arxiv.org/abs/2507.22614v1
• Date: Wed, 30 Jul 2025 12:35:20 GMT
• Title: Exploring Student-AI Interactions in Vibe Coding
• Authors: Francis Geng, Anshul Shah, Haolin Li, Nawab Mulla, Steven Swanson, Gerald Soosai Raj, Daniel Zingaro, Leo Porter,
• Abstract summary: The purpose of this study is to understand how students in introductory programming and advanced software engineering classes interact with a vibe coding platform (Replit) when creating software.<n>Interview participants were asked to think-aloud while building a web application using Replit.<n>For both groups, the majority of student interactions with Replit were to test or debug the prototype and only rarely did students visit code.
• Score: 6.086654284173657
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Background and Context. Chat-based and inline-coding-based GenAI has already had substantial impact on the CS Education community. The recent introduction of ``vibe coding'' may further transform how students program, as it introduces a new way for students to create software projects with minimal oversight. Objectives. The purpose of this study is to understand how students in introductory programming and advanced software engineering classes interact with a vibe coding platform (Replit) when creating software and how the interactions differ by programming background. Methods. Interview participants were asked to think-aloud while building a web application using Replit. Thematic analysis was then used to analyze the video recordings with an emphasis on the interactions between the student and Replit. Findings. For both groups, the majority of student interactions with Replit were to test or debug the prototype and only rarely did students visit code. Prompts by advanced software engineering students were much more likely to include relevant app feature and codebase contexts than those by introductory programming students.

Related papers

• Students' Feedback Requests and Interactions with the SCRIPT Chatbot: Do They Get What They Ask For? [0.0]
  Building on prior research on Generative AI (GenAI) and related tools for programming education, we developed SCRIPT to support novice learners.<n>SCRIPT allows for open-ended interactions and structured guidance through predefined prompts.<n>We analyzed how students interacted with SCRIPT while solving programming tasks with a focus on their feedback preferences.
  arXiv  Detail & Related papers  (2025-07-23T06:56:26Z)
• The StudyChat Dataset: Student Dialogues With ChatGPT in an Artificial Intelligence Course [2.1485350418225244]
  textbfStudyChat is a publicly available dataset capturing real-world student interactions with an LLM-powered tutor.<n>We deploy a web application that replicates ChatGPT's core functionalities, and use it to log student interactions with the LLM.<n>We analyze these interactions, highlight behavioral trends, and analyze how specific usage patterns relate to course outcomes.
  arXiv  Detail & Related papers  (2025-03-11T00:17:07Z)
• Analysis of Student-LLM Interaction in a Software Engineering Project [1.2233362977312945]
  We analyze 126 undergraduate students' interaction with an AI assistant during a 13-week semester to understand the benefits of AI for software engineering learning.<n>Our findings suggest that students prefer ChatGPT over CoPilot.<n> conversational-based interaction helps improve the quality of the code generated compared to auto-generated code.
  arXiv  Detail & Related papers  (2025-02-03T11:44:00Z)
• Learning Manipulation by Predicting Interaction [85.57297574510507]
  We propose a general pre-training pipeline that learns Manipulation by Predicting the Interaction. The experimental results demonstrate that MPI exhibits remarkable improvement by 10% to 64% compared with previous state-of-the-art in real-world robot platforms.
  arXiv  Detail & Related papers  (2024-06-01T13:28:31Z)
• Generating Situated Reflection Triggers about Alternative Solution Paths: A Case Study of Generative AI for Computer-Supported Collaborative Learning [3.2721068185888127]
  We present a proof-of-concept application to offer students dynamic and contextualized feedback. Specifically, we augment an Online Programming Exercise bot for a college-level Cloud Computing course with ChatGPT. We demonstrate that LLMs can be used to generate highly situated reflection triggers that incorporate details of the collaborative discussion happening in context.
  arXiv  Detail & Related papers  (2024-04-28T17:56:14Z)
• CLGT: A Graph Transformer for Student Performance Prediction in Collaborative Learning [6.140954034246379]
  We present an extended graph transformer framework for collaborative learning (CLGT) for evaluating and predicting the performance of students. The experimental results confirm that the proposed CLGT outperforms the baseline models in terms of performing predictions based on the real-world datasets.
  arXiv  Detail & Related papers  (2023-07-30T09:54:30Z)
• InterCode: Standardizing and Benchmarking Interactive Coding with Execution Feedback [50.725076393314964]
  We introduce InterCode, a lightweight, flexible, and easy-to-use framework of interactive coding as a standard reinforcement learning environment. Our framework is language and platform agnostic, uses self-contained Docker environments to provide safe and reproducible execution. We demonstrate InterCode's viability as a testbed by evaluating multiple state-of-the-art LLMs configured with different prompting strategies.
  arXiv  Detail & Related papers  (2023-06-26T17:59:50Z)
• A Review of Deep Learning for Video Captioning [111.1557921247882]
  Video captioning (VC) is a fast-moving, cross-disciplinary area of research. This survey covers deep learning-based VC, including but not limited to, attention-based architectures, graph networks, reinforcement learning, adversarial networks, dense video captioning (DVC)
  arXiv  Detail & Related papers  (2023-04-22T15:30:54Z)
• Giving Feedback on Interactive Student Programs with Meta-Exploration [74.5597783609281]
  Developing interactive software, such as websites or games, is a particularly engaging way to learn computer science. Standard approaches require instructors to manually grade student-implemented interactive programs. Online platforms that serve millions, like Code.org, are unable to provide any feedback on assignments for implementing interactive programs.
  arXiv  Detail & Related papers  (2022-11-16T10:00:23Z)
• ProtoTransformer: A Meta-Learning Approach to Providing Student Feedback [54.142719510638614]
  In this paper, we frame the problem of providing feedback as few-shot classification. A meta-learner adapts to give feedback to student code on a new programming question from just a few examples by instructors. Our approach was successfully deployed to deliver feedback to 16,000 student exam-solutions in a programming course offered by a tier 1 university.
  arXiv  Detail & Related papers  (2021-07-23T22:41:28Z)
• BUSTLE: Bottom-Up Program Synthesis Through Learning-Guided Exploration [72.88493072196094]
  We present a new synthesis approach that leverages learning to guide a bottom-up search over programs. In particular, we train a model to prioritize compositions of intermediate values during search conditioned on a set of input-output examples. We show that the combination of learning and bottom-up search is remarkably effective, even with simple supervised learning approaches.
  arXiv  Detail & Related papers  (2020-07-28T17:46:18Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.