RECIPE4U: Student-ChatGPT Interaction Dataset in EFL Writing Education

• URL: http://arxiv.org/abs/2403.08272v1
• Date: Wed, 13 Mar 2024 05:51:57 GMT
• Title: RECIPE4U: Student-ChatGPT Interaction Dataset in EFL Writing Education
• Abstract summary: We present RECIPE4U, a dataset sourced from a semester-long experiment with 212 college students in English as Foreign Language (EFL) writing courses. During the study, students engaged in dialogues with ChatGPT to revise their essays. RECIPE4U includes comprehensive records of these interactions, including conversation logs, students' intent, students' self-rated satisfaction, and students' essay edit histories.
• Score: 15.253081304714101
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: The integration of generative AI in education is expanding, yet empirical analyses of large-scale and real-world interactions between students and AI systems still remain limited. Addressing this gap, we present RECIPE4U (RECIPE for University), a dataset sourced from a semester-long experiment with 212 college students in English as Foreign Language (EFL) writing courses. During the study, students engaged in dialogues with ChatGPT to revise their essays. RECIPE4U includes comprehensive records of these interactions, including conversation logs, students' intent, students' self-rated satisfaction, and students' essay edit histories. In particular, we annotate the students' utterances in RECIPE4U with 13 intention labels based on our coding schemes. We establish baseline results for two subtasks in task-oriented dialogue systems within educational contexts: intent detection and satisfaction estimation. As a foundational step, we explore student-ChatGPT interaction patterns through RECIPE4U and analyze them by focusing on students' dialogue, essay data statistics, and students' essay edits. We further illustrate potential applications of RECIPE4U dataset for enhancing the incorporation of LLMs in educational frameworks. RECIPE4U is publicly available at https://zeunie.github.io/RECIPE4U/.

Related papers

• PeerMathDial: A Middle School Dialogue Dataset for Student Collaborative Math Problem Solving [10.652842345233559]
  Collaborative Problem Solving (CPS) is a core skill in education, where the process of peer interaction is highly important.<n>PeerMathDial is the first dataset of peer CPS dialogues collected from authentic middle school math classrooms.<n>It contains 55 dialogues from 27 students, totaling 6,406 turns.<n>Using the dataset and the dialogue act taxonomy, we demonstrate the practical applications of PeerMathDial across three use cases.
  arXiv  Detail & Related papers  (2026-06-19T15:55:18Z)
• Your Students Don't Use LLMs Like You Wish They Did [8.643506838321354]
  We introduce six computational metrics for automated evaluation of pedagogical alignment in student-AI dialogue.<n>We validate our metrics through analysis of 12,650 messages across 500 conversations from four courses.<n>Our metrics will enable researchers building educational dialogue systems to measure whether they are achieving their pedagogical goals.
  arXiv  Detail & Related papers  (2026-04-26T01:23:21Z)
• From Words to Wisdom: Discourse Annotation and Baseline Models for Student Dialogue Understanding [5.459797813771498]
  This work introduces an annotated educational dialogue dataset of student conversations featuring knowledge construction and task production discourse.<n>We also establish baseline models for automatically predicting these discourse properties for each turn of talk within conversations, using pre-trained large language models GPT-3.5 and Llama-3.1.<n> Experimental results indicate that these state-of-the-art models perform suboptimally on this task, indicating the potential for future research.
  arXiv  Detail & Related papers  (2025-11-25T17:46:00Z)
• IntrEx: A Dataset for Modeling Engagement in Educational Conversations [7.526860155587907]
  IntrEx is the first large dataset annotated for interestingness and expected interestingness in teacher-student interactions.<n>We employ a rigorous annotation process with over 100 second-language learners.<n>We investigate whether large language models (LLMs) can predict human interestingness judgments.
  arXiv  Detail & Related papers  (2025-09-08T13:07:35Z)
• The StudyChat Dataset: Student Dialogues With ChatGPT in an Artificial Intelligence Course [2.1485350418225244]
  textbfStudyChat is a publicly available dataset capturing real-world student interactions with an LLM-powered tutor. We deploy a web application that replicates ChatGPT's core functionalities, and use it to log student interactions with the LLM. We analyze these interactions, highlight behavioral trends, and analyze how specific usage patterns relate to course outcomes.
  arXiv  Detail & Related papers  (2025-03-11T00:17:07Z)
• REALTALK: A 21-Day Real-World Dataset for Long-Term Conversation [51.97224538045096]
  We introduce REALTALK, a 21-day corpus of authentic messaging app dialogues. We compare EI attributes and persona consistency to understand the challenges posed by real-world dialogues. Our findings reveal that models struggle to simulate a user solely from dialogue history, while fine-tuning on specific user chats improves persona emulation.
  arXiv  Detail & Related papers  (2025-02-18T20:29:01Z)
• INTERACT: Enabling Interactive, Question-Driven Learning in Large Language Models [15.825663946923289]
  Large language models (LLMs) excel at answering questions but remain passive learners--absorbing static data without the ability to question and refine knowledge. This paper explores how LLMs can transition to interactive, question-driven learning through student-teacher dialogues.
  arXiv  Detail & Related papers  (2024-12-16T02:28:53Z)
• Exploring Knowledge Tracing in Tutor-Student Dialogues [53.52699766206808]
  We present a first attempt at performing knowledge tracing (KT) in tutor-student dialogues. We propose methods to identify the knowledge components/skills involved in each dialogue turn. We then apply a range of KT methods on the resulting labeled data to track student knowledge levels over an entire dialogue.
  arXiv  Detail & Related papers  (2024-09-24T22:31:39Z)
• GPT-4 as a Homework Tutor can Improve Student Engagement and Learning Outcomes [80.60912258178045]
  We developed a prompting strategy that enables GPT-4 to conduct interactive homework sessions for high-school students learning English as a second language. We carried out a Randomized Controlled Trial (RCT) in four high-school classes, replacing traditional homework with GPT-4 homework sessions for the treatment group. We observed significant improvements in learning outcomes, specifically a greater gain in grammar, and student engagement.
  arXiv  Detail & Related papers  (2024-09-24T11:22:55Z)
• StuGPTViz: A Visual Analytics Approach to Understand Student-ChatGPT Interactions [35.927734064685886]
  We present a visual analytics system, StuGPTViz, that tracks and compares temporal patterns in student prompts and the quality of ChatGPT's responses at multiple scales. The results confirmed StuGPTViz's capacity to enhance educators' insights into the pedagogical value of ChatGPT.
  arXiv  Detail & Related papers  (2024-07-17T09:20:44Z)
• Generating Situated Reflection Triggers about Alternative Solution Paths: A Case Study of Generative AI for Computer-Supported Collaborative Learning [3.2721068185888127]
  We present a proof-of-concept application to offer students dynamic and contextualized feedback. Specifically, we augment an Online Programming Exercise bot for a college-level Cloud Computing course with ChatGPT. We demonstrate that LLMs can be used to generate highly situated reflection triggers that incorporate details of the collaborative discussion happening in context.
  arXiv  Detail & Related papers  (2024-04-28T17:56:14Z)
• Learning From Free-Text Human Feedback -- Collect New Datasets Or Extend Existing Ones? [57.16050211534735]
  We investigate the types and frequency of free-text human feedback in commonly used dialog datasets. Our findings provide new insights into the composition of the datasets examined, including error types, user response types, and the relations between them.
  arXiv  Detail & Related papers  (2023-10-24T12:01:11Z)
• ChEDDAR: Student-ChatGPT Dialogue in EFL Writing Education [14.524728335166703]
  The integration of generative AI in education is expanding, yet empirical analyses of large-scale, real-world interactions between students and AI systems remain limited. This study collects a semester-long longitudinal experiment involving 212 college students enrolled in English as Foreign Langauge (EFL) writing courses. ChEDDAR includes a conversation log, utterance-level essay edit history, self-rated satisfaction, and students' intent, in addition to session-level pre-and-post surveys documenting their objectives and overall experiences.
  arXiv  Detail & Related papers  (2023-09-23T03:28:25Z)
• Cue-CoT: Chain-of-thought Prompting for Responding to In-depth Dialogue Questions with LLMs [59.74002011562726]
  We propose a novel linguistic cue-based chain-of-thoughts (textitCue-CoT) to provide a more personalized and engaging response. We build a benchmark with in-depth dialogue questions, consisting of 6 datasets in both Chinese and English. Empirical results demonstrate our proposed textitCue-CoT method outperforms standard prompting methods in terms of both textithelpfulness and textitacceptability on all datasets.
  arXiv  Detail & Related papers  (2023-05-19T16:27:43Z)
• Analysis of Individual Conversational Volatility in Tandem Telecollaboration for Second Language Learning [7.767962338247332]
  Students are grouped into video conference calls while learning the native language of other student(s) on the calls. This places students in an online environment where the more outgoing can actively contribute and engage in dialogue. We have built and deployed the L2L system which records timings of conversational utterances from all participants in a call. We present an analysis of conversational volatility measures for a sample of 19 individual English-speaking students from our University who are learning Frenchm, in each of 86 tandem telecollaboration calls over one teaching semester.
  arXiv  Detail & Related papers  (2022-06-28T12:34:00Z)
• KETOD: Knowledge-Enriched Task-Oriented Dialogue [77.59814785157877]
  Existing studies in dialogue system research mostly treat task-oriented dialogue and chit-chat as separate domains. We investigate how task-oriented dialogue and knowledge-grounded chit-chat can be effectively integrated into a single model.
  arXiv  Detail & Related papers  (2022-05-11T16:01:03Z)
• UniDU: Towards A Unified Generative Dialogue Understanding Framework [62.8474841241855]
  We investigate a unified generative dialogue understanding framework, namely UniDU, to achieve information exchange among DU tasks. We conduct experiments on ten dialogue understanding datasets, which span five fundamental tasks. The proposed UniDU framework outperforms task-specific well-designed methods on all 5 tasks.
  arXiv  Detail & Related papers  (2022-04-10T09:32:34Z)
• Structural Pre-training for Dialogue Comprehension [51.215629336320305]
  We present SPIDER, Structural Pre-traIned DialoguE Reader, to capture dialogue exclusive features. To simulate the dialogue-like features, we propose two training objectives in addition to the original LM objectives. Experimental results on widely used dialogue benchmarks verify the effectiveness of the newly introduced self-supervised tasks.
  arXiv  Detail & Related papers  (2021-05-23T15:16:54Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.