ChEDDAR: Student-ChatGPT Dialogue in EFL Writing Education

• URL: http://arxiv.org/abs/2309.13243v2
• Date: Wed, 20 Mar 2024 08:16:14 GMT
• Title: ChEDDAR: Student-ChatGPT Dialogue in EFL Writing Education
• Authors: Jieun Han, Haneul Yoo, Junho Myung, Minsun Kim, Tak Yeon Lee, So-Yeon Ahn, Alice Oh,
• Abstract summary: The integration of generative AI in education is expanding, yet empirical analyses of large-scale, real-world interactions between students and AI systems remain limited. This study collects a semester-long longitudinal experiment involving 212 college students enrolled in English as Foreign Langauge (EFL) writing courses. ChEDDAR includes a conversation log, utterance-level essay edit history, self-rated satisfaction, and students' intent, in addition to session-level pre-and-post surveys documenting their objectives and overall experiences.
• Score: 14.524728335166703
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: The integration of generative AI in education is expanding, yet empirical analyses of large-scale, real-world interactions between students and AI systems still remain limited. In this study, we present ChEDDAR, ChatGPT & EFL Learner's Dialogue Dataset As Revising an essay, which is collected from a semester-long longitudinal experiment involving 212 college students enrolled in English as Foreign Langauge (EFL) writing courses. The students were asked to revise their essays through dialogues with ChatGPT. ChEDDAR includes a conversation log, utterance-level essay edit history, self-rated satisfaction, and students' intent, in addition to session-level pre-and-post surveys documenting their objectives and overall experiences. We analyze students' usage patterns and perceptions regarding generative AI with respect to their intent and satisfaction. As a foundational step, we establish baseline results for two pivotal tasks in task-oriented dialogue systems within educational contexts: intent detection and satisfaction estimation. We finally suggest further research to refine the integration of generative AI into education settings, outlining potential scenarios utilizing ChEDDAR. ChEDDAR is publicly available at https://github.com/zeunie/ChEDDAR.

Related papers

• Prompting ChatGPT for Chinese Learning as L2: A CEFR and EBCL Level Study [0.45060992929802196]
  This study explores how learners can use specific prompts to engage Large Language Models (LLM) as personalized chatbots. Our goal is to develop prompts that integrate oral and written skills, using high-frequency character lists and controlling oral lexical productions. The results indicate that incorporating level A1 and A1+ characters, along with the associated reference list, significantly enhances compliance with the EBCL character set.
  arXiv  Detail & Related papers  (2025-01-25T15:30:13Z)
• Embracing AI in Education: Understanding the Surge in Large Language Model Use by Secondary Students [53.20318273452059]
  Large language models (LLMs) like OpenAI's ChatGPT have opened up new avenues in education. Despite school restrictions, our survey of over 300 middle and high school students revealed that a remarkable 70% of students have utilized LLMs. We propose a few ideas to address such issues, including subject-specific models, personalized learning, and AI classrooms.
  arXiv  Detail & Related papers  (2024-11-27T19:19:34Z)
• Increasing faithfulness in human-human dialog summarization with Spoken Language Understanding tasks [0.0]
  We propose an exploration of how incorporating task-related information can enhance the summarization process. Results show that integrating models with task-related information improves summary accuracy, even with varying word error rates.
  arXiv  Detail & Related papers  (2024-09-16T08:15:35Z)
• Navigating the Landscape of Hint Generation Research: From the Past to the Future [34.47999708205151]
  We present a review of prior research on hint generation, aiming to bridge the gap between research in education and cognitive science. We propose a formal definition of the hint generation task, and discuss the roadmap of building an effective hint generation system.
  arXiv  Detail & Related papers  (2024-04-06T20:42:46Z)
• RECIPE4U: Student-ChatGPT Interaction Dataset in EFL Writing Education [15.253081304714101]
  We present RECIPE4U, a dataset sourced from a semester-long experiment with 212 college students in English as Foreign Language (EFL) writing courses. During the study, students engaged in dialogues with ChatGPT to revise their essays. RECIPE4U includes comprehensive records of these interactions, including conversation logs, students' intent, students' self-rated satisfaction, and students' essay edit histories.
  arXiv  Detail & Related papers  (2024-03-13T05:51:57Z)
• EFL Students' Attitudes and Contradictions in a Machine-in-the-loop Activity System [5.326832235832844]
  This study investigates the attitudes and contradictions of 67 English as a foreign language (EFL) students towards machine-in-the-loop writing. Results revealed mostly positive attitudes, with some negative or mixed feelings.
  arXiv  Detail & Related papers  (2023-07-13T07:38:11Z)
• KETOD: Knowledge-Enriched Task-Oriented Dialogue [77.59814785157877]
  Existing studies in dialogue system research mostly treat task-oriented dialogue and chit-chat as separate domains. We investigate how task-oriented dialogue and knowledge-grounded chit-chat can be effectively integrated into a single model.
  arXiv  Detail & Related papers  (2022-05-11T16:01:03Z)
• UniDU: Towards A Unified Generative Dialogue Understanding Framework [62.8474841241855]
  We investigate a unified generative dialogue understanding framework, namely UniDU, to achieve information exchange among DU tasks. We conduct experiments on ten dialogue understanding datasets, which span five fundamental tasks. The proposed UniDU framework outperforms task-specific well-designed methods on all 5 tasks.
  arXiv  Detail & Related papers  (2022-04-10T09:32:34Z)
• Structural Pre-training for Dialogue Comprehension [51.215629336320305]
  We present SPIDER, Structural Pre-traIned DialoguE Reader, to capture dialogue exclusive features. To simulate the dialogue-like features, we propose two training objectives in addition to the original LM objectives. Experimental results on widely used dialogue benchmarks verify the effectiveness of the newly introduced self-supervised tasks.
  arXiv  Detail & Related papers  (2021-05-23T15:16:54Z)
• Advances in Multi-turn Dialogue Comprehension: A Survey [51.215629336320305]
  We review the previous methods from the perspective of dialogue modeling. We discuss three typical patterns of dialogue modeling that are widely-used in dialogue comprehension tasks.
  arXiv  Detail & Related papers  (2021-03-04T15:50:17Z)
• Discern: Discourse-Aware Entailment Reasoning Network for Conversational Machine Reading [157.14821839576678]
  Discern is a discourse-aware entailment reasoning network to strengthen the connection and enhance the understanding for both document and dialog. Our experiments show that Discern achieves state-of-the-art results of 78.3% macro-averaged accuracy on decision making and 64.0 BLEU1 on follow-up question generation.
  arXiv  Detail & Related papers  (2020-10-05T07:49:51Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.