Investigation of the effectiveness of applying ChatGPT in Dialogic Teaching Using Electroencephalography

• URL: http://arxiv.org/abs/2403.16687v5
• Date: Tue, 11 Jun 2024 03:35:03 GMT
• Title: Investigation of the effectiveness of applying ChatGPT in Dialogic Teaching Using Electroencephalography
• Authors: Jiayue Zhang, Yiheng Liu, Wenqi Cai, Lanlan Wu, Yali Peng, Jingjing Yu, Senqing Qi, Taotao Long, Bao Ge,
• Abstract summary: Large language models (LLMs) possess the capability to interpret knowledge, answer questions, and consider context. This research recruited 34 undergraduate students as participants, who were randomly divided into two groups. The experimental group engaged in dialogic teaching using ChatGPT, while the control group interacted with human teachers.
• Score: 6.34494999013996
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: In recent years, the rapid development of artificial intelligence technology, especially the emergence of large language models (LLMs) such as ChatGPT, has presented significant prospects for application in the field of education. LLMs possess the capability to interpret knowledge, answer questions, and consider context, thus providing support for dialogic teaching to students. Therefore, an examination of the capacity of LLMs to effectively fulfill instructional roles, thereby facilitating student learning akin to human educators within dialogic teaching scenarios, is an exceptionally valuable research topic. This research recruited 34 undergraduate students as participants, who were randomly divided into two groups. The experimental group engaged in dialogic teaching using ChatGPT, while the control group interacted with human teachers. Both groups learned the histogram equalization unit in the information-related course "Digital Image Processing". The research findings show comparable scores between the two groups on the retention test. However, students who engaged in dialogue with ChatGPT exhibited lower performance on the transfer test. Electroencephalography data revealed that students who interacted with ChatGPT exhibited higher levels of cognitive activity, suggesting that ChatGPT could help students establish a knowledge foundation and stimulate cognitive activity. However, its strengths on promoting students. knowledge application and creativity were insignificant. Based upon the research findings, it is evident that ChatGPT cannot fully excel in fulfilling teaching tasks in the dialogue teaching in information related courses. Combining ChatGPT with traditional human teachers might be a more ideal approach. The synergistic use of both can provide students with more comprehensive learning support, thus contributing to enhancing the quality of teaching.

Related papers

• ChatGPT in Research and Education: Exploring Benefits and Threats [1.9466452723529557]
  ChatGPT is a powerful language model developed by OpenAI. It offers personalized feedback, enhances accessibility, enables interactive conversations, assists with lesson preparation and evaluation, and introduces new methods for teaching complex subjects. ChatGPT also poses challenges to traditional education and research systems. These challenges include the risk of cheating on online exams, the generation of human-like text that may compromise academic integrity, and difficulties in assessing the reliability of information generated by AI.
  arXiv  Detail & Related papers  (2024-11-05T05:29:00Z)
• Exploring Knowledge Tracing in Tutor-Student Dialogues [53.52699766206808]
  We present a first attempt at performing knowledge tracing (KT) in tutor-student dialogues. We propose methods to identify the knowledge components/skills involved in each dialogue turn. We then apply a range of KT methods on the resulting labeled data to track student knowledge levels over an entire dialogue.
  arXiv  Detail & Related papers  (2024-09-24T22:31:39Z)
• StuGPTViz: A Visual Analytics Approach to Understand Student-ChatGPT Interactions [35.927734064685886]
  We present a visual analytics system, StuGPTViz, that tracks and compares temporal patterns in student prompts and the quality of ChatGPT's responses at multiple scales. The results confirmed StuGPTViz's capacity to enhance educators' insights into the pedagogical value of ChatGPT.
  arXiv  Detail & Related papers  (2024-07-17T09:20:44Z)
• Adoption and Impact of ChatGPT in Computer Science Education: A Case Study on a Database Administration Course [0.46040036610482665]
  This contribution presents an exploratory and correlational study conducted with 37 students who used ChatGPT as a support tool to learn database administration. The usage and perceived utility of ChatGPT were moderate, but positive correlations between student grade and ChatGPT usage were found.
  arXiv  Detail & Related papers  (2024-05-26T20:51:28Z)
• Using ChatGPT for Science Learning: A Study on Pre-service Teachers' Lesson Planning [0.7416846035207727]
  This study analyzed lesson plans developed by 29 pre-service elementary teachers from a Korean university. 14 types of teaching and learning methods/strategies were identified in the lesson plans. The study identified both appropriate and inappropriate use cases of ChatGPT in lesson planning.
  arXiv  Detail & Related papers  (2024-01-18T22:52:04Z)
• Exploring User Perspectives on ChatGPT: Applications, Perceptions, and Implications for AI-Integrated Education [40.38809129759498]
  ChatGPT is most commonly used in the domains of higher education, K-12 education, and practical skills training. On one hand, some users view it as a transformative tool capable of amplifying student self-efficacy and learning motivation. On the other hand, there is a degree of apprehension among concerned users.
  arXiv  Detail & Related papers  (2023-05-22T15:13:14Z)
• ChatGPT Beyond English: Towards a Comprehensive Evaluation of Large Language Models in Multilingual Learning [70.57126720079971]
  Large language models (LLMs) have emerged as the most important breakthroughs in natural language processing (NLP) This paper evaluates ChatGPT on 7 different tasks, covering 37 diverse languages with high, medium, low, and extremely low resources. Compared to the performance of previous models, our extensive experimental results demonstrate a worse performance of ChatGPT for different NLP tasks and languages.
  arXiv  Detail & Related papers  (2023-04-12T05:08:52Z)
• A Preliminary Evaluation of ChatGPT for Zero-shot Dialogue Understanding [55.37338324658501]
  Zero-shot dialogue understanding aims to enable dialogue to track the user's needs without any training data. In this work, we investigate the understanding ability of ChatGPT for zero-shot dialogue understanding tasks.
  arXiv  Detail & Related papers  (2023-04-09T15:28:36Z)
• KETOD: Knowledge-Enriched Task-Oriented Dialogue [77.59814785157877]
  Existing studies in dialogue system research mostly treat task-oriented dialogue and chit-chat as separate domains. We investigate how task-oriented dialogue and knowledge-grounded chit-chat can be effectively integrated into a single model.
  arXiv  Detail & Related papers  (2022-05-11T16:01:03Z)
• Disadvantaged students increase their academic performance through collective intelligence exposure in emergency remote learning due to COVID 19 [105.54048699217668]
  During the COVID-19 crisis, educational institutions worldwide shifted from face-to-face instruction to emergency remote teaching (ERT) modalities. We analyzed data on 7,528 undergraduate students and found that cooperative and consensus dynamics among students in discussion forums positively affect their final GPA. Using natural language processing, we show that first-year students with low academic performance during high school are exposed to more content-intensive posts in discussion forums.
  arXiv  Detail & Related papers  (2022-03-10T20:23:38Z)
• Neural Multi-Task Learning for Teacher Question Detection in Online Classrooms [50.19997675066203]
  We build an end-to-end neural framework that automatically detects questions from teachers' audio recordings. By incorporating multi-task learning techniques, we are able to strengthen the understanding of semantic relations among different types of questions.
  arXiv  Detail & Related papers  (2020-05-16T02:17:04Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.