Should There be a Teacher In-the-Loop? A Study of Generative AI Personalized Tasks Middle School
- URL: http://arxiv.org/abs/2602.15876v1
- Date: Mon, 02 Feb 2026 19:36:38 GMT
- Title: Should There be a Teacher In-the-Loop? A Study of Generative AI Personalized Tasks Middle School
- Abstract summary: generative AI models can create tasks that correspond to students' interests and enact context personalization, enhancing students' interest in learning academic content.<n>We study 7 middle school mathematics teachers with ChatGPT to create personalized versions of problems in their curriculum, to correspond to their students' interests.<n>We find that having a teacher-in-the-loop results in generative AI-enhanced personalization being enacted at a relatively broad grain size.
- Score: 0.34891835983047076
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Adapting instruction to the fine-grained needs of individual students is a powerful application of recent advances in large language models. These generative AI models can create tasks that correspond to students' interests and enact context personalization, enhancing students' interest in learning academic content. However, when there is a teacher in-the-loop creating or modifying tasks with generative AI, it is unclear how efficient this process might be, despite commercial generative AI tools' claims that they will save teachers time. In the present study, we teamed 7 middle school mathematics teachers with ChatGPT to create personalized versions of problems in their curriculum, to correspond to their students' interests. We look at the prompting moves teachers made, their efficiency when creating problems, and the reactions of their 521 7th grade students who received the personalized assignments. We find that having a teacher-in-the-loop results in generative AI-enhanced personalization being enacted at a relatively broad grain size, whereas students tend to prefer a smaller grain size where they receive specific popular culture references that interest them. Teachers spent a lot of effort adjusting popular culture references and addressing issues with the depth or realism of the problems generated, giving higher or lower levels of ownership to the generative AI. Teachers were able to improve in their ability to craft interesting problems in partnership with generative AI, but this process did not appear to become particularly time efficient as teachers learned and reflected on their students' data, iterating their approaches.
Related papers
- Masking Teacher and Reinforcing Student for Distilling Vision-Language Models [50.619420197124356]
Large-scale vision-language models (VLMs) have recently achieved remarkable multimodal understanding.<n>This raises the need for compact yet capable VLMs that can efficiently learn from powerful large teachers.<n>We propose Masters (Masking Teacher and Reinforcing Student), a mask-progressive reinforcement learning framework.
arXiv Detail & Related papers (2025-12-23T14:40:38Z) - INSIGHT: Bridging the Student-Teacher Gap in Times of Large Language Models [0.7499722271664147]
INSIGHT is a proof of concept to combine various AI tools to assist teaching staff and students in the process of solving exercises.<n>We analyze students' questions to an LLM by extracting keywords, which we use to dynamically build an FAQ from students' questions.
arXiv Detail & Related papers (2025-04-24T15:47:20Z) - Who is Helping Whom? Student Concerns about AI- Teacher Collaboration in Higher Education Classrooms [8.888004194396643]
This paper aims to understand how students perceive the implications of AI in Education in terms of classroom collaborative dynamics.<n>We analyzed narratives from 65 participants, highlighting three challenges: AI decontextualizing of the educational context; AI-teacher cooperation with bias concerns and power disparities.<n>We argue that for effective and ethical AI-facilitated cooperative education, future AIEd design must factor in the situated nature of implementation.
arXiv Detail & Related papers (2024-12-19T02:35:01Z) - YODA: Teacher-Student Progressive Learning for Language Models [82.0172215948963]
This paper introduces YODA, a teacher-student progressive learning framework.
It emulates the teacher-student education process to improve the efficacy of model fine-tuning.
Experiments show that training LLaMA2 with data from YODA improves SFT with significant performance gain.
arXiv Detail & Related papers (2024-01-28T14:32:15Z) - Understanding Teacher Perspectives and Experiences after Deployment of
AI Literacy Curriculum in Middle-school Classrooms [12.35885897302579]
We investigate the experiences of seven teachers following their implementation of modules from the MIT RAICA curriculum.
Our analysis suggests that the AI modules expanded our teachers' knowledge in the field.
Our teachers advocated their need for better external support when navigating technological resources.
arXiv Detail & Related papers (2023-12-08T05:36:16Z) - MathDial: A Dialogue Tutoring Dataset with Rich Pedagogical Properties
Grounded in Math Reasoning Problems [74.73881579517055]
We propose a framework to generate such dialogues by pairing human teachers with a Large Language Model prompted to represent common student errors.
We describe how we use this framework to collect MathDial, a dataset of 3k one-to-one teacher-student tutoring dialogues.
arXiv Detail & Related papers (2023-05-23T21:44:56Z) - The AI Revolution in Education: Will AI Replace or Assist Teachers in
Higher Education? [0.0]
The study provides a comprehensive perspective on the future role of educators in the face of AI technologies.
Participants argue that human teachers possess unique qualities, such as critical thinking, creativity, and emotions, which make them irreplaceable.
The research proposes that teachers can effectively integrate AI to enhance teaching and learning without viewing it as a replacement.
arXiv Detail & Related papers (2023-05-02T03:39:34Z) - Computationally Identifying Funneling and Focusing Questions in
Classroom Discourse [24.279653100481863]
We propose the task of computationally detecting funneling and focusing questions in classroom discourse.
We release an annotated dataset of 2,348 teacher utterances labeled for funneling and focusing questions, or neither.
Our best model, a supervised RoBERTa model fine-tuned on our dataset, has a strong linear correlation of.76 with human expert labels and with positive educational outcomes.
arXiv Detail & Related papers (2022-07-08T01:28:29Z) - Iterative Teacher-Aware Learning [136.05341445369265]
In human pedagogy, teachers and students can interact adaptively to maximize communication efficiency.
We propose a gradient optimization based teacher-aware learner who can incorporate teacher's cooperative intention into the likelihood function.
arXiv Detail & Related papers (2021-10-01T00:27:47Z) - Creation and Evaluation of a Pre-tertiary Artificial Intelligence (AI)
Curriculum [58.86139968005518]
The Chinese University of Hong Kong (CUHK)-Jockey Club AI for the Future Project (AI4Future) co-created an AI curriculum for pre-tertiary education.
A team of 14 professors with expertise in engineering and education collaborated with 17 principals and teachers from 6 secondary schools to co-create the curriculum.
The co-creation process generated a variety of resources which enhanced the teachers knowledge in AI, as well as fostered teachers autonomy in bringing the subject matter into their classrooms.
arXiv Detail & Related papers (2021-01-19T11:26:19Z) - Neural Multi-Task Learning for Teacher Question Detection in Online
Classrooms [50.19997675066203]
We build an end-to-end neural framework that automatically detects questions from teachers' audio recordings.
By incorporating multi-task learning techniques, we are able to strengthen the understanding of semantic relations among different types of questions.
arXiv Detail & Related papers (2020-05-16T02:17:04Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.