Related papers: AI Meets Mathematics Education: A Case Study on Supporting an Instructor in a Large Mathematics Class with Context-Aware AI

AI Meets Mathematics Education: A Case Study on Supporting an Instructor in a Large Mathematics Class with Context-Aware AI

URL: http://arxiv.org/abs/2603.26679v1
Date: Mon, 09 Mar 2026 10:59:52 GMT
Title: AI Meets Mathematics Education: A Case Study on Supporting an Instructor in a Large Mathematics Class with Context-Aware AI
Abstract summary: Large-enrollment university courses face persistent challenges in providing timely and scalable instructional support.<n>We present a human-centered case study of AI-assisted support in a Calculus I course, implemented in close collaboration with the course instructor.<n>We developed a system to answer students' questions on a discussion forum, fine-tuning a lightweight language model on 2,588 historical student-instructor interactions.
Score: 18.81288652134873
License: http://creativecommons.org/licenses/by/4.0/
Abstract: Large-enrollment university courses face persistent challenges in providing timely and scalable instructional support. While generative AI holds promise, its effective use depends on reliability and pedagogical alignment. We present a human-centered case study of AI-assisted support in a Calculus I course, implemented in close collaboration with the course instructor. We developed a system to answer students' questions on a discussion forum, fine-tuning a lightweight language model on 2,588 historical student-instructor interactions. The model achieved 75.3% accuracy on a benchmark of 150 representative questions annotated by five instructors, and in 36% of cases, its responses were rated equal to or better than instructor answers. Post-deployment student survey (N = 105) indicated that students valued the alignment of the responses with the course materials and their immediate availability, while still relying on the instructor verification for trust. We highlight the importance of hybrid human-AI workflows for safe and effective course support.

Related papers

The Missing Evaluation Axis: What 10,000 Student Submissions Reveal About AI Tutor Effectiveness [9.482202294953526]
We argue that AI tutor evaluation should be extended with a behavioral dimension grounded in student interaction data.<n>We propose an evaluation framework and apply it to 10,235 code submissions with corresponding AI tutor feedback.<n>Using this framework to compare two deployed AI tutors across different semesters in a large-scale introductory computer science course reveals substantial differences in student engagement patterns.
arXiv Detail & Related papers (2026-05-07T03:58:04Z)
An AI Teaching Assistant for Motion Picture Engineering [0.0]
This article describes implementation of an AI Teaching Assistant (AI-TA) at Trinity College Dublin's Master's Motion Picture Engineering (MPE) course.<n>We describe our survey instrument and report on the impact of the AI-TA through a number of quantitative metrics.<n>Student feedback revealed that the AI-TA was beneficial, while students had mixed feelings about preferring it over human tutoring.
arXiv Detail & Related papers (2026-04-06T13:30:11Z)
From Domain Understanding to Design Readiness: a playbook for GenAI-supported learning in Software Engineering [0.4737991126491217]
We report a two-week milestone in a master's course where 29 students used a customized ChatGPT tutor to learn cryptocurrency basics.<n>Results suggest that genAI-supported learning can complement instruction in domain understanding and modeling tasks, while leaving room to improve tone and follow-up structure.
arXiv Detail & Related papers (2026-03-31T18:27:42Z)
Closing the Loop: An Instructor-in-the-Loop AI Assistance System for Supporting Student Help-Seeking in Programming Education [21.729610894273563]
We present a hybrid help framework that integrates AI-generated hints with an escalation mechanism.<n>We observed that out of the total 673 AI-generated hints, students rated 146 (22%) as unhelpful.<n>This finding suggests that when AI support fails, even instructors with expertise may need to pay greater attention to avoid making mistakes.
arXiv Detail & Related papers (2025-10-16T08:57:05Z)
Decoding Instructional Dialogue: Human-AI Collaborative Analysis of Teacher Use of AI Tool at Scale [9.092920230987684]
The integration of large language models into educational tools has the potential to substantially impact how teachers plan instruction.<n>This paper presents a human-AI collaborative methodology for large-scale qualitative analysis of over 140,000 educator-AI messages.
arXiv Detail & Related papers (2025-07-23T23:23:38Z)
Could ChatGPT get an Engineering Degree? Evaluating Higher Education Vulnerability to AI Assistants [176.39275404745098]
We evaluate whether two AI assistants, GPT-3.5 and GPT-4, can adequately answer assessment questions.<n>GPT-4 answers an average of 65.8% of questions correctly, and can even produce the correct answer across at least one prompting strategy for 85.1% of questions.<n>Our results call for revising program-level assessment design in higher education in light of advances in generative AI.
arXiv Detail & Related papers (2024-08-07T12:11:49Z)
CourseAssist: Pedagogically Appropriate AI Tutor for Computer Science Education [1.052788652996288]
This poster introduces CourseAssist, a novel LLM-based tutoring system tailored for computer science education. Unlike generic LLM systems, CourseAssist uses retrieval-augmented generation, user intent classification, and question decomposition to align AI responses with specific course materials and learning objectives.
arXiv Detail & Related papers (2024-05-01T20:43:06Z)
SyllabusQA: A Course Logistics Question Answering Dataset [45.90423821963144]
We introduce SyllabusQA, an open-source dataset with 63 real course syllabi covering 36 majors, containing 5,078 open-ended course logistics-related question-answer pairs. We benchmark several strong baselines on this task, from large language model prompting to retrieval-augmented generation. We find that despite performing close to humans on traditional metrics of textual similarity, there remains a significant gap between automated approaches and humans in terms of fact precision.
arXiv Detail & Related papers (2024-03-03T03:01:14Z)
YODA: Teacher-Student Progressive Learning for Language Models [82.0172215948963]
This paper introduces YODA, a teacher-student progressive learning framework. It emulates the teacher-student education process to improve the efficacy of model fine-tuning. Experiments show that training LLaMA2 with data from YODA improves SFT with significant performance gain.
arXiv Detail & Related papers (2024-01-28T14:32:15Z)
UKP-SQuARE: An Interactive Tool for Teaching Question Answering [61.93372227117229]
The exponential growth of question answering (QA) has made it an indispensable topic in any Natural Language Processing (NLP) course. We introduce UKP-SQuARE as a platform for QA education. Students can run, compare, and analyze various QA models from different perspectives.
arXiv Detail & Related papers (2023-05-31T11:29:04Z)
MathDial: A Dialogue Tutoring Dataset with Rich Pedagogical Properties Grounded in Math Reasoning Problems [74.73881579517055]
We propose a framework to generate such dialogues by pairing human teachers with a Large Language Model prompted to represent common student errors. We describe how we use this framework to collect MathDial, a dataset of 3k one-to-one teacher-student tutoring dialogues.
arXiv Detail & Related papers (2023-05-23T21:44:56Z)
Neural Multi-Task Learning for Teacher Question Detection in Online Classrooms [50.19997675066203]
We build an end-to-end neural framework that automatically detects questions from teachers' audio recordings. By incorporating multi-task learning techniques, we are able to strengthen the understanding of semantic relations among different types of questions.
arXiv Detail & Related papers (2020-05-16T02:17:04Z)

This list is automatically generated from the titles and abstracts of the papers in this site.