ANVIL: Analogies and Videos for Lecturers

• URL: http://arxiv.org/abs/2605.16295v1
• Date: Wed, 15 Apr 2026 12:12:14 GMT
• Title: ANVIL: Analogies and Videos for Lecturers
• Abstract summary: We present ANVIL, a multimodal generative system that automates the production of analogy-based instructional animations.<n>We use a teacher evaluation to ground the quality assessment and use its findings to guide automated screening.<n>Our findings suggest that ANVIL can produce materials that are frequently rated as adequate, and that educators respond positively to its perceived value and usability.
• Score: 0.6780086370528623
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: We present ANVIL, a multimodal generative system that automates the production of analogy-based instructional animations for computer science topics. Given a concept definition, ANVIL generates a textual analogy, compiles it into a structured visual screenplay, and produces executable manim code to render an animation, with an automated repair mechanism to improve robustness. Evaluating such systems at scale requires balancing pedagogical validity with scalability. We begin with a teacher evaluation to ground the quality assessment and use its findings to guide automated screening. For textual analogies, we introduce an LLM-based evaluator for scalable quality screening; for videos, where subjective judgments are difficult to automate, we instead assess fidelity to the intended screenplay using an automated proxy for auditing and error analysis. We further conduct a user study with educators to examine adoption requirements and risks. Our findings suggest that ANVIL can produce materials that are frequently rated as adequate, and that educators respond positively to its perceived value and usability.

Related papers

• EvalVerse: Pipeline-Aware and Expert-Calibrated Benchmarking for Professional Cinematic Video Generation [59.569634087474185]
  We introduce EvalVerse, a comprehensive, pipeline-aware, and expert-calibrated evaluation framework.<n>First, we organize domain knowledge into an evaluation taxonomy aligned with the professional filmmaking workflow.<n>Second, we distill human expert judgments into a curated dataset with large-scale human annotations.<n>Third, we inject this knowledge into Vision-Language Models (VLMs) through an expert-calibrated fine-tuning strategy.
  arXiv  Detail & Related papers  (2026-05-22T06:22:21Z)
• Exploring Automated Recognition of Instructional Activity and Discourse from Multimodal Classroom Data [8.014320244550243]
  This work explores AI-driven analysis of classroom recordings, focusing on multimodal instructional activity and discourse recognition.<n>Using a densely annotated dataset of 164 hours of video and 68 lesson transcripts, we design parallel, modality-specific pipelines.<n>Fine-tuned models consistently outperform prompting-based approaches, achieving macro-F1 scores of 0.577 for video and 0.460 for transcripts.
  arXiv  Detail & Related papers  (2025-11-26T11:57:22Z)
• Stable Cinemetrics : Structured Taxonomy and Evaluation for Professional Video Generation [78.24409139109507]
  We introduce Stable Cinemetrics, a framework that formalizes filmmaking controls into four disentangled, hierarchical control nodes.<n>We conduct a large-scale human study spanning 10+ models and 20K videos, annotated by a pool of 80+ film professionals.<n>SCINE is the first approach to situate professional video generation within the landscape of video generative models.
  arXiv  Detail & Related papers  (2025-09-30T17:22:18Z)
• VideoGen-Eval: Agent-based System for Video Generation Evaluation [54.662739174367836]
  Video generation has rendered existing evaluation systems inadequate for assessing state-of-the-art models.<n>We propose VideoGen-Eval, an agent evaluation system that integrates content structuring, MLLM-based content judgment, and patch tools for temporal-dense dimensions.<n>We introduce a video generation benchmark to evaluate existing cutting-edge models and verify the effectiveness of our evaluation system.
  arXiv  Detail & Related papers  (2025-03-30T14:12:21Z)
• VACT: A Video Automatic Causal Testing System and a Benchmark [55.53300306960048]
  VACT is an **automated** framework for modeling, evaluating, and measuring the causal understanding of VGMs in real-world scenarios.<n>We introduce multi-level causal evaluation metrics to provide a detailed analysis of the causal performance of VGMs.
  arXiv  Detail & Related papers  (2025-03-08T10:54:42Z)
• An Automated Explainable Educational Assessment System Built on LLMs [12.970776782360366]
  AERA Chat is an automated educational assessment system designed for interactive and visual evaluations of student responses.<n>Our system allows users to input questions and student answers, providing educators and researchers with insights into assessment accuracy.
  arXiv  Detail & Related papers  (2024-12-17T23:29:18Z)
• AutoBench-V: Can Large Vision-Language Models Benchmark Themselves? [65.92331309449015]
  We introduce AutoBench-V, an automated framework for serving evaluation on demand, i.e., benchmarking LVLMs based on specific aspects of model capability.<n>Through an extensive evaluation of nine popular LVLMs across five demanded user inputs, the framework shows effectiveness and reliability.
  arXiv  Detail & Related papers  (2024-10-28T17:55:08Z)
• Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levels [95.44077384918725]
  We propose to teach large multi-modality models (LMMs) with text-defined rating levels instead of scores. The proposed Q-Align achieves state-of-the-art performance on image quality assessment (IQA), image aesthetic assessment (IAA) and video quality assessment (VQA) tasks.
  arXiv  Detail & Related papers  (2023-12-28T16:10:25Z)
• Automated Assessment of Students' Code Comprehension using LLMs [0.3293989832773954]
  Large Language Models (LLMs) and encoder-based Semantic Textual Similarity (STS) models are assessed. Our findings indicate that LLMs, when prompted in few-shot and chain-of-thought setting, perform comparable to fine-tuned encoder-based models in evaluating students' short answers in programming domain.
  arXiv  Detail & Related papers  (2023-12-19T20:39:12Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.