Talking Slide Avatars: Open-Source Multimodal Communication Approach for Teaching

• URL: http://arxiv.org/abs/2604.23703v1
• Date: Sun, 26 Apr 2026 13:36:45 GMT
• Title: Talking Slide Avatars: Open-Source Multimodal Communication Approach for Teaching
• Abstract summary: This study presents a practice-based analysis of an open-source workflow for creating talking slide avatars for slide-based teaching.<n>The study frames talking slide avatars as multimodal communication artifacts at the intersection of digital pedagogy, aesthetic education, and art-technology practice.
• Score: 7.927674438432626
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Slide-based teaching is widely used in higher education, yet in online, hybrid, and asynchronous contexts, slides often lose the instructor presence, narrative continuity, and expressive framing that help learners connect with content. Full lecture video can partly restore these qualities, but it is time-consuming to record, revise, and reuse. This study addresses that pedagogical and production challenge by presenting a practice-based analysis of an open-source workflow for creating talking slide avatars for slide-based teaching. The workflow integrates OpenVoice for text-to-speech generation and voice cloning with Ditto-TalkingHead for audio-driven talking-image synthesis, enabling instructors to transform a script and a static portrait into a short narrated video that can be embedded in slide decks or HTML-based lecture materials. Rather than treating this workflow merely as a technical solution, the study frames talking slide avatars as multimodal communication artifacts at the intersection of digital pedagogy, aesthetic education, and art-technology practice. Using a practice-based implementation and analytic reflection approach, the study documents the production pipeline, examines its communicative and aesthetic affordances, and proposes practical guidelines for script length, image selection, pacing, disclosure, accessibility, and ethical use. The study makes three primary contributions: it presents an educator-oriented open-source production model, reframes talking avatars as an educational communication design problem, and proposes a responsible pathway for incorporating generative synthetic media into teaching. It concludes that short, transparent, and carefully designed avatars can humanize slide-based instruction while providing a reusable communicative layer for introductions, transitions, reminders, and recaps across online, hybrid, and asynchronous learning environments.

Related papers

• ALIVE: An Avatar-Lecture Interactive Video Engine with Content-Aware Retrieval for Real-Time Interaction [5.691710068675227]
  ALIVE is an Avatar-Lecture Interactive Video Engine that transforms passive lecture viewing into a dynamic, real-time learning experience.<n>ALIVE employs lightweight embedding models, FAISS-based retrieval, and segmented avatar synthesis with progressive preloading.<n>We demonstrate the system on a complete medical imaging course, evaluate its retrieval accuracy, latency characteristics, and user experience, and show that ALIVE provides accurate, content-aware, and engaging real-time support.
  arXiv  Detail & Related papers  (2025-12-24T00:33:59Z)
• BOOM: Beyond Only One Modality KIT's Multimodal Multilingual Lecture Companion [56.41649972542962]
  We present textbfBOOM, a multilingual lecture companion that jointly translates lecture audio and slides to produce synchronized outputs across three modalities.<n>Our experiments demonstrate that slide-aware transcripts also yield cascading benefits for downstream tasks such as summarization and question answering.
  arXiv  Detail & Related papers  (2025-12-02T14:27:26Z)
• Paper2Video: Automatic Video Generation from Scientific Papers [62.634562246594555]
  Paper2Video is the first benchmark of 101 research papers paired with author-created presentation videos, slides, and speaker metadata.<n>We propose PaperTalker, the first multi-agent framework for academic presentation video generation.
  arXiv  Detail & Related papers  (2025-10-06T17:58:02Z)
• SakugaFlow: A Stagewise Illustration Framework Emulating the Human Drawing Process and Providing Interactive Tutoring for Novice Drawing Skills [23.6178079869457]
  SakugaFlow is a four-stage pipeline that pairs diffusion-based image generation with a large-language-model tutor.<n> novices receive real-time feedback on anatomy, perspective, and composition.
  arXiv  Detail & Related papers  (2025-06-10T04:35:10Z)
• Awaking the Slides: A Tuning-free and Knowledge-regulated AI Tutoring System via Language Model Coordination [52.20542825755132]
  We develop Slide2Lecture, a tuning-free and knowledge-regulated intelligent tutoring system. It can effectively convert an input lecture slide into a structured teaching agenda consisting of a set of heterogeneous teaching actions. For teachers and developers, Slide2Lecture enables customization to cater to personalized demands.
  arXiv  Detail & Related papers  (2024-09-11T16:03:09Z)
• Seek for Incantations: Towards Accurate Text-to-Image Diffusion Synthesis through Prompt Engineering [118.53208190209517]
  We propose a framework to learn the proper textual descriptions for diffusion models through prompt learning. Our method can effectively learn the prompts to improve the matches between the input text and the generated images.
  arXiv  Detail & Related papers  (2024-01-12T03:46:29Z)
• SelfTalk: A Self-Supervised Commutative Training Diagram to Comprehend 3D Talking Faces [28.40393487247833]
  Speech-driven 3D face animation technique, extending its applications to various multimedia fields. Previous research has generated promising realistic lip movements and facial expressions from audio signals. We propose a novel framework SelfTalk, by involving self-supervision in a cross-modals network system to learn 3D talking faces.
  arXiv  Detail & Related papers  (2023-06-19T09:39:10Z)
• Multimodal Lecture Presentations Dataset: Understanding Multimodality in Educational Slides [57.86931911522967]
  We test the capabilities of machine learning models in multimodal understanding of educational content. Our dataset contains aligned slides and spoken language, for 180+ hours of video and 9000+ slides, with 10 lecturers from various subjects. We introduce PolyViLT, a multimodal transformer trained with a multi-instance learning loss that is more effective than current approaches.
  arXiv  Detail & Related papers  (2022-08-17T05:30:18Z)
• AI based Presentation Creator With Customized Audio Content Delivery [0.0]
  This paper aims to use Machine Learning (ML) algorithms and Natural Language Processing (NLP) modules to automate the process of creating a slides-based presentation from a document. We then use state-of-the-art voice cloning models to deliver the content in the desired author's voice.
  arXiv  Detail & Related papers  (2021-06-27T12:17:11Z)
• Visually Guided Self Supervised Learning of Speech Representations [62.23736312957182]
  We propose a framework for learning audio representations guided by the visual modality in the context of audiovisual speech. We employ a generative audio-to-video training scheme in which we animate a still image corresponding to a given audio clip and optimize the generated video to be as close as possible to the real video of the speech segment. We achieve state of the art results for emotion recognition and competitive results for speech recognition.
  arXiv  Detail & Related papers  (2020-01-13T14:53:22Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.