Observing Teachers' Instrumental Pedagogical Orchestration in Synchronous Online Learning: A Multimodal Grid Based on Videoconferencing Traces

• URL: http://arxiv.org/abs/2606.14358v1
• Date: Fri, 12 Jun 2026 11:37:18 GMT
• Title: Observing Teachers' Instrumental Pedagogical Orchestration in Synchronous Online Learning: A Multimodal Grid Based on Videoconferencing Traces
• Abstract summary: This article proposes a multimodal observation grid designed to analyze the instrumentalised pedagogical orchestration of teachers during synchronous online classes.<n>Based on theories of pedagogical orchestration, multimodality and professional gestures of teachers, this grid identifies a set of observable indicators related to communicational gestures, posture, gaze and the management of digital tools.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Synchronous online teaching environments pose specific challenges for the analysis of pedagogical activity as teaching takes place via videoconferencing platforms and interactions are multimodal. While pedagogical orchestration has been extensively studied in the context of face-to-face courses and at the level of instructional design, the analysis of teaching in videoconferencing environments remains under-explored and insufficiently instrumented in terms of methodology. This article proposes a multimodal observation grid designed to analyze the instrumentalised pedagogical orchestration of teachers during synchronous online classes. Based on theories of pedagogical orchestration, multimodality and professional gestures of teachers, this grid identifies a set of observable indicators related to communicational gestures, posture, gaze and the management of digital tools. These indicators are structured and ranked in order of priority according to their observability and analytical relevance. They are operationalised to consider the constraints associated with data that can be analysed in videoconference class contexts. The proposed grid aims to provide a reproducible methodological framework for the analysis of instrumental pedagogical orchestration, with a view to future empirical validation.

Related papers

• EduStory: A Unified Framework for Pedagogically-Consistent Multi-Shot STEM Instructional Video Generation [40.60762124779023]
  EduStory is a unified framework for reliable instructional video generation.<n>It integrates pedagogical state modeling to track persistent knowledge states, script-guided structured control to organize multi-shot narratives, and learning-oriented evaluation metrics.<n>EduVideoBench is a diagnostic benchmark with multi-granularity annotations, including pedagogical storyboards, shot-level semantics, and knowledge state transitions.
  arXiv  Detail & Related papers  (2026-05-10T07:03:37Z)
• GeoDial: A Multimodal Conversational Tutoring Dataset for Geometry Problem-Solving with Visual Tutor Turns [55.28321614854968]
  We introduce GeoDial, a dataset of over 1.3K teacher-student dialogs in the domain of geometry.<n>We propose a scalable annotation protocol that integrates dialog acts, visual highlighting, and feedback.
  arXiv  Detail & Related papers  (2026-05-08T10:54:32Z)
• Can Multimodal LLMs See Science Instruction? Benchmarking Pedagogical Reasoning in K-12 Classroom Videos [48.45150429099066]
  SciIBI is the first video benchmark for analyzing science classroom discourse.<n>By evaluating eight state-of-the-art LLMs and Multimodal LLMs, we reveal fundamental limitations.
  arXiv  Detail & Related papers  (2026-02-08T15:08:19Z)
• TeachPro: Multi-Label Qualitative Teaching Evaluation via Cross-View Graph Synergy and Semantic Anchored Evidence Encoding [12.647867305450289]
  We propose TeachPro, a multi-label learning framework that systematically assesses five key teaching dimensions.<n>We first propose a Dimension-Anchored Evidence, which integrates three core components.<n>We then propose a Cross-View Graph Synergy Network to represent student comments.
  arXiv  Detail & Related papers  (2026-01-14T07:27:57Z)
• EgoInstruct: An Egocentric Video Dataset of Face-to-face Instructional Interactions with Multi-modal LLM Benchmarking [20.1877648578032]
  We present a new egocentric video dataset of face-to-face instruction.<n>We provide ground-truth annotations for two fundamental tasks that serve as a first step toward a comprehensive understanding of instructional interactions.<n>We evaluate recently introduced MLLMs that jointly process images, audio, and text.
  arXiv  Detail & Related papers  (2025-09-26T07:52:26Z)
• Hierarchical Banzhaf Interaction for General Video-Language Representation Learning [60.44337740854767]
  Multimodal representation learning plays an important role in the artificial intelligence domain.<n>We introduce a new approach that models video-text as game players using multivariate cooperative game theory.<n>We extend our original structure into a flexible encoder-decoder framework, enabling the model to adapt to various downstream tasks.
  arXiv  Detail & Related papers  (2024-12-30T14:09:15Z)
• Enhancing Talk Moves Analysis in Mathematics Tutoring through Classroom Teaching Discourse [6.1701318546149]
  This paper focuses on analyzing mathematics tutoring discourse using talk moves.<n> scaling the collection, annotation, and analysis of extensive tutoring dialogues to develop machine learning models is a challenging and resource-intensive task.
  arXiv  Detail & Related papers  (2024-12-18T00:13:04Z)
• OnDiscuss: An Epistemic Network Analysis Learning Analytics Visualization Tool for Evaluating Asynchronous Online Discussions [0.49998148477760973]
  OnDiscuss is a learning analytics visualization tool for instructors that utilize text mining algorithms and Epistemic Network Analysis (ENA) Text mining is used to generate an initial codebook for the instructor as well as automatically code the data. This tool allows instructors to edit their codebook and then dynamically view the resulting ENA networks for the entire class and individual students.
  arXiv  Detail & Related papers  (2024-08-19T21:23:11Z)
• SAIE Framework: Support Alone Isn't Enough -- Advancing LLM Training with Adversarial Remarks [47.609417223514605]
  This work introduces the SAIE framework, which facilitates supportive and adversarial discussions between learner and partner models. Our empirical evaluation shows that models fine-tuned with the SAIE framework outperform those trained with conventional fine-tuning approaches.
  arXiv  Detail & Related papers  (2023-11-14T12:12:25Z)
• Multimodal Lecture Presentations Dataset: Understanding Multimodality in Educational Slides [57.86931911522967]
  We test the capabilities of machine learning models in multimodal understanding of educational content. Our dataset contains aligned slides and spoken language, for 180+ hours of video and 9000+ slides, with 10 lecturers from various subjects. We introduce PolyViLT, a multimodal transformer trained with a multi-instance learning loss that is more effective than current approaches.
  arXiv  Detail & Related papers  (2022-08-17T05:30:18Z)
• Neural Multi-Task Learning for Teacher Question Detection in Online Classrooms [50.19997675066203]
  We build an end-to-end neural framework that automatically detects questions from teachers' audio recordings. By incorporating multi-task learning techniques, we are able to strengthen the understanding of semantic relations among different types of questions.
  arXiv  Detail & Related papers  (2020-05-16T02:17:04Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.