Designing Human-GenAI Interaction for cMOOC Discussion Facilitation: Effects of a Collaborative AI-in-the-Loop Workflow on Social and Cognitive Presence

• URL: http://arxiv.org/abs/2603.29285v2
• Date: Sat, 04 Apr 2026 09:27:26 GMT
• Title: Designing Human-GenAI Interaction for cMOOC Discussion Facilitation: Effects of a Collaborative AI-in-the-Loop Workflow on Social and Cognitive Presence
• Abstract summary: Connectivist MOOCs rely on learner-driven interaction, yet their intentionally scalable facilitation makes it difficult to design generative AI participation.<n>This study examined how human-AI interaction can be designed for discussion facilitation through a collaborative AI-in-theloop workflow.
• Score: 0.16527192629404033
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Connectivist MOOCs (cMOOCs) rely on learner-driven interaction, yet their intentionally light facilitation makes it difficult to design generative AI participation that is both scalable and educationally productive. This design-based research study examined how human-AI interaction can be designed for discussion facilitation through a collaborative AI-in-the-loop workflow. Across two iterations in a five-week cMOOC (N = 606), we designed, deployed, and evaluated a facilitation system that combined network-structure-driven target selection, discourse-adaptive response roles, and mandatory human review before AI participation became visible in the community. Iteration 1 (Weeks 1-2) focused on refining the interaction design, showing that the most sustainable facilitation patterns were Guide (70.4%) and Amplifier (28.5%) responses and yielding explicit moderation standards for publishable AI participation. Iteration 2 (Weeks 3-5) examined how different forms of AI-mediated interaction related to social and cognitive presence. AI participation selectively enhanced Open Communication (r = 0.188, p = 0.006), Networked Cohesion (r = 0.274, p < 0.001), and overall social presence (r = 0.162, p = 0.015), while cognitive presence showed no overall improvement. More importantly, direct learner-agent interaction was associated with significantly higher social presence (r = 0.186, p = 0.004) and higher-order cognitive indicators-Integration (r = 0.206, p = 0.001) and Resolution/Creation (r = 0.350, p < 0.001)-than mere co-presence in AI-involved threads. The findings suggest that effective GenAI-supported discussion depends less on AI presence alone than on interaction design: reciprocal exchange, discourse-adaptive facilitation roles, and collaborative human review appear to be key conditions for productive AI participation in online learning communities.

Related papers

• Informal Learning Emerges in Everyday Human-LLM Interaction [74.53081471113929]
  We show that everyday human-LLM interaction contains measurable, selective and conditionally organized behavioural signatures of informal learning.<n>They shift AI evaluation from answer-delivery efficiency toward the preservation of cognitive opportunities for users to reason, test ideas and construct understanding.
  arXiv  Detail & Related papers  (2026-07-20T07:56:41Z)
• HRIBench: Benchmarking Interaction-Centric Human-Robot Collaboration [62.19372189311434]
  We introduce HRIBench, a diagnostic benchmark for intent-aware human-robot collaboration based on executable scenarios.<n>HRIBench represents collaborative tasks as structured scenario scripts that explicitly model agent roles, temporal dependencies, coordination constraints, and human behavior distributions.<n>Results show that current foundation robot policies struggle substantially in collaborative settings despite strong manipulation ability.
  arXiv  Detail & Related papers  (2026-07-05T09:15:35Z)
• Does Theory of Mind Improvement Really Benefit Human-AI Interactions? Empirical Findings from Interactive Evaluations [80.39504840645687]
  Existing benchmarks measure ToM capability improvement through story-reading, multiple-choice questions from a third-person perspective.<n>This paper proposes a new paradigm of interactive ToM evaluation with both perspective and metric shifts.<n>Our findings reveal that improvements on static benchmarks do not always translate to better performance in dynamic HAI interactions.
  arXiv  Detail & Related papers  (2026-04-28T15:38:31Z)
• Cooperation Through Indirect Reciprocity in Child-Robot Interactions [81.62347137438248]
  We investigate whether indirect reciprocity can be transposed to children-robot interactions.<n>We find that IR extends to children and robots solving coordination dilemmas.<n>We observe that cooperating through multi-armed bandit algorithms is highly dependent on the strategies revealed by humans.
  arXiv  Detail & Related papers  (2025-11-07T07:08:32Z)
• Efficiency Without Cognitive Change: Evidence from Human Interaction with Narrow AI Systems [0.0]
  Short-term exposure to narrow AI tools enhances core cognitive abilities.<n>No significant pre-post differences emerged in standardized measures of problem solving or verbal comprehension.
  arXiv  Detail & Related papers  (2025-10-28T18:55:44Z)
• Interaction as Intelligence: Deep Research With Human-AI Partnership [25.28272178646003]
  "Interaction as Intelligence" research series presents a reconceptualization of human-AI relationships in deep research tasks.<n>We introduce Deep Cognition, a system that transforms the human role from giving instructions to cognitive oversight.
  arXiv  Detail & Related papers  (2025-07-21T16:15:18Z)
• Co-Creative Learning via Metropolis-Hastings Interaction between Humans and AI [6.712251433139411]
  We propose co-creative learning where humans and AI mutually integrate their partial perceptual information and knowledge to construct shared external representations.<n>We empirically test this framework using a human-AI interaction model based on the Metropolis-Hastings naming game (MHNG)<n>Results show that human-AI pairs with an MH-based agent significantly improved categorization accuracy through interaction.<n>Human acceptance behavior aligned closely with the MH-derived acceptance probability.
  arXiv  Detail & Related papers  (2025-06-18T13:58:45Z)
• The Human Robot Social Interaction (HSRI) Dataset: Benchmarking Foundational Models' Social Reasoning [49.32390524168273]
  Our work aims to advance the social reasoning of embodied artificial intelligence (AI) agents in real-world social interactions.<n>We introduce a large-scale real-world Human Robot Social Interaction (HSRI) dataset to benchmark the capabilities of language models (LMs) and foundational models (FMs)<n>Our dataset consists of 400 real-world human social robot interaction videos and over 10K annotations, detailing the robot's social errors, competencies, rationale, and corrective actions.
  arXiv  Detail & Related papers  (2025-04-07T06:27:02Z)
• Towards interactive evaluations for interaction harms in human-AI systems [8.989911701384788]
  We propose a shift towards evaluation based on textitinteractional ethics, which focuses on textitinteraction harms<n>First, we discuss the limitations of current evaluation methods, which (1) are static, (2) assume a universal user experience, and (3) have limited construct validity.<n>We present practical principles for designing interactive evaluations. These include ecologically valid interaction scenarios, human impact metrics, and diverse human participation approaches.
  arXiv  Detail & Related papers  (2024-05-17T08:49:34Z)
• AntEval: Evaluation of Social Interaction Competencies in LLM-Driven Agents [65.16893197330589]
  Large Language Models (LLMs) have demonstrated their ability to replicate human behaviors across a wide range of scenarios. However, their capability in handling complex, multi-character social interactions has yet to be fully explored. We introduce the Multi-Agent Interaction Evaluation Framework (AntEval), encompassing a novel interaction framework and evaluation methods.
  arXiv  Detail & Related papers  (2024-01-12T11:18:00Z)
• Human-AI collaboration is not very collaborative yet: A taxonomy of interaction patterns in AI-assisted decision making from a systematic review [6.013543974938446]
  Leveraging Artificial Intelligence in decision support systems has disproportionately focused on technological advancements. A human-centered perspective attempts to alleviate this concern by designing AI solutions for seamless integration with existing processes.
  arXiv  Detail & Related papers  (2023-10-30T17:46:38Z)
• Human-AI Coevolution [48.74579595505374]
  Coevolution AI is a process in which humans and AI algorithms continuously influence each other. This paper introduces Coevolution AI as the cornerstone for a new field of study at the intersection between AI and complexity science.
  arXiv  Detail & Related papers  (2023-06-23T18:10:54Z)
• Adversarial Interaction Attack: Fooling AI to Misinterpret Human Intentions [46.87576410532481]
  We show that, despite their current huge success, deep learning based AI systems can be easily fooled by subtle adversarial noise. Based on a case study of skeleton-based human interactions, we propose a novel adversarial attack on interactions. Our study highlights potential risks in the interaction loop with AI and humans, which need to be carefully addressed when deploying AI systems in safety-critical applications.
  arXiv  Detail & Related papers  (2021-01-17T16:23:20Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.