Socrates went Nuclear: Comparing Interaction Strategies for AI systems in a Learning Context using Brain Sensing

• URL: http://arxiv.org/abs/2609.00584v1
• Date: Tue, 01 Sep 2026 02:24:35 GMT
• Title: Socrates went Nuclear: Comparing Interaction Strategies for AI systems in a Learning Context using Brain Sensing
• Abstract summary: This paper reports on a study where we compare three designs for user-AI interaction in a learning context.<n>Fifty study participants were tasked with learning about nuclear safety protocols.
• Score: 66.03354630509942
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Does unrestricted AI access bypass the cognitive effort required for learning, or does it streamline knowledge acquisition? This paper reports on a study where we compare three designs for user-AI interaction in a learning context: (1) an unrestricted conversational bot like ChatGPT, (2) a pedagogically constrained bot that guides through hints without giving final answers, which we refer to as the Socratic mode; and (3) a non-conversational adaptive tutoring system that adjusts difficulty in real-time based on the user's cognitive engagement derived from the brain signals. Fifty study participants were tasked with learning about nuclear safety protocols, a domain chosen for its zero-prior knowledge baseline. The participants progressed through an instructional video, a pre-test, an AI-driven assessment phase, which varied in the three conditions, and an immediate post-test. The nature of the questions centered primarily on factual knowledge acquisition, but it still required participants to have a global understanding of the concepts in order to answer the questions correctly. A Muse headband was used to derive the cognitive engagement of all users in all conditions. The unrestricted chatbot produced higher learning gains (delta) than both constrained modes (p < .03, d > 0.80), while the adaptive condition generated significantly higher EEG engagement (p = .018). The cluster analysis of chatbot usage and discussion patterns by users showed that most participants in the unrestricted-mode adopted a direct answer-retrieval strategy, while participants in the Socratic-mode initially attempted to reason through the hints before progressively disengaging. Consequently, this also suggests that the success of the unrestricted AI is not an evidence of deeper learning, but rather a result of the immediate post-test evaluation after the training phase.

Related papers

• Mind2Dialogue: Training Human-Aware Language Models by Simulating User Mental States [72.77158276658636]
  Mind2Dialogue is a framework for simulating users' mental states and turning them into privileged supervision for human-aware training.<n>We first propose a psychology-guided simulator that preserves personal characteristics while updating mental states to generate coherent conversations.<n>Our privileged distillation then trains models on the Oracle's well-informed responses to assist users without direct access to their mental states at deployment.
  arXiv  Detail & Related papers  (2026-09-14T17:55:58Z)
• AI-Generated Interactive Fiction for Educational Use: A Pilot Study of Perceived Comprehensibility, Coherence, and Engagement [0.0]
  This paper presents a pilot user-centred evaluation of AI-generated interactive fiction (IF) for educational use in higher education.<n>We generated a controlled pool of scenarios and asked participants to play one generated episode and rate it on narrative clarity, story-content coherence, engagement, and length acceptance.
  arXiv  Detail & Related papers  (2026-08-11T11:41:05Z)
• Informal Learning Emerges in Everyday Human-LLM Interaction [74.53081471113929]
  We show that everyday human-LLM interaction contains measurable, selective and conditionally organized behavioural signatures of informal learning.<n>They shift AI evaluation from answer-delivery efficiency toward the preservation of cognitive opportunities for users to reason, test ideas and construct understanding.
  arXiv  Detail & Related papers  (2026-07-20T07:56:41Z)
• Regulating the AI Tutor: Intentions, Help-Seeking, and Self-Regulated Learning in Adolescent GenAI Use [2.024558551027881]
  This work-in-progress examines open-ended conversational data from 98 Grade-9 students across three German Gymnasium schools.<n>We collected pre-post domain knowledge, pre-chat learning needs, and self-reported cognitive load.<n>Although students overwhelmingly selected scaffolded support before the chat, their interactions were dominated by instrumental requests.
  arXiv  Detail & Related papers  (2026-06-07T10:47:52Z)
• Framing, Judging, Steering: An Assessable Competency Model for Teach-ing Students to Reason With Generative AI [47.027290803102666]
  We propose CoRe-3 (Co-Reasoning), a competency model factoring productive AI use into three assessable skills.<n>We ground the skills in theory, state five testable propositions, and instantiate them in CoReasoningLab.<n>Human-rater agreement and outcomes are next; we release the instrument, data, and protocol.
  arXiv  Detail & Related papers  (2026-06-04T10:25:31Z)
• The Role of Instructional Guidance in Generative AI-Assisted Learning: Empirical Evidence from Construction Engineering Education [2.856083627975759]
  This study examines how instructional guidance shapes student and AI interaction in construction education.<n>A five-step prompting framework grounded in Generative Learning Theory is introduced to guide learner interaction.
  arXiv  Detail & Related papers  (2026-06-03T23:27:46Z)
• Characterizing initial human-AI proof formalization workflows [66.06866890889131]
  Advances in AI systems' ability to generate code and engage in increasingly high-level mathematical reasoning promise to transform people's ability to formalize and thereby verify proofs.<n>We conduct a mixed-methods analysis into the initial impact of AI on people's formalization.<n>A qualitative survey shows that people's preferences are diverse, but with a general desire for AI assistance in formalization.
  arXiv  Detail & Related papers  (2026-06-02T22:58:19Z)
• Reimagining Assessment in the Age of Generative AI: Lessons from Open-Book Exams with ChatGPT [1.2183405753834562]
  Generative AI systems such as ChatGPT challenge traditional assumptions about academic assessment by enabling students to generate explanations, code, and solutions in real time.<n>Rather than attempting to restrict AI use, this study investigates how students actually interact with such systems during formal evaluation.
  arXiv  Detail & Related papers  (2026-05-12T16:33:33Z)
• Supporting Students' Reading and Cognition with AI [12.029238454394445]
  We analyzed text from 124 sessions with AI tools to understand users' reading processes and cognitive engagement.<n>We propose design implications for future AI reading-support systems, including structured scaffolds for lower-level cognitive tasks.<n>We advocate for adaptive, human-in-the-loop features that allow students and instructors to tailor their reading experiences with AI.
  arXiv  Detail & Related papers  (2025-04-07T17:51:27Z)
• Quiz-based Knowledge Tracing [61.9152637457605]
  Knowledge tracing aims to assess individuals' evolving knowledge states according to their learning interactions. QKT achieves state-of-the-art performance compared to existing methods.
  arXiv  Detail & Related papers  (2023-04-05T12:48:42Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.