The GenAI Skill Bypass: Mapping Divergent Pathways of University Students and Staff AI Literacy
- URL: http://arxiv.org/abs/2607.05411v1
- Date: Wed, 10 Jun 2026 06:53:39 GMT
- Title: The GenAI Skill Bypass: Mapping Divergent Pathways of University Students and Staff AI Literacy
- Abstract summary: Higher education institutions are increasingly expected to ensure that both students and staff develop Generative AI (GenAI)<n>Current educational frameworks typically assume a linear progression of GenAI literacy.<n>This paper challenges such an assumption through a psychometric analysis of a taxonomy-based self-assessment instrument.
- Score: 0.9039347265533652
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: Higher education institutions are increasingly expected to ensure that both students and staff develop Generative AI (GenAI) literacies. In response, they are introducing professional development programs and embedding GenAI skills within student curricula. However, current educational frameworks typically assume a linear progression of GenAI literacy, implying that foundational technical understanding must precede creative application. This paper challenges such an assumption through a psychometric analysis of a taxonomy-based self-assessment instrument (n = 158). We applied Rasch measurement theory and Guttman ordering to map the latent perceived order of difficulty of GenAI skills across students, academics, and professional staff. Results reveal a fundamental divergence in perceived competence profiles: while academics follow a more traditional linear path, students exhibit an "inverted" profile, frequently mastering high-level creation tasks before acquiring foundational conceptual understanding. Furthermore, the correlation of skill difficulty between students and academics was weak (r = 0.188). We argue that this "skill bypass" creates a fragile sense of fluency, where high self-efficacy in prompting masks low literacy in AI mechanics. These findings challenge the "one-size-fits-all" curricula and provide the empirical basis for diagnostic-driven, modular interventions that foster genuine human-AI synergy.
Related papers
- Implementing GenAI-Supported Learning in Software Engineering and Computer Science Education using Bloom's Taxonomy [0.4306143768014156]
Generative AI adoption in software engineering education raises opportunities for learning support alongside concerns about superficial learning and academic integrity.<n>This study investigates how explicit instructional guidance aligned with Bloom's taxonomy supports responsible GenAI use in SE/CS education.
arXiv Detail & Related papers (2026-06-24T10:44:07Z) - Framing, Judging, Steering: An Assessable Competency Model for Teach-ing Students to Reason With Generative AI [47.027290803102666]
We propose CoRe-3 (Co-Reasoning), a competency model factoring productive AI use into three assessable skills.<n>We ground the skills in theory, state five testable propositions, and instantiate them in CoReasoningLab.<n>Human-rater agreement and outcomes are next; we release the instrument, data, and protocol.
arXiv Detail & Related papers (2026-06-04T10:25:31Z) - Characterizing initial human-AI proof formalization workflows [66.06866890889131]
Advances in AI systems' ability to generate code and engage in increasingly high-level mathematical reasoning promise to transform people's ability to formalize and thereby verify proofs.<n>We conduct a mixed-methods analysis into the initial impact of AI on people's formalization.<n>A qualitative survey shows that people's preferences are diverse, but with a general desire for AI assistance in formalization.
arXiv Detail & Related papers (2026-06-02T22:58:19Z) - The Pedagogy of AI Mistakes: Fostering Higher-Order Thinking [26.81026121718816]
We argue that instructors can engage students in the fundamental processes of higher-order thinking by framing AI as a learning companion''<n>We examine how structured interaction with AI-generated errors supports metacognitive engagement, reinforces disciplinary rigor, and relates to students' perceived AI literacy and subject-matter competency.
arXiv Detail & Related papers (2026-05-06T21:50:46Z) - Exploring Student Perception on Gen AI Adoption in Higher Education: A Descriptive Study [1.978884131103313]
This study examines how students perceive, use, and evaluate Generative Artificial Intelligence (GenAI)<n>Data were collected through a questionnaire administered to 436 postgraduate Computer Science students at the University of Hertfordshire.
arXiv Detail & Related papers (2026-03-29T17:19:39Z) - The next question after Turing's question: Introducing the Grow-AI test [51.56484100374058]
This study aims to extend the framework for assessing artificial intelligence, called GROW-AI.<n>GROW-AI is designed to answer the question "Can machines grow up?" -- a natural successor to the Turing Test.<n>The originality of the work lies in the conceptual transposition of the process of "growing" from the human world to that of artificial intelligence.
arXiv Detail & Related papers (2025-08-22T10:19:42Z) - The Agency Gap: How Generative AI Literacy Shapes Independent Writing after AI Support [4.013708138746962]
This study investigates the extent to which GenAI literacy predicts student writing performance in contexts that require self-initiation and regulation.<n>Writing was evaluated across insightfulness, visual data integration, organisation, linguistic quality, and critical thinking.
arXiv Detail & Related papers (2025-07-06T14:01:06Z) - From Recall to Reasoning: Automated Question Generation for Deeper Math Learning through Large Language Models [44.99833362998488]
We investigated the first steps for optimizing content creation for advanced math.<n>We looked at the ability of GenAI to produce high-quality practice problems that are relevant to the course content.
arXiv Detail & Related papers (2025-05-17T08:30:10Z) - Evaluating the AI-Lab Intervention: Impact on Student Perception and Use of Generative AI in Early Undergraduate Computer Science Courses [0.0]
Generative AI (GenAI) is rapidly entering computer science education.<n>Concerns about overreliance coexist with a gap in research on structured scaffolding to guide tool use in formal courses.<n>This study examines the impact of a dedicated "AI-Lab" intervention on undergraduate students.
arXiv Detail & Related papers (2025-04-30T18:12:42Z) - Generative AI Literacy: Twelve Defining Competencies [48.90506360377104]
This paper introduces a competency-based model for generative artificial intelligence (AI) literacy covering essential skills and knowledge areas necessary to interact with generative AI.<n>The competencies range from foundational AI literacy to prompt engineering and programming skills, including ethical and legal considerations.<n>These twelve competencies offer a framework for individuals, policymakers, government officials, and educators looking to navigate and take advantage of the potential of generative AI responsibly.
arXiv Detail & Related papers (2024-11-29T14:55:15Z) - Hey GPT, Can You be More Racist? Analysis from Crowdsourced Attempts to Elicit Biased Content from Generative AI [41.96102438774773]
This work presents the findings from a university-level competition, which challenged participants to design prompts for eliciting biased outputs from GenAI tools.
We quantitatively and qualitatively analyze the competition submissions and identify a diverse set of biases in GenAI and strategies employed by participants to induce bias in GenAI.
arXiv Detail & Related papers (2024-10-20T18:44:45Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.