What Does the Credential Still Certify? Cognitive Stewardship for AI-Mediated Education
- URL: http://arxiv.org/abs/2607.19988v1
- Date: Wed, 22 Jul 2026 10:21:16 GMT
- Title: What Does the Credential Still Certify? Cognitive Stewardship for AI-Mediated Education
- Abstract summary: This paper develops a framework for AI-mediated assessment that links the learning claim, delegation boundary, evidence standard, and safeguards.<n>We then audit verified public generative AI assessment guidance from 30 universities.
- Score: 3.2940515388832963
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Generative AI is changing a basic premise of educational assessment: that submitted work can reliably evidence the human capacities a credential claims to certify. The challenge is not simply whether students use AI, but what remains inferable about learning when some cognitive work has been delegated to a system. This paper develops cognitive stewardship, a framework for AI-mediated assessment that links the learning claim, delegation boundary, evidence standard, and safeguards. We then audit verified public generative AI assessment guidance from 30 universities. Using a pre-specified scoring codebook--a written, source-grounded rubric--four open-weight LLM models applied the rubric as structured coders, with scores averaged to reduce dependence on any single model's bias. The audit shows that public policies are becoming better at classifying AI use than at explaining what evidence and protections preserve credential validity. Boundaries are more visible than evidence standards; safeguards are uneven; and guidance is clearest when AI use resembles final-output substitution rather than feedback, access, verification, or professional workflow. The takeaway is that permission categories are necessary but insufficient. Universities need policies that make the certification logic visible: what learners may delegate, what they must still demonstrate, and how institutions will protect fair evidence rather than merely monitor AI use.
Related papers
- From Protocols to Evidence: Bounded Claims for AI in Service of the Common Good [30.6027944662133]
Claims that Artificial Intelligence systems improve decisions can exceed what their evaluation establishes.<n>We develop a rupture test that evaluates deployment against explicit human and non-AI baselines.<n>We distinguish evidence-bounded deployment, which limits claims to what has been evaluated, from measurement-bounded governance.
arXiv Detail & Related papers (2026-09-10T17:56:36Z) - Evaluation in the Age of AI: Output as Evidence of Learning [0.0]
The rapid adoption of artificial intelligence (AI) has disrupted how learning is demonstrated and evaluated in higher education.<n>This paper examines the ethical challenges of educational evaluation in the age of AI from a university-level perspective.
arXiv Detail & Related papers (2026-08-23T23:40:30Z) - When AI Does the Work, What Is Learning For? Post-Instrumental Learning and the Risk of Capacity Dissolution [3.2940515388832963]
Existing AI ethics rightly emphasizes present failures.<n>But if the case for learning rests only on those failures, then each technical improvement appears to weaken it.<n>Using the idealization of AI that executes specified tasks flawlessly while lacking authority over purposes, legitimacy, and responsibility, we argue for post-instrumental learning.
arXiv Detail & Related papers (2026-07-30T11:24:56Z) - Framing, Judging, Steering: An Assessable Competency Model for Teach-ing Students to Reason With Generative AI [47.027290803102666]
We propose CoRe-3 (Co-Reasoning), a competency model factoring productive AI use into three assessable skills.<n>We ground the skills in theory, state five testable propositions, and instantiate them in CoReasoningLab.<n>Human-rater agreement and outcomes are next; we release the instrument, data, and protocol.
arXiv Detail & Related papers (2026-06-04T10:25:31Z) - Characterizing initial human-AI proof formalization workflows [66.06866890889131]
Advances in AI systems' ability to generate code and engage in increasingly high-level mathematical reasoning promise to transform people's ability to formalize and thereby verify proofs.<n>We conduct a mixed-methods analysis into the initial impact of AI on people's formalization.<n>A qualitative survey shows that people's preferences are diverse, but with a general desire for AI assistance in formalization.
arXiv Detail & Related papers (2026-06-02T22:58:19Z) - Jobs' AI Exposure Should Be Measured from Evidence, Not Model Priors [2.4724375110574304]
Job exposure to AI should be measured with grounded, evidence-based methods.<n>Current theoretical exposure measures use zero-shot prompting to classify task-level AI exposure.<n>We propose a retrieval-augmented framework that assigns AI exposure labels to all 18,796 occupation--task pairs in O*NET 30.2.
arXiv Detail & Related papers (2026-05-14T23:29:42Z) - Making AI-Assisted Grant Evaluation Auditable without Exposing the Model [0.0]
We propose a TEE-based architecture that helps reconcile requirements through remote attestation.<n>The architecture allows an external verifier to check which model, rubric, prompt template, and input representation were used.<n>We position the design relative to confidential AI inference, attestable AI audits, zero-knowledge machine learning, algorithmic accountability, and AI-assisted peer review.
arXiv Detail & Related papers (2026-04-28T04:10:04Z) - When AI reviews science: Can we trust the referee? [73.47745294608072]
We map attacks across the review lifecycle -- training and data retrieval, desk review, deep review, rebuttal, and system-level.<n>We use two advanced LLM-based referees to isolate the causal effects of prestige framing, assertion strength, rebuttal sycophancy, and contextual poisoning on review scores.
arXiv Detail & Related papers (2026-04-26T08:03:32Z) - CoCoNUTS: Concentrating on Content while Neglecting Uninformative Textual Styles for AI-Generated Peer Review Detection [60.52240468810558]
We introduce CoCoNUTS, a content-oriented benchmark built upon a fine-grained dataset of AI-generated peer reviews.<n>We also develop CoCoDet, an AI review detector via a multi-task learning framework, to achieve more accurate and robust detection of AI involvement in review content.
arXiv Detail & Related papers (2025-08-28T06:03:11Z) - The Impact of AI on Educational Assessment: A Framework for Constructive Alignment [0.0]
We argue that AI influences learning objectives of different Bloom levels in a different way.<n>We propose structured guidelines on a university or faculty level, to foster alignment among the staff.
arXiv Detail & Related papers (2025-06-30T13:02:01Z) - The AI Imperative: Scaling High-Quality Peer Review in Machine Learning [49.87236114682497]
We argue that AI-assisted peer review must become an urgent research and infrastructure priority.<n>We propose specific roles for AI in enhancing factual verification, guiding reviewer performance, assisting authors in quality improvement, and supporting ACs in decision-making.
arXiv Detail & Related papers (2025-06-09T18:37:14Z) - Using AI Alignment Theory to understand the potential pitfalls of regulatory frameworks [55.2480439325792]
This paper critically examines the European Union's Artificial Intelligence Act (EU AI Act)
Uses insights from Alignment Theory (AT) research, which focuses on the potential pitfalls of technical alignment in Artificial Intelligence.
As we apply these concepts to the EU AI Act, we uncover potential vulnerabilities and areas for improvement in the regulation.
arXiv Detail & Related papers (2024-10-10T17:38:38Z) - Certification Labels for Trustworthy AI: Insights From an Empirical
Mixed-Method Study [0.0]
This study empirically investigated certification labels as a promising solution.
We demonstrate that labels can significantly increase end-users' trust and willingness to use AI.
However, end-users' preferences for certification labels and their effect on trust and willingness to use AI were more pronounced in high-stake scenarios.
arXiv Detail & Related papers (2023-05-15T09:51:10Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.