Reproducibility: The New Frontier in AI Governance

• URL: http://arxiv.org/abs/2510.11595v1
• Date: Mon, 13 Oct 2025 16:34:25 GMT
• Title: Reproducibility: The New Frontier in AI Governance
• Authors: Israel Mason-Williams, Gabryel Mason-Williams,
• Abstract summary: We argue that the current publication speeds in AI combined with the lack of strong scientific standards, via weak protocols, effectively erodes the power of policymakers to enact meaningful policy and governance protocols.<n>We evaluate the forthcoming crisis within AI research through the lens of crises in other scientific domains.<n>We argue that policymakers and governments must consider protocols as a core tool in the governance arsenal and demand higher standards for AI research.
• Score: 2.1485350418225244
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: AI policymakers are responsible for delivering effective governance mechanisms that can provide safe, aligned and trustworthy AI development. However, the information environment offered to policymakers is characterised by an unnecessarily low Signal-To-Noise Ratio, favouring regulatory capture and creating deep uncertainty and divides on which risks should be prioritised from a governance perspective. We posit that the current publication speeds in AI combined with the lack of strong scientific standards, via weak reproducibility protocols, effectively erodes the power of policymakers to enact meaningful policy and governance protocols. Our paper outlines how AI research could adopt stricter reproducibility guidelines to assist governance endeavours and improve consensus on the AI risk landscape. We evaluate the forthcoming reproducibility crisis within AI research through the lens of crises in other scientific domains; providing a commentary on how adopting preregistration, increased statistical power and negative result publication reproducibility protocols can enable effective AI governance. While we maintain that AI governance must be reactive due to AI's significant societal implications we argue that policymakers and governments must consider reproducibility protocols as a core tool in the governance arsenal and demand higher standards for AI research. Code to replicate data and figures: https://github.com/IFMW01/reproducibility-the-new-frontier-in-ai-governance

Related papers

• Responsible AI: The Good, The Bad, The AI [1.932555230783329]
  This paper presents a comprehensive examination of AI's dual nature through the lens of strategic information systems.<n>We develop the Paradox-based Responsible AI Governance (PRAIG) framework that articulates: (1) the strategic benefits of AI adoption, (2) the inherent risks and unintended consequences, and (3) governance mechanisms that enable organizations to navigate these tensions.<n>The paper concludes with a research agenda for advancing responsible AI governance scholarship.
  arXiv  Detail & Related papers  (2026-01-28T22:33:27Z)
• Never Compromise to Vulnerabilities: A Comprehensive Survey on AI Governance [211.5823259429128]
  We propose a comprehensive framework integrating technical and societal dimensions, structured around three interconnected pillars: Intrinsic Security, Derivative Security, and Social Ethics.<n>We identify three core challenges: (1) the generalization gap, where defenses fail against evolving threats; (2) inadequate evaluation protocols that overlook real-world risks; and (3) fragmented regulations leading to inconsistent oversight.<n>Our framework offers actionable guidance for researchers, engineers, and policymakers to develop AI systems that are not only robust and secure but also ethically aligned and publicly trustworthy.
  arXiv  Detail & Related papers  (2025-08-12T09:42:56Z)
• Advancing Science- and Evidence-based AI Policy [163.43609502905707]
  This paper tackles the problem of how to optimize the relationship between evidence and policy to address the opportunities and challenges of AI.<n>An increasing number of efforts address this problem by often either (i) contributing research into the risks of AI and their effective mitigation or (ii) advocating for policy to address these risks.
  arXiv  Detail & Related papers  (2025-08-02T23:20:58Z)
• The California Report on Frontier AI Policy [110.35302787349856]
  Continued progress in frontier AI carries the potential for profound advances in scientific discovery, economic productivity, and broader social well-being.<n>As the epicenter of global AI innovation, California has a unique opportunity to continue supporting developments in frontier AI.<n>Report derives policy principles that can inform how California approaches the use, assessment, and governance of frontier AI.
  arXiv  Detail & Related papers  (2025-06-17T23:33:21Z)
• The AI Imperative: Scaling High-Quality Peer Review in Machine Learning [49.87236114682497]
  We argue that AI-assisted peer review must become an urgent research and infrastructure priority.<n>We propose specific roles for AI in enhancing factual verification, guiding reviewer performance, assisting authors in quality improvement, and supporting ACs in decision-making.
  arXiv  Detail & Related papers  (2025-06-09T18:37:14Z)
• HH4AI: A methodological Framework for AI Human Rights impact assessment under the EUAI ACT [1.7754875105502606]
  The paper highlights AIs transformative nature, driven by autonomy, data, and goal-oriented design.<n>A key challenge is defining and assessing "high-risk" AI systems across industries.<n>It proposes a Fundamental Rights Impact Assessment (FRIA) methodology, a gate-based framework designed to isolate and assess risks.
  arXiv  Detail & Related papers  (2025-03-23T19:10:14Z)
• Transfeminist AI Governance [0.0]
  Article re-imagines the governance of artificial intelligence (AI) through a transfeminist lens.<n>Building upon trans and feminist theories of ethics, I introduce an approach to transfeminist AI governance.
  arXiv  Detail & Related papers  (2025-03-19T20:25:59Z)
• Media and responsible AI governance: a game-theoretic and LLM analysis [61.132523071109354]
  This paper investigates the interplay between AI developers, regulators, users, and the media in fostering trustworthy AI systems.<n>Using evolutionary game theory and large language models (LLMs), we model the strategic interactions among these actors under different regulatory regimes.
  arXiv  Detail & Related papers  (2025-03-12T21:39:38Z)
• AI and the Transformation of Accountability and Discretion in Urban Governance [1.9152655229960793]
  The study synthesizes insights to propose guiding principles for responsible AI integration in decision-making processes.<n>The analysis argues that AI does not simply restrict or enhance discretion but redistributes it across institutional levels.<n>It may simultaneously strengthen managerial oversight, enhance decision-making consistency, and improve operational efficiency.
  arXiv  Detail & Related papers  (2025-02-18T18:11:39Z)
• Generative AI Needs Adaptive Governance [0.0]
  generative AI challenges the notions of governance, trust, and human agency. This paper argues that generative AI calls for adaptive governance. We outline actors, roles, as well as both shared and actors-specific policy activities.
  arXiv  Detail & Related papers  (2024-06-06T23:47:14Z)
• Managing extreme AI risks amid rapid progress [171.05448842016125]
  We describe risks that include large-scale social harms, malicious uses, and irreversible loss of human control over autonomous AI systems. There is a lack of consensus about how exactly such risks arise, and how to manage them. Present governance initiatives lack the mechanisms and institutions to prevent misuse and recklessness, and barely address autonomous systems.
  arXiv  Detail & Related papers  (2023-10-26T17:59:06Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.