Bridging the Gap on AI-Assisted Scientific Software Development Through Transparency and Traceability

• URL: http://arxiv.org/abs/2605.17675v1
• Date: Sun, 17 May 2026 22:08:52 GMT
• Title: Bridging the Gap on AI-Assisted Scientific Software Development Through Transparency and Traceability
• Abstract summary: Researchers are already using large language models to write code, generate test cases, and draft documentation.<n>This ad hoc, ungoverned use of AI represents a systemic risk to scientific software quality.<n>This paper proposes guidance for AI-assisted code development in the context of strict software quality assurance.
• Score: 4.466942018046944
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The widespread adoption of AI-assisted development in scientific software is not a future concern -- it is a present reality. Researchers are already using large language models to write code, generate test cases, and draft documentation, yet this practice remains largely unacknowledged and unguided in formal workflows and published work. This ad hoc, ungoverned use of AI represents a systemic risk to scientific software quality, particularly in safety-relevant modeling and simulation tools subject to strict Software Quality Assurance (SQA), or even Nuclear Quality Assurance Level 1 (NQA-1) standards, for which traceability, independent verification, and documented procedures are paramount. The question facing the scientific software community is, therefore, not whether to permit AI-assisted development, but how to govern it responsibly. This paper proposes guidance for AI-assisted code development in the context of strict software quality assurance. Using TMAP8 -- an open-source tritium migration code for fusion energy -- as a demonstration platform, we propose a structured framework for AI-assisted verification and validation (V&V) case development. V&V case development represents the ideal proving ground for establishing that governance: because validation cases have known solutions, correctness is objectively measurable, errors are identifiable by design, and the artifacts are fully auditable. The proposed guidance, developed based on practical experience described herein, operates within NQA-1 requirements, preserves human accountability, and establishes the disclosure and review standards that responsible AI-assisted scientific software development demands.

Related papers

• On Automated and Explainable Provenance of AI-Generated Code [56.818202904805446]
  We argue that the next generation of CodeGenAI tools must be built on a foundation of explainable provenance.<n>We describe a research program combining large-scale empirical studies with post-hoc causal and interpretability techniques.
  arXiv  Detail & Related papers  (2026-08-03T14:50:31Z)
• Cheap Code, Costly Judgment: A Case Study on Governable Agentic Software Engineering [8.368707686524482]
  We study how engineers organize architectures, tools, evidence, and feedback loops so that AI-mediated development remains inspectable, correctable, and maintainable.<n>We develop a theory of governance conversion, expressed as a process model explaining how high-velocity agentic implementation becomes governable.
  arXiv  Detail & Related papers  (2026-07-01T15:44:15Z)
• AI-driven Software Development: A Pragmatic Path to Agentic Development Processes [0.06423291545613526]
  Generative AI is transforming software development from localized tool support into development work that is embedded in processes, tools, and organizational structures.<n>This paper develops a pragmatic organizing framework for the transition toward AI-driven Software Development.
  arXiv  Detail & Related papers  (2026-06-13T12:43:38Z)
• Accountable Agents in Software Engineering: An Analysis of Terms of Service and a Research Roadmap [10.967845122224299]
  We present a comparative analysis of the Terms of Service for widely used AI coding assistants and agent-enabled development tools.<n>Our analysis reveals a consistent tendency to shift responsibility for correctness, safety, and legal compliance onto users.<n>We argue that existing policy frameworks are poorly aligned with increasingly agent-mediated and autonomous software development.
  arXiv  Detail & Related papers  (2026-05-06T06:18:59Z)
• Agentic AI-assisted coding offers a unique opportunity to instill epistemic grounding during software development [0.02058747290260746]
  Chat-based vibe coding has evolved into fully fledged AI-assisted, agentic software development using agent scaffolds.<n>One current trend is utilizing documents beyond this plan document, such as project and method-scoped documents.<n>Here we propose GROUNDING.md, a community-governed, field-scoped grounding document.
  arXiv  Detail & Related papers  (2026-04-23T14:50:35Z)
• Ten Simple Rules for AI-Assisted Coding in Science [2.6232508912640937]
  We provide ten practical rules for AI-assisted coding that balance leveraging capabilities of AI with maintaining scientific and methodological rigor.<n>These principles serve to emphasize maintaining human agency in coding decisions, establishing robust validation procedures, and preserving the domain expertise essential for methodologically sound research.
  arXiv  Detail & Related papers  (2025-10-25T11:16:01Z)
• A Survey of Vibe Coding with Large Language Models [93.88284590533242]
  "Vibe Coding" is a development methodology where developers validate AI-generated implementations through outcome observation.<n>Despite its transformative potential, the effectiveness of this emergent paradigm remains under-explored.<n>This survey provides the first comprehensive and systematic review of Vibe Coding with large language models.
  arXiv  Detail & Related papers  (2025-10-14T11:26:56Z)
• Safe and Certifiable AI Systems: Concepts, Challenges, and Lessons Learned [45.44933002008943]
  This white paper presents the T"UV AUSTRIA Trusted AI framework.<n>It is an end-to-end audit catalog and methodology for assessing and certifying machine learning systems.<n>Building on three pillars - Secure Software Development, Functional Requirements, and Ethics & Data Privacy - it translates the high-level obligations of the EU AI Act into specific, testable criteria.
  arXiv  Detail & Related papers  (2025-09-08T17:52:08Z)
• Cognitive Kernel-Pro: A Framework for Deep Research Agents and Agent Foundation Models Training [67.895981259683]
  General AI Agents are increasingly recognized as foundational frameworks for the next generation of artificial intelligence.<n>Current agent systems are either closed-source or heavily reliant on a variety of paid APIs and proprietary tools.<n>We present Cognitive Kernel-Pro, a fully open-source and (to the maximum extent) free multi-module agent framework.
  arXiv  Detail & Related papers  (2025-08-01T08:11:31Z)
• The AI Imperative: Scaling High-Quality Peer Review in Machine Learning [49.87236114682497]
  We argue that AI-assisted peer review must become an urgent research and infrastructure priority.<n>We propose specific roles for AI in enhancing factual verification, guiding reviewer performance, assisting authors in quality improvement, and supporting ACs in decision-making.
  arXiv  Detail & Related papers  (2025-06-09T18:37:14Z)
• Automated Machine Learning: A Case Study on Non-Intrusive Appliance Load Monitoring [81.06807079998117]
  We propose a novel approach to enable Automated Machine Learning (AutoML) for Non-Intrusive Appliance Load Monitoring (NIALM)<n>NIALM offers a cost-effective alternative to smart meters for measuring the energy consumption of electric devices and appliances.
  arXiv  Detail & Related papers  (2022-03-06T10:12:56Z)
• Empowered and Embedded: Ethics and Agile Processes [60.63670249088117]
  We argue that ethical considerations need to be embedded into the (agile) software development process. We put emphasis on the possibility to implement ethical deliberations in already existing and well established agile software development processes.
  arXiv  Detail & Related papers  (2021-07-15T11:14:03Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.