Framework and Methodology for Verification of a Complex Scientific Simulation Software, Flash-X

• URL: http://arxiv.org/abs/2308.16180v1
• Date: Wed, 30 Aug 2023 17:57:37 GMT
• Title: Framework and Methodology for Verification of a Complex Scientific Simulation Software, Flash-X
• Authors: Akash Dhruv, Rajeev Jain, Jared O'Neal, Klaus Weide, Anshu Dubey
• Abstract summary: Computational science relies on scientific software as its primary instrument for scientific discovery. Scientific software verification can be especially difficult, as users typically need to modify the software as part of a scientific study. Here, we describe a methodology that we have developed for Flash-X, a community simulation software for multiple scientific domains.
• Score: 0.8437187555622163
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Computational science relies on scientific software as its primary instrument for scientific discovery. Therefore, similar to the use of other types of scientific instruments, correct software and the correct operation of the software is necessary for executing rigorous scientific investigations. Scientific software verification can be especially difficult, as users typically need to modify the software as part of a scientific study. Systematic methodologies for building test suites for scientific software are rare in the literature. Here, we describe a methodology that we have developed for Flash-X, a community simulation software for multiple scientific domains, that has composable components that can be permuted and combined in a multitude of ways to generate a wide range of applications. Ensuring sufficient code coverage by a test suite is particularly challenging due to this composability. Our methodology includes a consideration of trade-offs between meeting software quality goals, developer productivity, and meeting the scientific goals of the Flash-X user community.

Related papers

• Requirements Engineering for Research Software: A Vision [2.2217676348694213]
  Most researchers creating software for scientific purposes are not trained in Software Engineering. Research software is often developed ad hoc without following stringent processes. We describe how researchers elicit, document, and analyze requirements for research software.
  arXiv  Detail & Related papers  (2024-05-13T14:25:01Z)
• A Review of Neuroscience-Inspired Machine Learning [58.72729525961739]
  Bio-plausible credit assignment is compatible with practically any learning condition and is energy-efficient. In this paper, we survey several vital algorithms that model bio-plausible rules of credit assignment in artificial neural networks. We conclude by discussing the future challenges that will need to be addressed in order to make such algorithms more useful in practical applications.
  arXiv  Detail & Related papers  (2024-02-16T18:05:09Z)
• Ten simple rules for teaching sustainable software engineering [0.0]
  Developing high-quality research software requires scientists to develop a host of software development skills. There has been a growing importance placed on ensuring foundational and good development practices in computational research. Recent articles in the Ten Simple Rules collection have discussed the teaching of computer science and coding techniques to biology students. We advance this discussion by describing the specific steps for effectively teaching the necessary skills scientists need to develop sustainable software packages.
  arXiv  Detail & Related papers  (2024-02-07T10:16:20Z)
• SciCat: A Curated Dataset of Scientific Software Repositories [4.77982299447395]
  We introduce the SciCat dataset -- a comprehensive collection of Free-Libre Open Source Software (FLOSS) projects. Our approach involves selecting projects from a pool of 131 million deforked repositories from the World of Code data source. Our classification focuses on software designed for scientific purposes, research-related projects, and research support software.
  arXiv  Detail & Related papers  (2023-12-11T13:46:33Z)
• GFlowNets for AI-Driven Scientific Discovery [74.27219800878304]
  We present a new probabilistic machine learning framework called GFlowNets. GFlowNets can be applied in the modeling, hypotheses generation and experimental design stages of the experimental science loop. We argue that GFlowNets can become a valuable tool for AI-driven scientific discovery.
  arXiv  Detail & Related papers  (2023-02-01T17:29:43Z)
• KnowledgeShovel: An AI-in-the-Loop Document Annotation System for Scientific Knowledge Base Construction [46.56643271476249]
  KnowledgeShovel is an Al-in-the-Loop document annotation system for researchers to construct scientific knowledge bases. The design of KnowledgeShovel introduces a multi-step multi-modalAI collaboration pipeline to improve data accuracy while reducing the human burden. A follow-up user evaluation with 7 geoscience researchers shows that KnowledgeShovel can enable efficient construction of scientific knowledge bases with satisfactory accuracy.
  arXiv  Detail & Related papers  (2022-10-06T11:38:18Z)
• Automated Creation and Human-assisted Curation of Computable Scientific Models from Code and Text [2.3746609573239756]
  Domain experts cannot gain a complete understanding of the implementation of a scientific model if they are not familiar with the code. We develop a system for the automated creation and human-assisted curation of scientific models. We present experimental results obtained using a dataset of code and associated text derived from NASA's Hypersonic Aerodynamics website.
  arXiv  Detail & Related papers  (2022-01-28T17:31:38Z)
• Simulation Intelligence: Towards a New Generation of Scientific Methods [81.75565391122751]
  "Nine Motifs of Simulation Intelligence" is a roadmap for the development and integration of the essential algorithms necessary for a merger of scientific computing, scientific simulation, and artificial intelligence. We argue the motifs of simulation intelligence are interconnected and interdependent, much like the components within the layers of an operating system. We believe coordinated efforts between motifs offers immense opportunity to accelerate scientific discovery.
  arXiv  Detail & Related papers  (2021-12-06T18:45:31Z)
• Applications and Techniques for Fast Machine Learning in Science [11.578814969632552]
  This report builds on two workshops held by the Fast ML for Science community. It covers three main areas: applications for fast ML across a number of scientific domains, techniques for training and implementing performant and resource-efficient algorithms, and computing architectures, platforms, and technologies for deploying these algorithms. This report is intended to give plenty of examples and inspiration for scientific discovery through integrated and accelerated ML solutions.
  arXiv  Detail & Related papers  (2021-10-25T15:25:25Z)
• An Extensible Benchmark Suite for Learning to Simulate Physical Systems [60.249111272844374]
  We introduce a set of benchmark problems to take a step towards unified benchmarks and evaluation protocols. We propose four representative physical systems, as well as a collection of both widely used classical time-based and representative data-driven methods.
  arXiv  Detail & Related papers  (2021-08-09T17:39:09Z)
• A backend-agnostic, quantum-classical framework for simulations of chemistry in C++ [62.997667081978825]
  We present the XACC system-level quantum computing framework as a platform for prototyping, developing, and deploying quantum-classical software. A series of examples demonstrating some of the state-of-the-art chemistry algorithms currently implemented in XACC are presented.
  arXiv  Detail & Related papers  (2021-05-04T16:53:51Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.