Exploring Quantum Software Testing Across Research and Practice: Emerging Results from a Multivocal Literature Review

• URL: http://arxiv.org/abs/2609.00354v1
• Date: Mon, 24 Aug 2026 02:39:24 GMT
• Title: Exploring Quantum Software Testing Across Research and Practice: Emerging Results from a Multivocal Literature Review
• Abstract summary: Our study integrated peer-reviewed studies with gray literature, including blogs, tutorials, forums, technical reports, documentation pages, and company webpages.<n>Our results indicate a rapidly evolving but fragmented ecosystem involving classical adapted testing approaches, quantum-specific techniques, statistical validation methods, simulators, debug environments, and verification frameworks.
• Score: 2.012425476229879
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: This paper presents preliminary findings from a multivocal literature review investigating how quantum software testing is characterized across academic and practitioner-oriented sources. Our study integrated peer-reviewed studies with gray literature, including blogs, tutorials, forums, technical reports, documentation pages, and company webpages. Our results indicate a rapidly evolving but fragmented ecosystem involving classical adapted testing approaches, quantum-specific techniques, statistical validation methods, simulators, debugging environments, and verification frameworks. The reviewed material also revealed recurring challenges related to scalability limitations, hardware noise, probabilistic execution, limited observability, and immature tooling ecosystems. These findings provide an initial characterization of how research and practice currently discuss quantum software testing challenges, techniques, and tooling.

Related papers

• PaperMind: Benchmarking Agentic Reasoning and Critique over Scientific Papers in Multimodal LLMs [68.27437550335709]
  We introduce PaperMind, a benchmark designed to evaluate integrated and agent-oriented scientific reasoning over research papers.<n>PaperMind is constructed from real scientific papers across seven domains, including agriculture, biology, chemistry, computer science, medicine, physics, and economics.<n>By analyzing model behavior across multiple tasks, PaperMind enables a diagnostic evaluation of integrated scientific reasoning behaviors.
  arXiv  Detail & Related papers  (2026-04-23T05:42:39Z)
• A Methodological Analysis of Empirical Studies in Quantum Software Testing [4.872319569157807]
  In quantum software engineering (QSE), quantum software testing (QST) has attracted increasing attention as quantum software systems grow in scale and complexity.<n>Since QST evaluates quantum programs through execution under designed test inputs, empirical studies are widely used to assess the effectiveness of testing approaches.<n>This paper presents a methodological analysis of empirical studies in QST through a systematic examination of 59 primary studies identified from a literature pool of size 384.
  arXiv  Detail & Related papers  (2026-01-13T09:29:00Z)
• Empirical Studies on Quantum Optimization for Software Engineering: A Systematic Analysis [8.44997508165897]
  Quantum, quantum-inspired, and hybrid algorithms are increasingly showing promise for solving software engineering optimization problems.<n>Best-intended practices for conducting empirical studies have not yet well established.
  arXiv  Detail & Related papers  (2025-10-31T02:28:11Z)
• Learning the physics of open quantum systems from experiments [55.2480439325792]
  This thesis explores adaptive inference as a tool to characterize quantum systems using experimental data.<n>I propose and test algorithms for learning Hamiltonian and Kraus operators using Bayesian experimental design and advanced Monte Carlo techniques.
  arXiv  Detail & Related papers  (2024-11-26T19:23:02Z)
• A Survey on Testing and Analysis of Quantum Software [21.351834312054844]
  We provide an extensive survey of the state of the art in testing and analysis of quantum software. We discuss literature from several research communities, including quantum computing, software engineering, programming languages, and formal methods.
  arXiv  Detail & Related papers  (2024-10-01T13:05:54Z)
• Ontology Embedding: A Survey of Methods, Applications and Resources [54.3453925775069]
  Onologies are widely used for representing domain knowledge and meta data.<n> logical reasoning that can directly support are quite limited in learning, approximation and prediction.<n>One straightforward solution is to integrate statistical analysis and machine learning.
  arXiv  Detail & Related papers  (2024-06-16T14:49:19Z)
• Testing Multi-Subroutine Quantum Programs: From Unit Testing to Integration Testing [2.8611507672161265]
  This paper addresses the specific testing requirements of multi-subroutine quantum programs. We focus on testing criteria and techniques based on the whole testing process perspective. We conduct comprehensive testing on typical quantum subroutines, including diverse mutants and randomized inputs.
  arXiv  Detail & Related papers  (2023-06-30T05:31:56Z)
• Faithfulness in Natural Language Generation: A Systematic Survey of Analysis, Evaluation and Optimization Methods [48.47413103662829]
  Natural Language Generation (NLG) has made great progress in recent years due to the development of deep learning techniques such as pre-trained language models. However, the faithfulness problem that the generated text usually contains unfaithful or non-factual information has become the biggest challenge.
  arXiv  Detail & Related papers  (2022-03-10T08:28:32Z)
• Deep Learning Schema-based Event Extraction: Literature Review and Current Trends [60.29289298349322]
  Event extraction technology based on deep learning has become a research hotspot. This paper fills the gap by reviewing the state-of-the-art approaches, focusing on deep learning-based models.
  arXiv  Detail & Related papers  (2021-07-05T16:32:45Z)
• Scaling up Search Engine Audits: Practical Insights for Algorithm Auditing [68.8204255655161]
  We set up experiments for eight search engines with hundreds of virtual agents placed in different regions. We demonstrate the successful performance of our research infrastructure across multiple data collections. We conclude that virtual agents are a promising venue for monitoring the performance of algorithms across long periods of time.
  arXiv  Detail & Related papers  (2021-06-10T15:49:58Z)
• Open Source Software for Efficient and Transparent Reviews [0.11179881480027788]
  ASReview is an open source machine learning-aided pipeline applying active learning. We demonstrate by means of simulation studies that ASReview can yield far more efficient reviewing than manual reviewing.
  arXiv  Detail & Related papers  (2020-06-22T11:57:10Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.