A Taxonomy of Real Faults in Hybrid Quantum-Classical Architectures
- URL: http://arxiv.org/abs/2502.08739v1
- Date: Wed, 12 Feb 2025 19:20:29 GMT
- Title: A Taxonomy of Real Faults in Hybrid Quantum-Classical Architectures
- Abstract summary: We propose a taxonomy of faults in Hybrid Quantum-Classical architectures accompanied by a dataset of real faults.<n>We analysed over 5000 closed issues on GitHub and pre-selected 529 of them.<n>We cross-validated the classification and labels assigned to every fault between two of the authors.
- Score: 3.8233569758620063
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: With the popularity of Hybrid Quantum-Classical architectures, particularly noisy intermediate-scale quantum (NISQ) architectures, comes the need for quality assurance methods tailored to their specific faults. In this study, we propose a taxonomy of faults in Hybrid Quantum-Classical architectures accompanied by a dataset of real faults in the identified categories. To achieve this, we empirically analysed open-source repositories for fixed faults. We analysed over 5000 closed issues on GitHub and pre-selected 529 of them based on rigorously defined inclusion criteria. We selected 133 faults that we labelled around symptoms and the origin of the faults. We cross-validated the classification and labels assigned to every fault between two of the authors. As a result, we introduced a taxonomy of real faults in Hybrid Quantum-Classical architectures. Subsequently, we validated the taxonomy through interviews conducted with eleven developers. The taxonomy was dynamically updated throughout the cross-validation and interview processes. The final version was validated and discussed through surveys conducted with an independent group of domain experts to ensure its relevance and to gain further insights.
Related papers
- Structure Aware Neural Architecture Search for Mixture of Experts [3.100317701802537]
We propose an architecture search framework that makes the alignment between experts and the structure of the data emerge as a search variable.<n>We show that it coincides with the incomplete-data maximum likelihood of a latent-variable mixture, and solve it by a generalised Expectation-Maximisation procedure.<n>We prove that the iterates converge whenever the surrogate errors are summable, and that at every limit point no candidate the search produces improves the true objective.
arXiv Detail & Related papers (2026-08-30T14:37:23Z) - Cross-Ecosystem Bug Classification in Quantum Software [0.5735035463793009]
This paper presents a comparative study of 12,910 issues from Qiskit and 4,613 issues from 11 additional repositories, including Cirq and PyQuil.<n>Using a rule-based classification framework, we analyze bugs by type, category, severity, quality attributes, and quantum-specific subtypes.
arXiv Detail & Related papers (2026-08-04T06:04:44Z) - Coordination as an Architectural Layer for LLM-Based Multi-Agent Systems [0.0]
Multi-agent LLM systems fail in production at rates between 41% and 87%, mostly due to coordination defects.<n>We argue that coordination should be treated as a architectural layer, separable from agent logic and from information access.<n>We instantiate this with an information-controlled design on prediction markets.
arXiv Detail & Related papers (2026-05-05T02:56:44Z) - Domain-Aware Hybrid Quantum Learning via Correlation-Guided Circuit Design for Crime Pattern Analytics [54.3410887955176]
Crime pattern analysis is critical for law enforcement and predictive policing.<n>The surge in criminal activities from rapid urbanization creates high-dimensional, imbalanced datasets.<n>This study presents a quantum-classical comparison framework for crime analytics.
arXiv Detail & Related papers (2026-04-08T06:05:25Z) - GenAI for Systems: Recurring Challenges and Design Principles from Software to Silicon [62.2138479061386]
Generative AI is reshaping how computing systems are designed, optimized, and built, yet research remains fragmented across software, architecture, and chip design communities.<n>This paper takes a cross-stack perspective, examining how generative models are being applied from code generation and distributed runtimes through hardware design space exploration to RTL synthesis, physical layout, and verification.
arXiv Detail & Related papers (2026-02-16T22:45:33Z) - Encyclo-K: Evaluating LLMs with Dynamically Composed Knowledge Statements [78.87065404966002]
Existing benchmarks predominantly curate questions at the question level.<n>We propose Encyclo-K, a statement-based benchmark that rethinks benchmark construction from the ground up.
arXiv Detail & Related papers (2025-12-31T13:55:54Z) - Characterizing Bugs and Quality Attributes in Quantum Software: A Large-Scale Empirical Study [0.6445605125467574]
This study presents the first ecosystem-scale longitudinal analysis of software bugs across 123 open source quantum repositories from 2012 to 2024.<n>Full-stack libraries and compilers are the most bug-prone categories due to circuit, gate, and transpilation-related issues.<n>High-severity bugs cluster in cryptography, experimental computing, and compiler toolchains.
arXiv Detail & Related papers (2025-12-31T06:05:49Z) - Beyond Memorization: Reasoning-Driven Synthesis as a Mitigation Strategy Against Benchmark Contamination [77.69093448529455]
We present an empirical study using an infinitely scalable framework to synthesize research-level QA directly from arXiv papers.<n>We evaluate a lack of significant performance decay near knowledge cutoff dates for models of various sizes, developers, and release dates.<n>We hypothesize that the multi-step reasoning required by our synthesis pipeline offered additional complexity that goes deeper than shallow memorization.
arXiv Detail & Related papers (2025-08-26T16:41:37Z) - HySemRAG: A Hybrid Semantic Retrieval-Augmented Generation Framework for Automated Literature Synthesis and Methodological Gap Analysis [55.2480439325792]
HySemRAG is a framework that combines Extract, Transform, Load (ETL) pipelines with Retrieval-Augmented Generation (RAG)<n>System addresses limitations in existing RAG architectures through a multi-layered approach.
arXiv Detail & Related papers (2025-08-01T20:30:42Z) - Stochastic Entanglement Configuration for Constructive Entanglement Topologies in Quantum Machine Learning with Application to Cardiac MRI [0.0]
We introduce a novel entanglement configuration method that generates diverse entanglement topologies.<n>We identify a subspace of constructive entanglement configurations that boost hybrid model performance.<n>Using our method, 400 configurations were generated and evaluated in a hybrid QML for cardiac MRI disease classification.
arXiv Detail & Related papers (2025-07-15T15:12:59Z) - Diagnosing and Addressing Pitfalls in KG-RAG Datasets: Toward More Reliable Benchmarking [56.27361644734853]
Knowledge Graph Question Answering systems rely on high-quality benchmarks to evaluate complex multi-hop reasoning.<n>Despite their widespread use, popular datasets such as WebQSP and CWQ suffer from critical quality issues.<n>We introduce KGQAGen, an LLM-in-the-loop framework that systematically resolves these pitfalls.<n>Our findings advocate for more rigorous benchmark construction and position KGQAGen as a scalable framework for advancing KGQA evaluation.
arXiv Detail & Related papers (2025-05-29T14:44:52Z) - A Defect Taxonomy for Infrastructure as Code: A Replication Study [0.0]
Prior study developed such a taxonomy, but based it exclusively on the declarative language Puppet.<n>It remained unknown whether this taxonomy applies to programming language-based IaC tools like Pulumi, Terraform CDK, and AWS CDK.<n>We performed qualitative analysis on 3,364 defect-related commits from 285 open-source PL-IaC repositories.
arXiv Detail & Related papers (2025-05-02T20:18:55Z) - Enforcing Consistency and Fairness in Multi-level Hierarchical Classification with a Mask-based Output Layer [25.819440955594736]
We introduce a fair, model-agnostic layer designed to enforce taxonomy and optimize objectives, including consistency, fairness, and exact match.
Our evaluations demonstrate that the proposed layer not only improves the fairness of predictions but also enforces the taxonomy, resulting in consistent predictions and superior performance.
arXiv Detail & Related papers (2025-03-19T06:30:04Z) - ExpertGenQA: Open-ended QA generation in Specialized Domains [9.412082058055823]
ExpertGenQA is a protocol that combines few-shot learning with structured topic and style categorization to generate comprehensive domain-specific QA pairs.
We show that ExpertGenQA achieves twice the efficiency of baseline few-shot approaches while maintaining $94.4%$ topic coverage.
arXiv Detail & Related papers (2025-03-04T19:09:48Z) - When Quantum Meets Classical: Characterizing Hybrid Quantum-Classical Issues Discussed in Developer Forums [7.856941186056147]
Hybrid quantum-classical computing has emerged as a possible compromise that achieves the best of both worlds.<n>The study comprised a thorough analysis of 531 real-world issues faced by developers of hybrid applications.<n>We conclude by identifying recurring obstacles for developers of hybrid applications and actionable recommendations to overcome them.
arXiv Detail & Related papers (2024-11-25T19:32:01Z) - Self-supervised Topic Taxonomy Discovery in the Box Embedding Space [23.942807248774514]
This paper develops a Box embedding-based Topic Model (BoxTM) that maps words and topics into the box embedding space.
Our BoxTM explicitly infers upper-level topics based on correlation between specific topics.
Extensive experiments validate high-quality of the topic taxonomy learned by BoxTM.
arXiv Detail & Related papers (2024-08-27T13:19:32Z) - Unsupervised Graph Neural Architecture Search with Disentangled
Self-supervision [51.88848982611515]
Unsupervised graph neural architecture search remains unexplored in the literature.
We propose a novel Disentangled Self-supervised Graph Neural Architecture Search model.
Our model is able to achieve state-of-the-art performance against several baseline methods in an unsupervised manner.
arXiv Detail & Related papers (2024-03-08T05:23:55Z) - Characterizing Hybrid Causal Structures with the Exclusivity Graph
Approach [0.41942958779358674]
We extend a graph theoretical technique to explore classical, quantum, and no-signaling distributions in hybrid scenarios.
We show how with our method we can construct minimal Bell-like inequalities capable of simultaneously distinguishing classical, quantum, and no-signaling behaviors.
The demonstrated method will represent a powerful tool to study quantum networks and for applications in quantum information tasks.
arXiv Detail & Related papers (2023-12-29T19:44:38Z) - Pre-training Tensor-Train Networks Facilitates Machine Learning with Variational Quantum Circuits [70.97518416003358]
Variational quantum circuits (VQCs) hold promise for quantum machine learning on noisy intermediate-scale quantum (NISQ) devices.
While tensor-train networks (TTNs) can enhance VQC representation and generalization, the resulting hybrid model, TTN-VQC, faces optimization challenges due to the Polyak-Lojasiewicz (PL) condition.
To mitigate this challenge, we introduce Pre+TTN-VQC, a pre-trained TTN model combined with a VQC.
arXiv Detail & Related papers (2023-05-18T03:08:18Z) - Rethinking Bias Mitigation: Fairer Architectures Make for Fairer Face
Recognition [107.58227666024791]
Face recognition systems are widely deployed in safety-critical applications, including law enforcement.
They exhibit bias across a range of socio-demographic dimensions, such as gender and race.
Previous works on bias mitigation largely focused on pre-processing the training data.
arXiv Detail & Related papers (2022-10-18T15:46:05Z) - Shortcomings of Question Answering Based Factuality Frameworks for Error
Localization [51.01957350348377]
We show that question answering (QA)-based factuality metrics fail to correctly identify error spans in generated summaries.
Our analysis reveals a major reason for such poor localization: questions generated by the QG module often inherit errors from non-factual summaries which are then propagated further into downstream modules.
Our experiments conclusively show that there exist fundamental issues with localization using the QA framework which cannot be fixed solely by stronger QA and QG models.
arXiv Detail & Related papers (2022-10-13T05:23:38Z) - Bringing motion taxonomies to continuous domains via GPLVM on hyperbolic manifolds [8.385386712928785]
Human motion serves as high-level hierarchical abstractions that classify how humans move and interact with their environment.
We propose to model taxonomy data via hyperbolic embeddings that capture the associated hierarchical structure.
We show that our model properly encodes unseen data from existing or new taxonomy categories, and outperforms its Euclidean and VAE-based counterparts.
arXiv Detail & Related papers (2022-10-04T15:19:24Z) - When BERT Meets Quantum Temporal Convolution Learning for Text
Classification in Heterogeneous Computing [75.75419308975746]
This work proposes a vertical federated learning architecture based on variational quantum circuits to demonstrate the competitive performance of a quantum-enhanced pre-trained BERT model for text classification.
Our experiments on intent classification show that our proposed BERT-QTC model attains competitive experimental results in the Snips and ATIS spoken language datasets.
arXiv Detail & Related papers (2022-02-17T09:55:21Z) - Quantum Machine Learning with SQUID [64.53556573827525]
We present the Scaled QUantum IDentifier (SQUID), an open-source framework for exploring hybrid Quantum-Classical algorithms for classification problems.
We provide examples of using SQUID in a standard binary classification problem from the popular MNIST dataset.
arXiv Detail & Related papers (2021-04-30T21:34:11Z) - Coherent Hierarchical Multi-Label Classification Networks [56.41950277906307]
C-HMCNN(h) is a novel approach for HMC problems, which exploits hierarchy information in order to produce predictions coherent with the constraint and improve performance.
We conduct an extensive experimental analysis showing the superior performance of C-HMCNN(h) when compared to state-of-the-art models.
arXiv Detail & Related papers (2020-10-20T09:37:02Z) - Neural Ensemble Search for Uncertainty Estimation and Dataset Shift [67.57720300323928]
Ensembles of neural networks achieve superior performance compared to stand-alone networks in terms of accuracy, uncertainty calibration and robustness to dataset shift.
We propose two methods for automatically constructing ensembles with emphvarying architectures.
We show that the resulting ensembles outperform deep ensembles not only in terms of accuracy but also uncertainty calibration and robustness to dataset shift.
arXiv Detail & Related papers (2020-06-15T17:38:15Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.