Platform-Agnostic Modular Architecture for Quantum Benchmarking

• URL: http://arxiv.org/abs/2510.08469v1
• Date: Thu, 09 Oct 2025 17:09:56 GMT
• Title: Platform-Agnostic Modular Architecture for Quantum Benchmarking
• Abstract summary: We present a platform-agnostic modular architecture that addresses the increasingly fragmented landscape of quantum computing benchmarking.<n>We support over 20 benchmark variants ranging from simple tests like Bernstein-Vazirani to complex Hamiltonian simulation with observable calculations.<n>This architecture has been developed as a key enhancement to the continually evolving QED-C Application-Oriented Performance Benchmarks for Quantum Computing suite.
• Score: 1.0654458441169534
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We present a platform-agnostic modular architecture that addresses the increasingly fragmented landscape of quantum computing benchmarking by decoupling problem generation, circuit execution, and results analysis into independent, interoperable components. Supporting over 20 benchmark variants ranging from simple algorithmic tests like Bernstein-Vazirani to complex Hamiltonian simulation with observable calculations, the system integrates with multiple circuit generation APIs (Qiskit, CUDA-Q, Cirq) and enables diverse workflows. We validate the architecture through successful integration with Sandia's $\textit{pyGSTi}$ for advanced circuit analysis and CUDA-Q for multi-GPU HPC simulations. Extensibility of the system is demonstrated by implementing dynamic circuit variants of existing benchmarks and a new quantum reinforcement learning benchmark, which become readily available across multiple execution and analysis modes. Our primary contribution is identifying and formalizing modular interfaces that enable interoperability between incompatible benchmarking frameworks, demonstrating that standardized interfaces reduce ecosystem fragmentation while preserving optimization flexibility. This architecture has been developed as a key enhancement to the continually evolving QED-C Application-Oriented Performance Benchmarks for Quantum Computing suite.

Related papers

• Architectural scaling tradeoffs in modular 3D bosonic quantum processors [60.61253784194378]
  We propose a three-dimensional bosonic quantum processor built from coupled-cavity modules linked by interconnect networks.<n>We compare nearest-neighbor, hub-based, and hybrid architectures in terms of interconnect count, communication distance, resource concentration, and implementation complexity.
  arXiv  Detail & Related papers  (2026-08-22T02:31:24Z)
• Software Between Quantum and Machine Learning -- And Down to Pulses [0.9569512179866463]
  We present a software framework that extends quantum machine learning (QML) methodologies to encompass pulse-level modelling.<n>The framework provides a comprehensive suite of modelling and analytical capabilities.<n>All performance-critical components are implemented in a high-performance environment using JAX and supported by a dedicated quantum simulator.
  arXiv  Detail & Related papers  (2026-05-20T15:20:07Z)
• Characterizing and Benchmarking Dynamic Quantum Circuits [1.341649735289308]
  dynamarq is a scalable and hardware-agnostic benchmarking framework for dynamic circuits.<n>We propose a broad set of circuit features to characterize the structure of these dynamic circuits.<n>Our framework provides insights for designing and optimizing dynamic circuits to achieve high execution fidelity on quantum hardware.
  arXiv  Detail & Related papers  (2026-04-03T17:31:12Z)
• UniDial-EvalKit: A Unified Toolkit for Evaluating Multi-Faceted Conversational Abilities [70.79422099851506]
  We present UniDial-EvalKit (UDE), a unified evaluation toolkit for assessing interactive AI systems.<n>UDE standardizes heterogeneous data formats into a universal schema, streamlines complex evaluation pipelines through a modular architecture, and aligns metric calculations under a consistent scoring interface.
  arXiv  Detail & Related papers  (2026-03-24T13:01:31Z)
• ODIN-Based CPU-GPU Architecture with Replay-Driven Simulation and Emulation [3.1001376169814656]
  Integration of CPU and GPU technologies is a key enabler for modern AI and graphics workloads.<n>This paper presents a replay-driven validation methodology developed during the integration of a CPU subsystem, multiple Xe GPU cores, and a Network-on-Chip (NoC)<n>By leveraging deterministic waveform capture and replay across both simulation and emulation using a single design database, complex GPU workloads and protocol sequences can be reproduced reliably at the system level.
  arXiv  Detail & Related papers  (2026-03-17T17:16:41Z)
• FTCircuitBench: A Benchmark Suite for Fault-Tolerant Quantum Compilation and Architecture [9.755713238528779]
  FTCircuitBench serves as a benchmark suite of impactful quantum algorithms.<n>A modular end-to-end pipeline allows users to compile and decompose algorithms for various fault-tolerant architectures.<n>A toolkit provides detailed numerical analysis at each stage.
  arXiv  Detail & Related papers  (2026-01-06T17:08:46Z)
• COMPAS: A Distributed Multi-Party SWAP Test for Parallel Quantum Algorithms [4.584616394519209]
  We introduce COMPAS, an architecture that realizes multivariate trace estimation across a multi-party network of interconnected modular and distributed QPUs.<n>Unlike other schemes, which must choose between optimality in circuit depth or GHZ width, COMPAS achieves both at once.<n>We analyze network-level errors and simulate the effects of circuit-level noise on the architecture.
  arXiv  Detail & Related papers  (2025-11-28T18:31:15Z)
• A2R: An Asymmetric Two-Stage Reasoning Framework for Parallel Reasoning [57.727084580884075]
  Asymmetric Two-Stage Reasoning framework designed to bridge gap between a model's potential and its actual performance.<n>A2R-Efficient is a "small-to-big" variant that combines a Qwen3-4B explorer with a Qwen3-8B synthesizer.<n>Results show A2R is not only a performance-boosting framework but also an efficient and practical solution for real-world applications.
  arXiv  Detail & Related papers  (2025-09-26T08:27:03Z)
• Scaling Hybrid Quantum-HPC Applications with the Quantum Framework [2.9218462389567823]
  Hybrid quantum-high performance computing is emerging as a key strategy for running quantum applications at scale.<n>We extend the Quantum Framework (QFw), a modular and HPC-aware orchestration layer, to integrate multiple local backends and a cloud-based quantum backend.<n>Using this integration, we execute a number of non-variational as well as variational workloads.
  arXiv  Detail & Related papers  (2025-09-17T22:58:43Z)
• EmuPlat: A Framework-Agnostic Platform for Quantum Hardware Emulation with Validated Transpiler-to-Pulse Pipeline [2.0785699263580475]
  EmuPlat is a framework-agnostic quantum hardware emulation platform.<n>It addresses the interoperability gap between high-level quantum programming frameworks and hardware-specific pulse control systems.<n>EmuPlat provides a unified infrastructure enabling seamless integration across diverse quantum computing ecosystems.
  arXiv  Detail & Related papers  (2025-09-16T03:56:23Z)
• Distributed Implementation of Variational Quantum Eigensolver to Solve QUBO Problems [0.0]
  We present a distributed algorithm and implementation of the variational quantum eigensolver (VQE)<n>DVQE enables the execution of parameterized quantum circuits across multiple quantum processing units (QPUs) in a distributed fashion.
  arXiv  Detail & Related papers  (2025-08-24T17:55:07Z)
• Towards System-Level Quantum-Accelerator Integration [3.4486179803947254]
  We propose a vertically integrated quantum systems architecture that treats quantum accelerators and processing units as peripheral system components.<n>A central element is the Quantum Abstraction Layer (QAL) at operating system kernel level.<n>We present first results towards such an integrated architecture, including a virtual QPU model based on QEMU.
  arXiv  Detail & Related papers  (2025-07-25T12:30:42Z)
• AsCAN: Asymmetric Convolution-Attention Networks for Efficient Recognition and Generation [48.82264764771652]
  We introduce AsCAN -- a hybrid architecture, combining both convolutional and transformer blocks. AsCAN supports a variety of tasks: recognition, segmentation, class-conditional image generation. We then scale the same architecture to solve a large-scale text-to-image task and show state-of-the-art performance.
  arXiv  Detail & Related papers  (2024-11-07T18:43:17Z)
• A Realistic Simulation Framework for Analog/Digital Neuromorphic Architectures [73.65190161312555]
  ARCANA is a software spiking neural network simulator designed to account for the properties of mixed-signal neuromorphic circuits.<n>We show how the results obtained provide a reliable estimate of the behavior of the spiking neural network trained in software, once deployed in hardware.
  arXiv  Detail & Related papers  (2024-09-23T11:16:46Z)
• AdaLog: Post-Training Quantization for Vision Transformers with Adaptive Logarithm Quantizer [54.713778961605115]
  Vision Transformer (ViT) has become one of the most prevailing fundamental backbone networks in the computer vision community. We propose a novel non-uniform quantizer, dubbed the Adaptive Logarithm AdaLog (AdaLog) quantizer.
  arXiv  Detail & Related papers  (2024-07-17T18:38:48Z)
• Mechanistic Design and Scaling of Hybrid Architectures [114.3129802943915]
  We identify and test new hybrid architectures constructed from a variety of computational primitives. We experimentally validate the resulting architectures via an extensive compute-optimal and a new state-optimal scaling law analysis. We find MAD synthetics to correlate with compute-optimal perplexity, enabling accurate evaluation of new architectures.
  arXiv  Detail & Related papers  (2024-03-26T16:33:12Z)
• MQBench: Towards Reproducible and Deployable Model Quantization Benchmark [53.12623958951738]
  MQBench is a first attempt to evaluate, analyze, and benchmark the and deployability for model quantization algorithms. We choose multiple platforms for real-world deployments, including CPU, GPU, ASIC, DSP, and evaluate extensive state-of-the-art quantization algorithms. We conduct a comprehensive analysis and find considerable intuitive or counter-intuitive insights.
  arXiv  Detail & Related papers  (2021-11-05T23:38:44Z)
• QuaSiMo: A Composable Library to Program Hybrid Workflows for Quantum Simulation [48.341084094844746]
  We present a composable design scheme for the development of hybrid quantum/classical algorithms and for applications of quantum simulation. We implement our design scheme using the hardware-agnostic programming language QCOR into the QuaSiMo library.
  arXiv  Detail & Related papers  (2021-05-17T16:17:57Z)
• Composable Programming of Hybrid Workflows for Quantum Simulation [48.341084094844746]
  We present a composable design scheme for the development of hybrid quantum/classical algorithms and for applications of quantum simulation. We implement our design scheme using the hardware-agnostic programming language QCOR into the QuaSiMo library.
  arXiv  Detail & Related papers  (2021-01-20T14:20:14Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.