Benchmarking Quantum Computers via Protocols, Comparing IBM's Heron vs IBM's Eagle

• URL: http://arxiv.org/abs/2603.04377v1
• Date: Wed, 04 Mar 2026 18:41:19 GMT
• Title: Benchmarking Quantum Computers via Protocols, Comparing IBM's Heron vs IBM's Eagle
• Authors: Nitay Mayo, Tal Mor, Yossi Weinstein,
• Abstract summary: We apply and extend a protocol-based benchmarking methodology that utilizes well-defined quantumness thresholds.<n>We compare two generations of IBM quantum computers: the older Eagle architecture and the newer Heron architecture.<n>Our findings reveal the genuine operational strengths and limitations of these devices, demonstrating substantial performance improvements in the newer Heron generation.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: As quantum computing hardware rapidly advances, objectively evaluating the capabilities and error rates of new processors remains a critical challenge for the field. A clear and realistic understanding of current quantum performance is essential to guide research priorities and drive meaningful progress. In this work, we apply and extend a protocol-based benchmarking methodology (presented in arXiv:2505.12441) that utilizes well-defined quantumness thresholds. By evaluating performance at protocol level rather then the gate level, this approach provides a transparent and intuitive assessment of whether specific quantum processors, or isolated sub-chips within them, can demonstrate a practical quantum advantage. To illustrate the utility of this method, we compare two generations of IBM quantum computers: the older Eagle architecture and the newer Heron architecture. Our findings reveal the genuine operational strengths and limitations of these devices, demonstrating substantial performance improvements in the newer Heron generation.

Related papers

• Optimized readout strategies for neutral atom quantum processors [5.5800582684268685]
  We develop a theoretical framework to quantify the trade-off between readout fidelity and atomic retention.<n>We introduce a metric of quantum circuit rate (qCIR) and employ normalized quantum Fisher information to characterize system overall performance.<n>Considering the experimentally feasible parameters for 87Rb atoms, we demonstrate that qCIRs of 197.2Hz and 154.5Hz are achievable.
  arXiv  Detail & Related papers  (2026-01-15T15:12:28Z)
• The EU Quantum Flagship's Key Performance Indicators for Quantum Computing [0.12099984425168675]
  We present a suite of scalable quantum computing benchmarks developed as key performance indicators (KPIs) within the EU Quantum Flagship.<n>These benchmarks are designed to assess holistic system performance rather than isolated components.
  arXiv  Detail & Related papers  (2025-12-22T18:30:06Z)
• Demonstration of Efficient Predictive Surrogates for Large-scale Quantum Processors [64.50565018996328]
  We introduce the concept of predictive surrogates, designed to emulate the mean-value behavior of a given quantum processor with provably computational efficiency.<n>We use these surrogates to emulate a quantum processor with up to 20 programmable superconducting qubits, enabling efficient pre-training of variational quantum eigensolvers.<n> Experimental results reveal that the predictive surrogates not only reduce measurement overhead by orders of magnitude, but can also surpass the performance of conventional, quantum-resource-intensive approaches.
  arXiv  Detail & Related papers  (2025-07-23T12:51:03Z)
• Quantum Executor: A Unified Interface for Quantum Computing [46.36953285198747]
  Quantum Executor is a backend-agnostic execution engine designed to orchestrate quantum experiments across heterogeneous platforms.<n>Key features include support for asynchronous and distributed execution, customizable execution strategies and a unified API for managing quantum experiments.
  arXiv  Detail & Related papers  (2025-07-10T09:55:32Z)
• VQC-MLPNet: An Unconventional Hybrid Quantum-Classical Architecture for Scalable and Robust Quantum Machine Learning [50.95799256262098]
  Variational quantum circuits (VQCs) hold promise for quantum machine learning but face challenges in expressivity, trainability, and noise resilience.<n>We propose VQC-MLPNet, a hybrid architecture where a VQC generates the first-layer weights of a classical multilayer perceptron during training, while inference is performed entirely classically.
  arXiv  Detail & Related papers  (2025-06-12T01:38:15Z)
• Quantum Compiler Design for Qubit Mapping and Routing: A Cross-Architectural Survey of Superconducting, Trapped-Ion, and Neutral Atom Systems [36.240273478884696]
  We review and categorize research on the qubit mapping and routing problems across the three mainstream quantum hardware platforms.<n>We primarily explore the development of hardware-aware compilers for superconducting platforms.<n>We examine the evolution of trapped-ion and neutral atom devices.
  arXiv  Detail & Related papers  (2025-05-22T16:49:57Z)
• A Practical Introduction to Benchmarking and Characterization of Quantum Computers [1.3895526819795618]
  QCVV methods and protocols enable scientists and engineers to scrutinize, understand, and enhance the performance of quantum information-processing devices.<n>This tutorial serves as a guidebook for researchers unfamiliar with the benchmarking and characterization of quantum computers.
  arXiv  Detail & Related papers  (2024-08-22T02:00:49Z)
• Benchmarking Quantum Computers: Towards a Standard Performance Evaluation Approach [0.7349727826230863]
  We review the most important aspects of both classical processor benchmarks and the metrics comprising them.<n>We analyze the intrinsic properties that characterize the paradigm of quantum computing.<n>We propose general guidelines for quantum benchmarking.
  arXiv  Detail & Related papers  (2024-07-15T17:39:59Z)
• Quantum Compiling with Reinforcement Learning on a Superconducting Processor [55.135709564322624]
  We develop a reinforcement learning-based quantum compiler for a superconducting processor. We demonstrate its capability of discovering novel and hardware-amenable circuits with short lengths. Our study exemplifies the codesign of the software with hardware for efficient quantum compilation.
  arXiv  Detail & Related papers  (2024-06-18T01:49:48Z)
• Parallel Quantum Computing Simulations via Quantum Accelerator Platform Virtualization [44.99833362998488]
  We present a model for parallelizing simulation of quantum circuit executions. The model can take advantage of its backend-agnostic features, enabling parallel quantum circuit execution over any target backend.
  arXiv  Detail & Related papers  (2024-06-05T17:16:07Z)
• A Quantum-Classical Collaborative Training Architecture Based on Quantum State Fidelity [50.387179833629254]
  We introduce a collaborative classical-quantum architecture called co-TenQu. Co-TenQu enhances a classical deep neural network by up to 41.72% in a fair setting. It outperforms other quantum-based methods by up to 1.9 times and achieves similar accuracy while utilizing 70.59% fewer qubits.
  arXiv  Detail & Related papers  (2024-02-23T14:09:41Z)
• Experimental Quantum Generative Adversarial Networks for Image Generation [93.06926114985761]
  We experimentally achieve the learning and generation of real-world hand-written digit images on a superconducting quantum processor. Our work provides guidance for developing advanced quantum generative models on near-term quantum devices.
  arXiv  Detail & Related papers  (2020-10-13T06:57:17Z)
• Design of a Quantum-Repeater using Quantum-Circuits and benchmarking its performance on an IBM Quantum-Computer [1.9447311464267876]
  We report the circuit-level implementation of a quantum repeater, and benchmark this protocol on IBM's cloud quantum computer - IBMQ. Our experiments indicate a 26% fidelity of shared bell-pairs for a complete on-chip quantum repeater with a yield of 49%.
  arXiv  Detail & Related papers  (2020-09-09T21:44:11Z)
• Programming a quantum computer with quantum instructions [39.994876450026865]
  We use a density matrixiation protocol to execute quantum instructions on quantum data. A fixed sequence of classically-defined gates performs an operation that uniquely depends on an auxiliary quantum instruction state. The utilization of quantum instructions obviates the need for costly tomographic state reconstruction and recompilation.
  arXiv  Detail & Related papers  (2020-01-23T22:43:29Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.