SupermarQ: A Scalable Quantum Benchmark Suite

• URL: http://arxiv.org/abs/2202.11045v3
• Date: Wed, 27 Apr 2022 15:51:11 GMT
• Title: SupermarQ: A Scalable Quantum Benchmark Suite
• Authors: Teague Tomesh, Pranav Gokhale, Victory Omole, Gokul Subramanian Ravi, Kaitlin N. Smith, Joshua Viszlai, Xin-Chuan Wu, Nikos Hardavellas, Margaret R. Martonosi, Frederic T. Chong
• Abstract summary: SupermarQ is a scalable, hardware-agnostic quantum benchmark suite which uses application-level metrics to measure performance. SupermarQ is the first attempt to systematically apply techniques from classical benchmarking methodology to the quantum domain. We envision that quantum benchmarking will encompass a large cross-community effort built on open source, constantly evolving benchmark suites.
• Score: 3.6806897290408305
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The emergence of quantum computers as a new computational paradigm has been accompanied by speculation concerning the scope and timeline of their anticipated revolutionary changes. While quantum computing is still in its infancy, the variety of different architectures used to implement quantum computations make it difficult to reliably measure and compare performance. This problem motivates our introduction of SupermarQ, a scalable, hardware-agnostic quantum benchmark suite which uses application-level metrics to measure performance. SupermarQ is the first attempt to systematically apply techniques from classical benchmarking methodology to the quantum domain. We define a set of feature vectors to quantify coverage, select applications from a variety of domains to ensure the suite is representative of real workloads, and collect benchmark results from the IBM, IonQ, and AQT@LBNL platforms. Looking forward, we envision that quantum benchmarking will encompass a large cross-community effort built on open source, constantly evolving benchmark suites. We introduce SupermarQ as an important step in this direction.

Related papers

• Quantum Subroutine for Variance Estimation: Algorithmic Design and Applications [80.04533958880862]
  Quantum computing sets the foundation for new ways of designing algorithms. New challenges arise concerning which field quantum speedup can be achieved. Looking for the design of quantum subroutines that are more efficient than their classical counterpart poses solid pillars to new powerful quantum algorithms.
  arXiv  Detail & Related papers  (2024-02-26T09:32:07Z)
• Benchmarking a trapped-ion quantum computer with 30 qubits [0.2276773223605655]
  We benchmark a single-chain 30-qubit trapped-ion quantum computer with all-to-all operations. We build a system-level model to predict the application benchmarking data through direct simulation. This highlights that as quantum computers move toward larger and higher-quality devices, characterization becomes more challenging.
  arXiv  Detail & Related papers  (2023-08-09T17:02:55Z)
• Majorization-based benchmark of the complexity of quantum processors [105.54048699217668]
  We numerically simulate and characterize the operation of various quantum processors. We identify and assess quantum complexity by comparing the performance of each device against benchmark lines. We find that the majorization-based benchmark holds as long as the circuits' output states have, on average, high purity.
  arXiv  Detail & Related papers  (2023-04-10T23:01:10Z)
• Extending the Q-score to an Application-level Quantum Metric Framework [0.0]
  evaluating the performance of quantum devices is an important step towards scaling quantum devices and eventually using them in practice. A prominent quantum metric is given by the Q-score metric of Atos. We show that the Q-score defines a framework of quantum metrics, which allows benchmarking using different problems, user settings and solvers.
  arXiv  Detail & Related papers  (2023-02-01T18:03:13Z)
• Iterative Qubits Management for Quantum Index Searching in a Hybrid System [56.39703478198019]
  IQuCS aims at index searching and counting in a quantum-classical hybrid system. We implement IQuCS with Qiskit and conduct intensive experiments. Results demonstrate that it reduces qubits consumption by up to 66.2%.
  arXiv  Detail & Related papers  (2022-09-22T21:54:28Z)
• Anticipative measurements in hybrid quantum-classical computation [68.8204255655161]
  We present an approach where the quantum computation is supplemented by a classical result. Taking advantage of its anticipation also leads to a new type of quantum measurements, which we call anticipative. In an anticipative quantum measurement the combination of the results from classical and quantum computations happens only in the end.
  arXiv  Detail & Related papers  (2022-09-12T15:47:44Z)
• QPack Scores: Quantitative performance metrics for application-oriented quantum computer benchmarking [1.0323063834827415]
  This paper presents the benchmark score definitions of QPack, an application-oriented cross-platform benchmarking suite for quantum computers and simulators. A comparison is made between various quantum computer simulators, running both locally and on vendors' remote cloud services.
  arXiv  Detail & Related papers  (2022-05-24T15:18:24Z)
• Application-Oriented Performance Benchmarks for Quantum Computing [0.0]
  benchmarking suite is designed to be readily accessible to a broad audience of users. Our methodology is constructed to anticipate advances in quantum computing hardware that are likely to emerge in the next five years.
  arXiv  Detail & Related papers  (2021-10-07T01:45:06Z)
• Accelerating variational quantum algorithms with multiple quantum processors [78.36566711543476]
  Variational quantum algorithms (VQAs) have the potential of utilizing near-term quantum machines to gain certain computational advantages. Modern VQAs suffer from cumbersome computational overhead, hampered by the tradition of employing a solitary quantum processor to handle large data. Here we devise an efficient distributed optimization scheme, called QUDIO, to address this issue.
  arXiv  Detail & Related papers  (2021-06-24T08:18:42Z)
• QPack: Quantum Approximate Optimization Algorithms as universal benchmark for quantum computers [1.1602089225841632]
  We present QPack, a universal benchmark for Noisy Intermediate-Scale Quantum (NISQ) computers. QPack evaluates the maximum problem size a quantum computer can solve, the required runtime, as well as the achieved accuracy.
  arXiv  Detail & Related papers  (2021-03-31T16:20:51Z)
• Quantum circuit architecture search for variational quantum algorithms [88.71725630554758]
  We propose a resource and runtime efficient scheme termed quantum architecture search (QAS) QAS automatically seeks a near-optimal ansatz to balance benefits and side-effects brought by adding more noisy quantum gates. We implement QAS on both the numerical simulator and real quantum hardware, via the IBM cloud, to accomplish data classification and quantum chemistry tasks.
  arXiv  Detail & Related papers  (2020-10-20T12:06:27Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.