Pilot-Quantum: A Quantum-HPC Middleware for Resource, Workload and Task Management
- URL: http://arxiv.org/abs/2412.18519v2
- Date: Fri, 27 Dec 2024 09:24:51 GMT
- Title: Pilot-Quantum: A Quantum-HPC Middleware for Resource, Workload and Task Management
- Authors: Pradeep Mantha, Florian J. Kiwit, Nishant Saurabh, Shantenu Jha, Andre Luckow,
- Abstract summary: Pilot-Quantum is designed to provide unified application-level management of resources and workloads across hybrid quantum-classical environments.
It implements the Pilot Abstraction conceptual model, originally developed for HPC, to manage resources, workloads, and tasks.
- Score: 1.381966718755792
- License:
- Abstract: As quantum hardware continues to scale, managing the heterogeneity of resources and applications -- spanning diverse quantum and classical hardware and software frameworks -- becomes increasingly critical. Pilot-Quantum addresses these challenges as a middleware designed to provide unified application-level management of resources and workloads across hybrid quantum-classical environments. It is built on a rigorous analysis of existing quantum middleware systems and application execution patterns. It implements the Pilot Abstraction conceptual model, originally developed for HPC, to manage resources, workloads, and tasks. It is designed for quantum applications that rely on task parallelism, including: (i) Hybrid algorithms, such as variational approaches, and (ii) Circuit cutting systems, used to partition and execute large quantum circuits. Pilot-Quantum facilitates seamless integration of quantum processing units (QPUs), classical CPUs, and GPUs, while supporting high-level programming frameworks like Qiskit and Pennylane. This enables users to design and execute hybrid workflows across diverse computing resources efficiently. The capabilities of Pilot-Quantum are demonstrated through mini-applications -- simplified yet representative kernels focusing on critical performance bottlenecks. We present several mini-apps, including circuit execution across hardware and simulator platforms (e.g., IBM's Eagle QPU), distributed state vector simulation, circuit cutting, and quantum machine learning workflows, demonstrating significant scale (e.g., a 41-qubit simulation on 256 GPUs) and speedups (e.g., 15x for QML, 3.5x for circuit cutting).
Related papers
- Ecosystem-Agnostic Standardization of Quantum Runtime Architecture: Accelerating Utility in Quantum Computing [0.0]
This research covers all layers of Quantum Computing Optimization Middleware (QCOM)
It requires execution on real quantum hardware (QH)
There is a need for a widely adopted runtime platform (RP) driven by the open-source community.
arXiv Detail & Related papers (2024-09-26T16:43:07Z) - A Framework for Integrating Quantum Simulation and High Performance Computing [0.0]
We describe a framework to help streamline access to quantum simulation software running on HPC resources.
This includes an interface for circuit-based quantum computing tasks, as well as the necessary resource management infrastructure.
arXiv Detail & Related papers (2024-08-15T11:48:14Z) - Quantum Compiling with Reinforcement Learning on a Superconducting Processor [55.135709564322624]
We develop a reinforcement learning-based quantum compiler for a superconducting processor.
We demonstrate its capability of discovering novel and hardware-amenable circuits with short lengths.
Our study exemplifies the codesign of the software with hardware for efficient quantum compilation.
arXiv Detail & Related papers (2024-06-18T01:49:48Z) - A Cross-Platform Execution Engine for the Quantum Intermediate Representation [1.4078224649226623]
We describe and demonstrate the QIR Execution Engine (QIR-EE) for parsing, interpreting, and executing QIR across multiple hardware platforms.
We demonstrate an implementation that uses the XACC quantum hardware-accelerator library to dispatch quantum programs on different commercial quantum platforms and numerical simulators.
arXiv Detail & Related papers (2024-04-22T15:59:41Z) - Benchmarking Quantum Computer Simulation Software Packages: State Vector Simulators [0.0]
We benchmark several software packages capable of simulating quantum dynamics with a special focus on HPC capabilities.
We develop a containerized toolchain for benchmarking a large set of simulation packages on a local HPC cluster using different parallelisation capabilities.
Our results can help finding the right package for a given simulation task and lay the foundation for a systematic community effort to benchmark and validate upcoming versions of existing and also newly developed simulation packages.
arXiv Detail & Related papers (2024-01-17T09:34:28Z) - Cloud on-demand emulation of quantum dynamics with tensor networks [48.7576911714538]
We introduce a tensor network based emulator, simulating a programmable analog quantum processing unit (QPU)
The software package is fully integrated in a cloud platform providing a common interface for executing jobs on a HPC cluster as well as dispatching them to a QPU device.
arXiv Detail & Related papers (2023-02-10T14:08:05Z) - The Basis of Design Tools for Quantum Computing: Arrays, Decision
Diagrams, Tensor Networks, and ZX-Calculus [55.58528469973086]
Quantum computers promise to efficiently solve important problems classical computers never will.
A fully automated quantum software stack needs to be developed.
This work provides a look "under the hood" of today's tools and showcases how these means are utilized in them, e.g., for simulation, compilation, and verification of quantum circuits.
arXiv Detail & Related papers (2023-01-10T19:00:00Z) - Quantum simulation with just-in-time compilation [0.0]
We present a first attempt to perform circuit-based quantum simulation using the just-in-time (JIT) compilation technique.
Qibojit is a new module for the Qibo quantum computing framework, which uses a just-in-time compilation approach through Python.
arXiv Detail & Related papers (2022-03-16T18:00:00Z) - Parallel Simulation of Quantum Networks with Distributed Quantum State
Management [56.24769206561207]
We identify requirements for parallel simulation of quantum networks and develop the first parallel discrete event quantum network simulator.
Our contributions include the design and development of a quantum state manager that maintains shared quantum information distributed across multiple processes.
We release the parallel SeQUeNCe simulator as an open-source tool alongside the existing sequential version.
arXiv Detail & Related papers (2021-11-06T16:51:17Z) - QuaSiMo: A Composable Library to Program Hybrid Workflows for Quantum
Simulation [48.341084094844746]
We present a composable design scheme for the development of hybrid quantum/classical algorithms and for applications of quantum simulation.
We implement our design scheme using the hardware-agnostic programming language QCOR into the QuaSiMo library.
arXiv Detail & Related papers (2021-05-17T16:17:57Z) - Tensor Network Quantum Virtual Machine for Simulating Quantum Circuits
at Exascale [57.84751206630535]
We present a modernized version of the Quantum Virtual Machine (TNQVM) which serves as a quantum circuit simulation backend in the e-scale ACCelerator (XACC) framework.
The new version is based on the general purpose, scalable network processing library, ExaTN, and provides multiple quantum circuit simulators.
By combining the portable XACC quantum processors and the scalable ExaTN backend we introduce an end-to-end virtual development environment which can scale from laptops to future exascale platforms.
arXiv Detail & Related papers (2021-04-21T13:26:42Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.