Pilot-Quantum: A Quantum-HPC Middleware for Resource, Workload and Task Management

• URL: http://arxiv.org/abs/2412.18519v2
• Date: Fri, 27 Dec 2024 09:24:51 GMT
• Title: Pilot-Quantum: A Quantum-HPC Middleware for Resource, Workload and Task Management
• Authors: Pradeep Mantha, Florian J. Kiwit, Nishant Saurabh, Shantenu Jha, Andre Luckow,
• Abstract summary: Pilot-Quantum is designed to provide unified application-level management of resources and workloads across hybrid quantum-classical environments.<n>It implements the Pilot Abstraction conceptual model, originally developed for HPC, to manage resources, workloads, and tasks.
• Score: 1.381966718755792
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: As quantum hardware continues to scale, managing the heterogeneity of resources and applications -- spanning diverse quantum and classical hardware and software frameworks -- becomes increasingly critical. Pilot-Quantum addresses these challenges as a middleware designed to provide unified application-level management of resources and workloads across hybrid quantum-classical environments. It is built on a rigorous analysis of existing quantum middleware systems and application execution patterns. It implements the Pilot Abstraction conceptual model, originally developed for HPC, to manage resources, workloads, and tasks. It is designed for quantum applications that rely on task parallelism, including: (i) Hybrid algorithms, such as variational approaches, and (ii) Circuit cutting systems, used to partition and execute large quantum circuits. Pilot-Quantum facilitates seamless integration of quantum processing units (QPUs), classical CPUs, and GPUs, while supporting high-level programming frameworks like Qiskit and Pennylane. This enables users to design and execute hybrid workflows across diverse computing resources efficiently. The capabilities of Pilot-Quantum are demonstrated through mini-applications -- simplified yet representative kernels focusing on critical performance bottlenecks. We present several mini-apps, including circuit execution across hardware and simulator platforms (e.g., IBM's Eagle QPU), distributed state vector simulation, circuit cutting, and quantum machine learning workflows, demonstrating significant scale (e.g., a 41-qubit simulation on 256 GPUs) and speedups (e.g., 15x for QML, 3.5x for circuit cutting).

Related papers

• QAOA in Quantum Datacenters: Parallelization, Simulation, and Orchestration [0.0]
  We present a massively parallelized, automated QAOA workflow that automates problem decomposition, job generation, and high-performance simulation. Our framework simulator selection, optimize execution across distributed, heterogeneous resources, and provides a cloud-based infrastructure. We find that QAOA does not significantly degrade optimization performance and often outperforms classical solvers.
  arXiv  Detail & Related papers  (2025-03-08T14:30:00Z)
• Building a Software Stack for Quantum-HPC Integration [0.9360388224886863]
  We propose a hardware-agnostic software framework that supports both current intermediate-scale quantum devices and future fault-tolerant quantum computers. The architecture includes a quantum gateway interface, standardized APIs for resource management, and robust scheduling mechanisms. Key innovations include: (1) a unified resource management system that efficiently coordinates quantum and classical resources, (2) a flexible quantum programming interface that abstracts hardware-specific details, and (4) a comprehensive tool chain for quantum circuit optimization and execution.
  arXiv  Detail & Related papers  (2025-03-03T18:18:45Z)
• Ecosystem-Agnostic Standardization of Quantum Runtime Architecture: Accelerating Utility in Quantum Computing [0.0]
  This research covers all layers of Quantum Computing Optimization Middleware (QCOM) It requires execution on real quantum hardware (QH) There is a need for a widely adopted runtime platform (RP) driven by the open-source community.
  arXiv  Detail & Related papers  (2024-09-26T16:43:07Z)
• A Framework for Integrating Quantum Simulation and High Performance Computing [0.0]
  We describe a framework to help streamline access to quantum simulation software running on HPC resources. This includes an interface for circuit-based quantum computing tasks, as well as the necessary resource management infrastructure.
  arXiv  Detail & Related papers  (2024-08-15T11:48:14Z)
• Quantum Compiling with Reinforcement Learning on a Superconducting Processor [55.135709564322624]
  We develop a reinforcement learning-based quantum compiler for a superconducting processor. We demonstrate its capability of discovering novel and hardware-amenable circuits with short lengths. Our study exemplifies the codesign of the software with hardware for efficient quantum compilation.
  arXiv  Detail & Related papers  (2024-06-18T01:49:48Z)
• Benchmarking Quantum Computer Simulation Software Packages: State Vector Simulators [0.0]
  We benchmark several software packages capable of simulating quantum dynamics with a special focus on HPC capabilities. We develop a containerized toolchain for benchmarking a large set of simulation packages on a local HPC cluster using different parallelisation capabilities. Our results can help finding the right package for a given simulation task and lay the foundation for a systematic community effort to benchmark and validate upcoming versions of existing and also newly developed simulation packages.
  arXiv  Detail & Related papers  (2024-01-17T09:34:28Z)
• A Design Framework for the Simulation of Distributed Quantum Computing [2.969582361376132]
  Growing demand for large-scale quantum computers is pushing research on Distributed Quantum Computing (DQC) Recent experimental efforts have demonstrated some of the building blocks for such a design. DQC systems are clusters of quantum processing units connected by means of quantum network infrastructures.
  arXiv  Detail & Related papers  (2023-06-20T13:52:05Z)
• Cloud on-demand emulation of quantum dynamics with tensor networks [48.7576911714538]
  We introduce a tensor network based emulator, simulating a programmable analog quantum processing unit (QPU) The software package is fully integrated in a cloud platform providing a common interface for executing jobs on a HPC cluster as well as dispatching them to a QPU device.
  arXiv  Detail & Related papers  (2023-02-10T14:08:05Z)
• The Basis of Design Tools for Quantum Computing: Arrays, Decision Diagrams, Tensor Networks, and ZX-Calculus [55.58528469973086]
  Quantum computers promise to efficiently solve important problems classical computers never will. A fully automated quantum software stack needs to be developed. This work provides a look "under the hood" of today's tools and showcases how these means are utilized in them, e.g., for simulation, compilation, and verification of quantum circuits.
  arXiv  Detail & Related papers  (2023-01-10T19:00:00Z)
• Synergy Between Quantum Circuits and Tensor Networks: Short-cutting the Race to Practical Quantum Advantage [43.3054117987806]
  We introduce a scalable procedure for harnessing classical computing resources to provide pre-optimized initializations for quantum circuits. We show this method significantly improves the trainability and performance of PQCs on a variety of problems. By demonstrating a means of boosting limited quantum resources using classical computers, our approach illustrates the promise of this synergy between quantum and quantum-inspired models in quantum computing.
  arXiv  Detail & Related papers  (2022-08-29T15:24:03Z)
• Parallel Simulation of Quantum Networks with Distributed Quantum State Management [56.24769206561207]
  We identify requirements for parallel simulation of quantum networks and develop the first parallel discrete event quantum network simulator. Our contributions include the design and development of a quantum state manager that maintains shared quantum information distributed across multiple processes. We release the parallel SeQUeNCe simulator as an open-source tool alongside the existing sequential version.
  arXiv  Detail & Related papers  (2021-11-06T16:51:17Z)
• QuaSiMo: A Composable Library to Program Hybrid Workflows for Quantum Simulation [48.341084094844746]
  We present a composable design scheme for the development of hybrid quantum/classical algorithms and for applications of quantum simulation. We implement our design scheme using the hardware-agnostic programming language QCOR into the QuaSiMo library.
  arXiv  Detail & Related papers  (2021-05-17T16:17:57Z)
• Tensor Network Quantum Virtual Machine for Simulating Quantum Circuits at Exascale [57.84751206630535]
  We present a modernized version of the Quantum Virtual Machine (TNQVM) which serves as a quantum circuit simulation backend in the e-scale ACCelerator (XACC) framework. The new version is based on the general purpose, scalable network processing library, ExaTN, and provides multiple quantum circuit simulators. By combining the portable XACC quantum processors and the scalable ExaTN backend we introduce an end-to-end virtual development environment which can scale from laptops to future exascale platforms.
  arXiv  Detail & Related papers  (2021-04-21T13:26:42Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.