Hybrid Quantum-HPC Middleware Systems for Adaptive Resource, Workload and Task Management

• URL: http://arxiv.org/abs/2604.03445v1
• Date: Fri, 03 Apr 2026 20:37:06 GMT
• Title: Hybrid Quantum-HPC Middleware Systems for Adaptive Resource, Workload and Task Management
• Abstract summary: This paper presents an abstraction-based approach for adaptive resource, workload, and task management in hybrid quantum- HPC systems.<n>We make four contributions: (i) a conceptual four-layer architecture that decomposes management across workflow, workload, task, and resource levels, enabling application-aware scheduling over heterogeneous quantum- HPC resources; (ii) a set of execution motifs capturing interaction and coupling characteristics of hybrid applications, realized as quantum mini-apps for systematic workload characterization; (iii) Pilot-Quantum, a framework built on the pilot runtime that enables late binding and dynamic resource allocation; and (iv) Q-Dream
• Score: 1.1775814290229856
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Hybrid quantum-classical applications pose significant resource management challenges due to heterogeneity and dynamism in both infrastructure and workloads. Quantum-HPC environments integrate quantum processing units (QPUs) with diverse classical resources (CPUs, GPUs), while applications span coupling patterns from tightly coupled execution to loosely coupled task parallelism with varying resource requirements. Traditional HPC schedulers lack visibility into application semantics and cannot respond to fluctuating resource availability at runtime. This paper presents a middleware-based approach for adaptive resource, workload, and task management in hybrid quantum-HPC systems. We make four contributions: (i) a conceptual four-layer middleware architecture that decomposes management across workflow, workload, task, and resource levels, enabling application-aware scheduling over heterogeneous quantum-HPC resources; (ii) a set of execution motifs capturing interaction and coupling characteristics of hybrid applications, realized as quantum mini-apps for systematic workload characterization; (iii) Pilot-Quantum, a middleware framework built on the pilot abstraction that enables late binding and dynamic resource allocation, adapting to resource and workload dynamics at runtime; and (iv) Q-Dreamer, a performance modeling toolkit providing reusable components for informed workload partitioning, including a circuit-cutting optimizer that analytically derives optimal partitioning strategies. Evaluation on heterogeneous HPC platforms (Perlmutter, NVIDIA DGX with H100/B200 GPUs) demonstrates efficient multi-backend orchestration across CPUs, GPUs, and QPUs for diverse execution motifs. Q-Dreamer predicts optimal circuit cutting configurations with up to 82% accuracy.

Related papers

• Three ways to share a QPU: Scheduling strategies for hybrid Quantum-HPC applications [0.9023764564490087]
  We investigate three distinct methodologies for HPC-QC resource scheduling.<n>We show that time-based multiplexing, dynamic resource management, and workflow decomposition are most effective for hybrid jobs.<n>These findings underscore the practical viability of tailored scheduling strategies for hybrid HPC-QC environments.
  arXiv  Detail & Related papers  (2026-04-16T12:52:45Z)
• Scaling Hybrid Quantum-HPC Applications with the Quantum Framework [2.9218462389567823]
  Hybrid quantum-high performance computing is emerging as a key strategy for running quantum applications at scale.<n>We extend the Quantum Framework (QFw), a modular and HPC-aware orchestration layer, to integrate multiple local backends and a cloud-based quantum backend.<n>Using this integration, we execute a number of non-variational as well as variational workloads.
  arXiv  Detail & Related papers  (2025-09-17T22:58:43Z)
• VQC-MLPNet: An Unconventional Hybrid Quantum-Classical Architecture for Scalable and Robust Quantum Machine Learning [50.95799256262098]
  Variational quantum circuits (VQCs) hold promise for quantum machine learning but face challenges in expressivity, trainability, and noise resilience.<n>We propose VQC-MLPNet, a hybrid architecture where a VQC generates the first-layer weights of a classical multilayer perceptron during training, while inference is performed entirely classically.
  arXiv  Detail & Related papers  (2025-06-12T01:38:15Z)
• Quantum resources in resource management systems [30.432877421232842]
  This paper presents the design architecture and reference implementation for quantum resources control using existing workload management systems.<n>We introduce a suite of plugins for Slurm that enable integration of on-prem and cloud quantum computing resources into existing high-performance computing centers.
  arXiv  Detail & Related papers  (2025-06-11T16:29:49Z)
• Bridging Paradigms: Designing for HPC-Quantum Convergence [0.9360388224886863]
  We propose a hardware-agnostic software framework that supports both current intermediate-scale quantum devices and future fault-tolerant quantum computers.<n>The architecture includes a quantum gateway interface, standardized APIs for resource management, and robust scheduling mechanisms.<n>Key innovations include: (1) a unified resource management system that efficiently coordinates quantum and classical resources, (2) a flexible quantum programming interface that abstracts hardware-specific details, and (4) a comprehensive tool chain for quantum circuit optimization and execution.
  arXiv  Detail & Related papers  (2025-03-03T18:18:45Z)
• Pilot-Quantum: A Quantum-HPC Middleware for Resource, Workload and Task Management [1.381966718755792]
  Pilot-Quantum is designed to provide unified application-level management of resources and workloads across hybrid quantum-classical environments.<n>It implements the Pilot Abstraction conceptual model, originally developed for HPC, to manage resources, workloads, and tasks.
  arXiv  Detail & Related papers  (2024-12-24T15:55:46Z)
• AdaLog: Post-Training Quantization for Vision Transformers with Adaptive Logarithm Quantizer [54.713778961605115]
  Vision Transformer (ViT) has become one of the most prevailing fundamental backbone networks in the computer vision community. We propose a novel non-uniform quantizer, dubbed the Adaptive Logarithm AdaLog (AdaLog) quantizer.
  arXiv  Detail & Related papers  (2024-07-17T18:38:48Z)
• A Multi-Head Ensemble Multi-Task Learning Approach for Dynamical Computation Offloading [62.34538208323411]
  We propose a multi-head ensemble multi-task learning (MEMTL) approach with a shared backbone and multiple prediction heads (PHs) MEMTL outperforms benchmark methods in both the inference accuracy and mean square error without requiring additional training data.
  arXiv  Detail & Related papers  (2023-09-02T11:01:16Z)
• Elastic Entangled Pair and Qubit Resource Management in Quantum Cloud Computing [73.7522199491117]
  Quantum cloud computing (QCC) offers a promising approach to efficiently provide quantum computing resources. The fluctuations in user demand and quantum circuit requirements are challenging for efficient resource provisioning. We propose a resource allocation model to provision quantum computing and networking resources.
  arXiv  Detail & Related papers  (2023-07-25T00:38:46Z)
• Partitioning Distributed Compute Jobs with Reinforcement Learning and Graph Neural Networks [58.720142291102135]
  Large-scale machine learning models are bringing advances to a broad range of fields. Many of these models are too large to be trained on a single machine, and must be distributed across multiple devices. We show that maximum parallelisation is sub-optimal in relation to user-critical metrics such as throughput and blocking rate.
  arXiv  Detail & Related papers  (2023-01-31T17:41:07Z)
• Controllable Dynamic Multi-Task Architectures [92.74372912009127]
  We propose a controllable multi-task network that dynamically adjusts its architecture and weights to match the desired task preference as well as the resource constraints. We propose a disentangled training of two hypernetworks, by exploiting task affinity and a novel branching regularized loss, to take input preferences and accordingly predict tree-structured models with adapted weights.
  arXiv  Detail & Related papers  (2022-03-28T17:56:40Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.