Reinforcement Learning for Robust Calibration of Multi-Qudit Quantum Gates

• URL: http://arxiv.org/abs/2604.19990v1
• Date: Tue, 21 Apr 2026 21:00:27 GMT
• Title: Reinforcement Learning for Robust Calibration of Multi-Qudit Quantum Gates
• Abstract summary: We propose a hybrid optimization framework that integrates optimal control theory methods with contextual deep reinforcement learning to achieve robust controlled-phase gates on two qutrits.<n>Our results establish reinforcement learning as a practical and scalable ingredient for robust calibration of quantum gates in high-dimensional systems.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Higher-dimensional quantum systems, such as qudits, offer architectural and algorithmic advantages over qubits, but their increased spectral crowding and limited controllability render high-fidelity quantum gates particularly challenging. We propose a hybrid optimization framework that integrates optimal control theory methods with contextual deep reinforcement learning to achieve robust controlled-phase gates on two qutrits. Optimal control is first used to design high-fidelity control pulses for a nominal system model. Reinforcement learning is then employed as a calibration stage that learns small residual corrections to these pulses in the presence of static model mismatch, thereby preserving good gate performance under realistic parameter uncertainties. By learning structured, low-dimensional residual corrections conditioned on device-specific parameter variations, reinforcement learning enhances the transfer robustness of nominally optimal but parameter-sensitive control solutions across ensembles of devices. Crucially, the reinforcement learning step in our framework does not compete with the optimal control step but provides the adaptability required for realistic hardware, systematically reducing the sensitivity to parameter fluctuations. Our results establish reinforcement learning as a practical and scalable ingredient for robust calibration of quantum gates in high-dimensional systems.

Related papers

• Intelligent Optimal Control of Rydberg Gates with Incremental-Update Deep Reinforcement Learning [10.771205594997445]
  We show a DRL-based framework for realizing Rydberg controlled-NOT gates with high speed and high fidelity.<n>By introducing an incremental-update learning policy, our framework effectively regularizes the exploration of the control landscape.<n>Our protocol achieves a peak average fidelity of 0.9991, significantly outperforming conventional methods and surpassing the critical fault-tolerant threshold.
  arXiv  Detail & Related papers  (2026-05-06T08:15:59Z)
• Decoupling Reasoning and Confidence: Resurrecting Calibration in Reinforcement Learning from Verifiable Rewards [71.19033708090389]
  Reinforcement Learning from Verifiable Rewards (RLVR) significantly enhances large language models (LLMs) reasoning but severely suffers from calibration degeneration.<n>We propose DCPO, a framework that systematically decouples reasoning and calibration objectives.
  arXiv  Detail & Related papers  (2026-03-10T02:47:59Z)
• Comparing and correcting robustness metrics for quantum optimal control [1.6927349660459692]
  We present a novel, systematic study demonstrating important numerical differences between adjoint end-point and toggling-frame approaches.<n>We also introduce a critical discretization correction to the widely-used robustness-frame estimator.<n>Our approach uniquely handles control and fidelity constraints while cleanly isolating robustness for dedicated optimization.
  arXiv  Detail & Related papers  (2026-02-10T22:44:16Z)
• Reinforcement Learning for Quantum Network Control with Application-Driven Objectives [53.03367590211247]
  Dynamic programming and reinforcement learning offer promising tools for optimizing control strategies.<n>We propose a novel RL framework that directly optimize non-linear, differentiable objective functions.<n>Our work comprises the first step towards non-linear objective function optimization in quantum networks with RL, opening a path towards more advanced use cases.
  arXiv  Detail & Related papers  (2025-09-12T18:41:10Z)
• TensorHyper-VQC: A Tensor-Train-Guided Hypernetwork for Robust and Scalable Variational Quantum Computing [50.95799256262098]
  We introduceHyper-VQC, a novel tensor-train (TT)-guided hypernetwork framework for quantum machine learning.<n>Our framework delegates the generation of quantum circuit parameters to a classical TT network, effectively decoupling optimization from quantum hardware.<n>These results positionHyper-VQC as a scalable and noise-resilient framework for advancing practical quantum machine learning on near-term devices.
  arXiv  Detail & Related papers  (2025-08-01T23:37:55Z)
• Using optimal control to guide neural-network interpolation of continuously-parameterized gates [1.989128176079823]
  We combine quantum optimal control with physics-informed machine learning to efficiently synthesize control surfaces that interpolate among gate families.<n>Our framework shows how accessible optimal control tools can be combined with simple machine learning to enable practitioners to achieve 3x speedups for their algorithms.
  arXiv  Detail & Related papers  (2024-12-09T16:16:18Z)
• Reinforcement learning pulses for transmon qubit entangling gates [0.0]
  We utilize a continuous-control reinforcement learning algorithm to design entangling two-qubit gates for superconducting qubits. We demonstrate the capability to generate novel pulse sequences that outperform the standard cross-resonance gates.
  arXiv  Detail & Related papers  (2023-11-07T03:19:19Z)
• Neural Networks with Quantization Constraints [111.42313650830248]
  We present a constrained learning approach to quantization training. We show that the resulting problem is strongly dual and does away with gradient estimations. We demonstrate that the proposed approach exhibits competitive performance in image classification tasks.
  arXiv  Detail & Related papers  (2022-10-27T17:12:48Z)
• Sparsity in Partially Controllable Linear Systems [56.142264865866636]
  We study partially controllable linear dynamical systems specified by an underlying sparsity pattern. Our results characterize those state variables which are irrelevant for optimal control.
  arXiv  Detail & Related papers  (2021-10-12T16:41:47Z)
• Integrated tool-set for Control, Calibration and Characterization of quantum devices applied to superconducting qubits [0.5269923665485903]
  We present a methodology to find a quantitatively accurate system model, high-fidelity gates and an approximate error budget. We derive a coherence limited cross-resonance gate that achieves 99.6% fidelity without need for calibration.
  arXiv  Detail & Related papers  (2020-09-21T13:38:45Z)
• Adaptive Control and Regret Minimization in Linear Quadratic Gaussian (LQG) Setting [91.43582419264763]
  We propose LqgOpt, a novel reinforcement learning algorithm based on the principle of optimism in the face of uncertainty. LqgOpt efficiently explores the system dynamics, estimates the model parameters up to their confidence interval, and deploys the controller of the most optimistic model.
  arXiv  Detail & Related papers  (2020-03-12T19:56:38Z)
• Learning Adaptive Loss for Robust Learning with Noisy Labels [59.06189240645958]
  Robust loss is an important strategy for handling robust learning issue. We propose a meta-learning method capable of robust hyper tuning. Four kinds of SOTA loss functions are attempted to be minimization, general availability and effectiveness.
  arXiv  Detail & Related papers  (2020-02-16T00:53:37Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.