Continuous Quantum Feedback Control via Kraus-Parameterized Belief Reinforcement Learning
- URL: http://arxiv.org/abs/2608.15715v1
- Date: Sun, 16 Aug 2026 12:37:25 GMT
- Title: Continuous Quantum Feedback Control via Kraus-Parameterized Belief Reinforcement Learning
- Abstract summary: Quantum feedback control requires acting on noisy continuous measurement records without direct access to the underlying quantum state.<n>We propose Kraus-ized Belief Reinforcement Learning, a pipeline in which a recurrent encoder, constrained to the Stiefel manifold, produces density-matrix estimates that are guaranteed positive-semidefinite and trace-normalized by construction.<n>A Proximal Policy Optimization (PPO) actor then maps these physically valid belief states to continuous control actions.<n>On a simulated continuously monitored qubit, the resulting policy achieves stable feedback control, maintaining a measurement-conditioned belief fidelity of approximately 0.77-0.80 and exhibiting substantially lower return variance
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Quantum feedback control requires acting on noisy continuous measurement records without direct access to the underlying quantum state. We propose Kraus-Parameterized Belief Reinforcement Learning, a pipeline in which a recurrent encoder, constrained to the Stiefel manifold, produces density-matrix estimates that are guaranteed positive-semidefinite and trace-normalized by construction, embedding quantum state geometry directly into the learning loop. A Proximal Policy Optimization (PPO) actor then maps these physically valid belief states to continuous control actions. On a simulated continuously monitored qubit, the resulting policy achieves stable feedback control, maintaining a measurement-conditioned belief fidelity of approximately 0.77-0.80 and exhibiting substantially lower return variance than a parameter-matched LSTM-history baseline across both nominal and out-of-distribution conditions. Although gains in raw target fidelity are modest, the geometric constraint guarantees a physically valid, interpretable belief representation and yields markedly more stable control under measurement inefficiency and abrupt dynamics switches. These results indicate that physics-informed neural memory is a practical inductive bias for reliable quantum feedback control.
Related papers
- Kraus Constrained Sequence Learning For Quantum Trajectories from Continuous Measurement [0.0]
We propose a Kraus-structured output layer that converts the hidden representation of a generic sequence backbone into a positive trace preserving (CPTP) quantum operation.<n>Across all models, Kraus-LS achieves the strongest results, improving state estimation quality by 7% over its unconstrained counterpart.
arXiv Detail & Related papers (2026-03-05T18:37:05Z) - Continual Quantum Architecture Search with Tensor-Train Encoding: Theory and Applications to Signal Processing [68.35481158940401]
CL-QAS is a continual quantum architecture search framework.<n>It mitigates challenges of costly encoding amplitude and forgetting in variational quantum circuits.<n>It achieves controllable robustness expressivity, sample-efficient generalization, and smooth convergence without barren plateaus.
arXiv Detail & Related papers (2026-01-10T02:36:03Z) - Verifying Closed-Loop Contractivity of Learning-Based Controllers via Partitioning [52.23804865017831]
We address the problem of verifying closed-loop contraction in nonlinear control systems whose controller and contraction metric are both parameterized by neural networks.<n>We derive a tractable and scalable sufficient condition for closed-loop contractivity that reduces to checking that the dominant eigenvalue of a symmetric Metzler matrix is nonpositive.
arXiv Detail & Related papers (2025-12-01T23:06:56Z) - Reinforcement Learning Control of Quantum Error Correction [108.70420561323692]
Quantum computer learns to self-improve directly from its errors and never stops computing.<n>This work enables a new paradigm: a quantum computer that learns to self-improve directly from its errors and never stops computing.
arXiv Detail & Related papers (2025-11-11T17:32:25Z) - Stabilization of Time-Varying Perturbed Quantum Systems via Reduced Filters [9.742034542708145]
This paper proposes a feedback stabilization strategy based on a reduced quantum filter.<n>The proposed filter estimates only O(N) real variables corresponding to the diagonal elements of the system density matrix in a quantum non-demolition basis.
arXiv Detail & Related papers (2025-11-11T08:01:31Z) - Noise-Canceling Quantum Feedback: non-Hermitian Dynamics with Applications to State Preparation and Magic State Distillation [0.6749750044497732]
Time-continuous quantum measurement allows for the tracking of a quantum system in real time via sequences of short, and individually weak, measurement intervals.<n>We consider diffusive quantum trajectories, and focus on the "noise-canceling" subset of feedback protocols.<n>We derive such a class of feedback operations, showing that under the idealized assumptions of pure states, unit measurement efficiency, and zero time-delay in implementing feedback operations, perfectly noise-canceling feedback always exists.
arXiv Detail & Related papers (2025-07-08T02:43:32Z) - Quantum sensing of displacements with stabilized GKP states [41.94295877935867]
We show how protocols for the stabilization of Gottesman-Kitaev-Preskill states can be used for the estimation of two-quadrature displacement sensing.<n>Thanks to the stabilization, this sensor is backaction evading and can function continuously without reset, making it well suited for the detection of itinerant signals.
arXiv Detail & Related papers (2025-06-25T17:18:50Z) - Quantum Fidelity Estimation in the Resource Theory of Nonstabilizerness [11.386506926570442]
fidelity estimation is essential for benchmarking quantum states and processes on noisy quantum devices.<n>We propose several efficient protocols for both quantum states and channels within the resource theory of nonstabilizerness.
arXiv Detail & Related papers (2025-06-15T18:51:09Z) - Dynamic Estimation Loss Control in Variational Quantum Sensing via Online Conformal Inference [39.72602887300498]
Current variational quantum sensing methods lack rigorous performance guarantees.<n>This paper proposes an online control framework for VQS that dynamically updates the variational parameters while providing deterministic error bars on the estimates.<n> Experiments on a quantum magnetometry task confirm that the proposed dynamic VQS approach maintains the required reliability over time, while still yielding precise estimates.
arXiv Detail & Related papers (2025-05-29T12:19:07Z) - Target Networks and Over-parameterization Stabilize Off-policy Bootstrapping with Function Approximation [46.48569176651487]
We prove a weaker convergence condition for bootstrapped value estimation in certain cases, even with off-policy data.<n>We extend our results to learning with truncated trajectories, showing that convergence is achievable for all tasks with minor modifications.
arXiv Detail & Related papers (2024-05-31T17:36:16Z) - No-Collapse Accurate Quantum Feedback Control via Conditional State
Tomography [0.0]
The effectiveness of measurement-based feedback control (MBFC) protocols is hampered by the presence of measurement noise.
This work explores a real-time continuous state estimation approach that enables noise-free monitoring of the conditional dynamics.
This approach is particularly useful for reinforcement-learning (RL)-based control, where the RL-agent can be trained with arbitrary conditional averages of observables.
arXiv Detail & Related papers (2023-01-18T01:28:23Z) - Gradient Ascent Pulse Engineering with Feedback [0.0]
We introduce feedback-GRAPE, which borrows some concepts from model-free reinforcement learning to incorporate the response to strong measurements.
Our method yields interpretable feedback strategies for state preparation and stabilization in the presence of noise.
arXiv Detail & Related papers (2022-03-08T18:46:09Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.