Quantum Control based on Deep Reinforcement Learning

• URL: http://arxiv.org/abs/2212.07385v1
• Date: Wed, 14 Dec 2022 18:12:26 GMT
• Title: Quantum Control based on Deep Reinforcement Learning
• Authors: Zhikang Wang
• Abstract summary: In this thesis, we consider two simple but typical control problems and apply deep reinforcement learning to them. We show that reinforcement learning achieves a performance comparable to the optimal control for the quadratic case. This is the first time deep reinforcement learning is applied to quantum control problems.
• Score: 1.8710230264817362
• License: http://creativecommons.org/publicdomain/zero/1.0/
• Abstract: In this thesis, we consider two simple but typical control problems and apply deep reinforcement learning to them, i.e., to cool and control a particle which is subject to continuous position measurement in a one-dimensional quadratic potential or in a quartic potential. We compare the performance of reinforcement learning control and conventional control strategies on the two problems, and show that the reinforcement learning achieves a performance comparable to the optimal control for the quadratic case, and outperforms conventional control strategies for the quartic case for which the optimal control strategy is unknown. To our knowledge, this is the first time deep reinforcement learning is applied to quantum control problems in continuous real space. Our research demonstrates that deep reinforcement learning can be used to control a stochastic quantum system in real space effectively as a measurement-feedback closed-loop controller, and our research also shows the ability of AI to discover new control strategies and properties of the quantum systems that are not well understood, and we can gain insights into these problems by learning from the AI, which opens up a new regime for scientific research.

Related papers

• Growing Q-Networks: Solving Continuous Control Tasks with Adaptive Control Resolution [51.83951489847344]
  In robotics applications, smooth control signals are commonly preferred to reduce system wear and energy efficiency. In this work, we aim to bridge this performance gap by growing discrete action spaces from coarse to fine control resolution. Our work indicates that an adaptive control resolution in combination with value decomposition yields simple critic-only algorithms that yield surprisingly strong performance on continuous control tasks.
  arXiv  Detail & Related papers  (2024-04-05T17:58:37Z)
• Robust Quantum Control in Closed and Open Systems: Theory and Practice [0.0]
  This survey is written for control theorists to provide a review of the current state of quantum control and outline the challenges faced in trying to apply modern robust control to quantum systems. We present issues that arise when applying classical robust control theory to quantum systems, typical methods used by quantum physicists to explore such systems and their robustness, as well as a discussion of open problems to be addressed in the field.
  arXiv  Detail & Related papers  (2023-12-30T18:08:43Z)
• The Quantum Cartpole: A benchmark environment for non-linear reinforcement learning [0.0]
  We show how a trade-off between state estimation and controllability arises. We demonstrate the feasibility of using transfer learning to develop a quantum control agent trained via reinforcement learning.
  arXiv  Detail & Related papers  (2023-11-01T18:02:42Z)
• A quantum system control method based on enhanced reinforcement learning [2.70857393901228]
  A quantum system control method based on enhanced reinforcement learning (QSC-ERL) is proposed. The states and actions in reinforcement learning are mapped to quantum states and control operations in quantum systems. Compared with other methods, the QSC-ERL achieves close to 1 fidelity learning control of quantum systems.
  arXiv  Detail & Related papers  (2023-09-30T03:22:44Z)
• ShadowNet for Data-Centric Quantum System Learning [188.683909185536]
  We propose a data-centric learning paradigm combining the strength of neural-network protocols and classical shadows. Capitalizing on the generalization power of neural networks, this paradigm can be trained offline and excel at predicting previously unseen systems. We present the instantiation of our paradigm in quantum state tomography and direct fidelity estimation tasks and conduct numerical analysis up to 60 qubits.
  arXiv  Detail & Related papers  (2023-08-22T09:11:53Z)
• Realizing a deep reinforcement learning agent discovering real-time feedback control strategies for a quantum system [3.598535368045164]
  We develop a latency-optimized deep neural network on a field-programmable gate array (FPGA) We demonstrate its use to efficiently initialize a superconducting qubit into a target state. We study the agent's performance for strong and weak measurements, and for three-level readout, and compare with simple strategies based on thresholding.
  arXiv  Detail & Related papers  (2022-10-30T01:31:20Z)
• Sparsity in Partially Controllable Linear Systems [56.142264865866636]
  We study partially controllable linear dynamical systems specified by an underlying sparsity pattern. Our results characterize those state variables which are irrelevant for optimal control.
  arXiv  Detail & Related papers  (2021-10-12T16:41:47Z)
• Measurement Based Feedback Quantum Control With Deep Reinforcement Learning for Double-well Non-linear Potential [0.0]
  We use Deep Reinforcement Learning to learn to control the quantum evolution of a non-linear system. We show that the DRL can effectively learn counter-intuitive strategies to cool the system to a nearly-pure cat' state.
  arXiv  Detail & Related papers  (2021-04-24T02:13:13Z)
• Closing the Closed-Loop Distribution Shift in Safe Imitation Learning [80.05727171757454]
  We treat safe optimization-based control strategies as experts in an imitation learning problem. We train a learned policy that can be cheaply evaluated at run-time and that provably satisfies the same safety guarantees as the expert.
  arXiv  Detail & Related papers  (2021-02-18T05:11:41Z)
• Quantum Geometric Machine Learning for Quantum Circuits and Control [78.50747042819503]
  We review and extend the application of deep learning to quantum geometric control problems. We demonstrate enhancements in time-optimal control in the context of quantum circuit synthesis problems. Our results are of interest to researchers in quantum control and quantum information theory seeking to combine machine learning and geometric techniques for time-optimal control problems.
  arXiv  Detail & Related papers  (2020-06-19T19:12:14Z)
• Provably Efficient Exploration for Reinforcement Learning Using Unsupervised Learning [96.78504087416654]
  Motivated by the prevailing paradigm of using unsupervised learning for efficient exploration in reinforcement learning (RL) problems, we investigate when this paradigm is provably efficient. We present a general algorithmic framework that is built upon two components: an unsupervised learning algorithm and a noregret tabular RL algorithm.
  arXiv  Detail & Related papers  (2020-03-15T19:23:59Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.