Reinforcement Learning for Many-Body Ground-State Preparation Inspired by Counterdiabatic Driving

• URL: http://arxiv.org/abs/2010.03655v2
• Date: Sun, 3 Oct 2021 03:41:39 GMT
• Title: Reinforcement Learning for Many-Body Ground-State Preparation Inspired by Counterdiabatic Driving
• Authors: Jiahao Yao, Lin Lin, Marin Bukov
• Abstract summary: CD-QAOA is designed for quantum many-body systems and optimized using a reinforcement learning (RL) approach. We show that using terms occurring in the adiabatic gauge potential as generators of additional control unitaries, it is possible to achieve fast high-fidelity many-body control away from the adiabatic regime. This work paves the way to incorporate recent success from deep learning for the purpose of quantum many-body control.
• Score: 2.5614220901453333
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The quantum alternating operator ansatz (QAOA) is a prominent example of variational quantum algorithms. We propose a generalized QAOA called CD-QAOA, which is inspired by the counterdiabatic driving procedure, designed for quantum many-body systems and optimized using a reinforcement learning (RL) approach. The resulting hybrid control algorithm proves versatile in preparing the ground state of quantum-chaotic many-body spin chains by minimizing the energy. We show that using terms occurring in the adiabatic gauge potential as generators of additional control unitaries, it is possible to achieve fast high-fidelity many-body control away from the adiabatic regime. While each unitary retains the conventional QAOA-intrinsic continuous control degree of freedom such as the time duration, we consider the order of the multiple available unitaries appearing in the control sequence as an additional discrete optimization problem. Endowing the policy gradient algorithm with an autoregressive deep learning architecture to capture causality, we train the RL agent to construct optimal sequences of unitaries. The algorithm has no access to the quantum state, and we find that the protocol learned on small systems may generalize to larger systems. By scanning a range of protocol durations, we present numerical evidence for a finite quantum speed limit in the nonintegrable mixed-field spin-1/2 Ising and Lipkin-Meshkov-Glick models, and for the suitability to prepare ground states of the spin-1 Heisenberg chain in the long-range and topologically ordered parameter regimes. This work paves the way to incorporate recent success from deep learning for the purpose of quantum many-body control.

Related papers

• Controlling nonergodicity in quantum many-body systems by reinforcement learning [0.0]
  We develop a model-free and deep-reinforcement learning framework for quantum nonergodicity control. We use the paradigmatic one-dimensional tilted Fermi-Hubbard system to demonstrate that the DRL agent can efficiently learn the quantum many-body system. The continuous control protocols and observations are experimentally feasible.
  arXiv  Detail & Related papers  (2024-08-21T20:55:44Z)
• Optimal control in large open quantum systems: the case of transmon readout and reset [44.99833362998488]
  We present a framework that combines the adjoint state method together with reverse-time back-propagation to solve prohibitively large open-system quantum control problems. We apply this framework to optimize two inherently dissipative operations in superconducting qubits. Our results show that, given a fixed set of system parameters, shaping the control pulses can yield 2x improvements in the fidelity and duration for both of these operations.
  arXiv  Detail & Related papers  (2024-03-21T18:12:51Z)
• Quantum control by the environment: Turing uncomputability, Optimization over Stiefel manifolds, Reachable sets, and Incoherent GRAPE [56.47577824219207]
  In many practical situations, the controlled quantum systems are open, interacting with the environment. In this note, we briefly review some results on control of open quantum systems using environment as a resource.
  arXiv  Detail & Related papers  (2024-03-20T10:09:13Z)
• Machine-learning-inspired quantum optimal control of nonadiabatic geometric quantum computation via reverse engineering [3.3216171033358077]
  We propose a promising average-fidelity-based machine-learning-inspired method to optimize the control parameters. We implement a single-qubit gate by cat-state nonadiabatic geometric quantum computation via reverse engineering. We demonstrate that the neural network possesses the ability to expand the model space.
  arXiv  Detail & Related papers  (2023-09-28T14:36:26Z)
• Quantum Gate Generation in Two-Level Open Quantum Systems by Coherent and Incoherent Photons Found with Gradient Search [77.34726150561087]
  We consider an environment formed by incoherent photons as a resource for controlling open quantum systems via an incoherent control. We exploit a coherent control in the Hamiltonian and an incoherent control in the dissipator which induces the time-dependent decoherence rates.
  arXiv  Detail & Related papers  (2023-02-28T07:36:02Z)
• Multi-squeezed state generation and universal bosonic control via a driven quantum Rabi model [68.8204255655161]
  Universal control over a bosonic degree of freedom is key in the quest for quantum-based technologies. Here we consider a single ancillary two-level system, interacting with the bosonic mode of interest via a driven quantum Rabi model. We show that it is sufficient to induce the deterministic realization of a large class of Gaussian and non-Gaussian gates, which in turn provide universal bosonic control.
  arXiv  Detail & Related papers  (2022-09-16T14:18:53Z)
• Optimal quantum control via genetic algorithms for quantum state engineering in driven-resonator mediated networks [68.8204255655161]
  We employ a machine learning-enabled approach to quantum state engineering based on evolutionary algorithms. We consider a network of qubits -- encoded in the states of artificial atoms with no direct coupling -- interacting via a common single-mode driven microwave resonator. We observe high quantum fidelities and resilience to noise, despite the algorithm being trained in the ideal noise-free setting.
  arXiv  Detail & Related papers  (2022-06-29T14:34:00Z)
• Optimal steering of matrix product states and quantum many-body scars [0.0]
  We formulate an approach to control quantum systems based on matrix product states(MPS) We compare counter-diabatic and leakage minimization approaches to the so-called local steering problem. We find that the leakage-based approach generally outperforms the counter-diabatic framework.
  arXiv  Detail & Related papers  (2022-04-06T15:34:27Z)
• Self-Correcting Quantum Many-Body Control using Reinforcement Learning with Tensor Networks [0.0]
  We present a novel framework for efficiently controlling quantum many-body systems based on reinforcement learning (RL) We show that RL agents are capable of finding universal controls, of learning how to optimally steer previously unseen many-body states, and of adapting control protocols on-thefly when the quantum dynamics is subject to perturbations.
  arXiv  Detail & Related papers  (2022-01-27T20:14:09Z)
• Quantum control landscape for ultrafast generation of single-qubit phase shift quantum gates [68.8204255655161]
  We consider the problem of ultrafast controlled generation of single-qubit phase shift quantum gates. Globally optimal control is a control which realizes the gate with maximal possible fidelity. Trap is a control which is optimal only locally but not globally.
  arXiv  Detail & Related papers  (2021-04-26T16:38:43Z)
• Noise-Robust End-to-End Quantum Control using Deep Autoregressive Policy Networks [2.5946789143276447]
  Variational quantum eigensolvers have recently received increased attention, as they enable the use of quantum computing devices. We present a hybrid policy gradient algorithm capable of simultaneously optimizing continuous and discrete degrees of freedom in an uncertainty-resilient way. Our work exhibits the beneficial synergy between reinforcement learning and quantum control.
  arXiv  Detail & Related papers  (2020-12-12T02:13:28Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.