Non-Markovian Quantum Control via Model Maximum Likelihood Estimation and Reinforcement Learning

• URL: http://arxiv.org/abs/2402.05084v1
• Date: Wed, 7 Feb 2024 18:37:17 GMT
• Title: Non-Markovian Quantum Control via Model Maximum Likelihood Estimation and Reinforcement Learning
• Authors: Tanmay Neema (1), Susmit Jha (1), Tuhin Sahai (2) ((1) SRI International Computer Science Laboratory, (2) SRI International Applied Sciences)
• Abstract summary: We propose a novel approach that incorporates the non-Markovian nature of the environment into a low-dimensional effective reservoir. We utilize machine learning techniques to learn the effective quantum dynamics more efficiently than traditional tomographic methods. This approach may not only mitigates the issues of model bias but also provides a more accurate representation of quantum dynamics.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Reinforcement Learning (RL) techniques have been increasingly applied in optimizing control systems. However, their application in quantum systems is hampered by the challenge of performing closed-loop control due to the difficulty in measuring these systems. This often leads to reliance on assumed models, introducing model bias, a problem that is exacerbated in open quantum dynamics where Markovian approximations are not valid. To address these challenges, we propose a novel approach that incorporates the non-Markovian nature of the environment into a low-dimensional effective reservoir. By initially employing a series of measurements as a 'dataset', we utilize machine learning techniques to learn the effective quantum dynamics more efficiently than traditional tomographic methods. Our methodology aims to demonstrates that by integrating reinforcement learning with model learning, it is possible to devise control policies and models that can counteract decoherence in a spin-boson system. This approach may not only mitigates the issues of model bias but also provides a more accurate representation of quantum dynamics, paving the way for more effective quantum control strategies.

Related papers

• Evolutionary-enhanced quantum supervised learning model [0.0]
  This study proposes an evolutionary-enhanced ansatz-free supervised learning model. In contrast to parametrized circuits, our model employs circuits with variable topology that evolves through an elitist method. Our framework successfully avoids barren plateaus, resulting in enhanced model accuracy.
  arXiv  Detail & Related papers  (2023-11-14T11:08:47Z)
• Experimental graybox quantum system identification and control [2.92406842378658]
  We experimentally demonstrate a "graybox" approach to construct a physical model of a quantum system and use it to design optimal control. Our approach combines physics principles with high-accuracy machine learning and is effective with any problem where the required controlled quantities cannot be directly measured in experiments. This method naturally extends to time-dependent and open quantum systems, with applications in quantum noise spectroscopy and cancellation.
  arXiv  Detail & Related papers  (2022-06-24T10:19:55Z)
• Physics-Inspired Temporal Learning of Quadrotor Dynamics for Accurate Model Predictive Trajectory Tracking [76.27433308688592]
  Accurately modeling quadrotor's system dynamics is critical for guaranteeing agile, safe, and stable navigation. We present a novel Physics-Inspired Temporal Convolutional Network (PI-TCN) approach to learning quadrotor's system dynamics purely from robot experience. Our approach combines the expressive power of sparse temporal convolutions and dense feed-forward connections to make accurate system predictions.
  arXiv  Detail & Related papers  (2022-06-07T13:51:35Z)
• Optimal steering of matrix product states and quantum many-body scars [0.0]
  We formulate an approach to control quantum systems based on matrix product states(MPS) We compare counter-diabatic and leakage minimization approaches to the so-called local steering problem. We find that the leakage-based approach generally outperforms the counter-diabatic framework.
  arXiv  Detail & Related papers  (2022-04-06T15:34:27Z)
• Gradient Ascent Pulse Engineering with Feedback [0.0]
  We introduce feedback-GRAPE, which borrows some concepts from model-free reinforcement learning to incorporate the response to strong measurements. Our method yields interpretable feedback strategies for state preparation and stabilization in the presence of noise.
  arXiv  Detail & Related papers  (2022-03-08T18:46:09Z)
• Sparsity in Partially Controllable Linear Systems [56.142264865866636]
  We study partially controllable linear dynamical systems specified by an underlying sparsity pattern. Our results characterize those state variables which are irrelevant for optimal control.
  arXiv  Detail & Related papers  (2021-10-12T16:41:47Z)
• Quantum algorithms for quantum dynamics: A performance study on the spin-boson model [68.8204255655161]
  Quantum algorithms for quantum dynamics simulations are traditionally based on implementing a Trotter-approximation of the time-evolution operator. variational quantum algorithms have become an indispensable alternative, enabling small-scale simulations on present-day hardware. We show that, despite providing a clear reduction of quantum gate cost, the variational method in its current implementation is unlikely to lead to a quantum advantage.
  arXiv  Detail & Related papers  (2021-08-09T18:00:05Z)
• Model-Free Quantum Control with Reinforcement Learning [0.0]
  We propose a circuit-based approach for training a reinforcement learning agent on quantum control tasks in a model-free way. We show how to reward the learning agent using measurements of experimentally available observables. This approach significantly outperforms widely used model-free methods in terms of sample efficiency.
  arXiv  Detail & Related papers  (2021-04-29T17:53:26Z)
• Dynamically corrected gates from geometric space curves [55.41644538483948]
  We review a technique for designing control fields that dynamically correct errors while performing operations using a close relationship between quantum evolution and geometric space curves. This approach provides access to the global solution space of control fields that accomplish a given task, facilitating the design of experimentally feasible gate operations for a wide variety of applications.
  arXiv  Detail & Related papers  (2021-03-30T01:12:36Z)
• Error mitigation and quantum-assisted simulation in the error corrected regime [77.34726150561087]
  A standard approach to quantum computing is based on the idea of promoting a classically simulable and fault-tolerant set of operations. We show how the addition of noisy magic resources allows one to boost classical quasiprobability simulations of a quantum circuit.
  arXiv  Detail & Related papers  (2021-03-12T20:58:41Z)
• Information Theoretic Model Predictive Q-Learning [64.74041985237105]
  We present a novel theoretical connection between information theoretic MPC and entropy regularized RL. We develop a Q-learning algorithm that can leverage biased models.
  arXiv  Detail & Related papers  (2019-12-31T00:29:22Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.