Artificially intelligent Maxwell's demon for optimal control of open quantum systems

• URL: http://arxiv.org/abs/2408.15328v1
• Date: Tue, 27 Aug 2024 18:00:02 GMT
• Title: Artificially intelligent Maxwell's demon for optimal control of open quantum systems
• Authors: Paolo Andrea Erdman, Robert Czupryniak, Bibek Bhandari, Andrew N. Jordan, Frank Noé, Jens Eisert, Giacomo Guarnieri,
• Abstract summary: We employ a reinforcement learning approach to automate and capture the role of a quantum Maxwell's demon. We explore different regimes based on the ordering between the thermalization, the measurement, and the unitary feedback timescales. We find strategies with elaborate finite-time thermalization protocols conditioned on measurement outcomes.
• Score: 3.8043829889888716
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Feedback control of open quantum systems is of fundamental importance for practical applications in various contexts, ranging from quantum computation to quantum error correction and quantum metrology. Its use in the context of thermodynamics further enables the study of the interplay between information and energy. However, deriving optimal feedback control strategies is highly challenging, as it involves the optimal control of open quantum systems, the stochastic nature of quantum measurement, and the inclusion of policies that maximize a long-term time- and trajectory-averaged goal. In this work, we employ a reinforcement learning approach to automate and capture the role of a quantum Maxwell's demon: the agent takes the literal role of discovering optimal feedback control strategies in qubit-based systems that maximize a trade-off between measurement-powered cooling and measurement efficiency. Considering weak or projective quantum measurements, we explore different regimes based on the ordering between the thermalization, the measurement, and the unitary feedback timescales, finding different and highly non-intuitive, yet interpretable, strategies. In the thermalization-dominated regime, we find strategies with elaborate finite-time thermalization protocols conditioned on measurement outcomes. In the measurement-dominated regime, we find that optimal strategies involve adaptively measuring different qubit observables reflecting the acquired information, and repeating multiple weak measurements until the quantum state is "sufficiently pure", leading to random walks in state space. Finally, we study the case when all timescales are comparable, finding new feedback control strategies that considerably outperform more intuitive ones. We discuss a two-qubit example where we explore the role of entanglement and conclude discussing the scaling of our results to quantum many-body systems.

Related papers

• Harnessing quantum back-action for time-series processing [0.0]
  We show that incorporating weak measurements into a quantum machine-learning protocol provides advantages in both execution time scaling and overall performance. This work provides a comprehensive and practical recipe to promote the implementation of weak measurement-based protocols in quantum reservoir computing.
  arXiv  Detail & Related papers  (2024-11-06T15:15:04Z)
• Quantum control by the environment: Turing uncomputability, Optimization over Stiefel manifolds, Reachable sets, and Incoherent GRAPE [56.47577824219207]
  In many practical situations, the controlled quantum systems are open, interacting with the environment. In this note, we briefly review some results on control of open quantum systems using environment as a resource.
  arXiv  Detail & Related papers  (2024-03-20T10:09:13Z)
• Effect of the readout efficiency of quantum measurement on the system entanglement [44.99833362998488]
  We quantify the entanglement for a particle on a 1d quantum random walk under inefficient monitoring. We find that the system's maximal mean entanglement at the measurement-induced quantum-to-classical crossover is in different ways by the measurement strength and inefficiency.
  arXiv  Detail & Related papers  (2024-02-29T18:10:05Z)
• Quantum Computer-Based Verification of Quantum Thermodynamic Uncertainty Relation [1.6574413179773757]
  We present an approach using quantum computers to verify a general quantum thermodynamic uncertainty relation. Our method, which implements quantum dynamics on physical qubits, enables us to investigate the measurability of relevant quantities.
  arXiv  Detail & Related papers  (2024-02-29T15:55:29Z)
• Universality of critical dynamics with finite entanglement [68.8204255655161]
  We study how low-energy dynamics of quantum systems near criticality are modified by finite entanglement. Our result establishes the precise role played by entanglement in time-dependent critical phenomena.
  arXiv  Detail & Related papers  (2023-01-23T19:23:54Z)
• Guaranteed efficient energy estimation of quantum many-body Hamiltonians using ShadowGrouping [55.47824411563162]
  Estimation of the energy of quantum many-body systems is a paradigmatic task in various research fields. We aim to find the optimal strategy with single-qubit measurements that yields the highest provable accuracy given a total measurement budget. We develop a practical, efficient estimation strategy, which we call ShadowGrouping.
  arXiv  Detail & Related papers  (2023-01-09T14:41:07Z)
• Anticipative measurements in hybrid quantum-classical computation [68.8204255655161]
  We present an approach where the quantum computation is supplemented by a classical result. Taking advantage of its anticipation also leads to a new type of quantum measurements, which we call anticipative. In an anticipative quantum measurement the combination of the results from classical and quantum computations happens only in the end.
  arXiv  Detail & Related papers  (2022-09-12T15:47:44Z)
• Adaptive measurement filter: efficient strategy for optimal estimation of quantum Markov chains [0.0]
  We present an efficient algorithm for optimal estimation of one-dimensional dynamical parameters. The scheme offers an exciting prospect for optimal continuous-time adaptive measurements, but more work is needed to find realistic practical implementations.
  arXiv  Detail & Related papers  (2022-04-19T16:03:40Z)
• Gradient Ascent Pulse Engineering with Feedback [0.0]
  We introduce feedback-GRAPE, which borrows some concepts from model-free reinforcement learning to incorporate the response to strong measurements. Our method yields interpretable feedback strategies for state preparation and stabilization in the presence of noise.
  arXiv  Detail & Related papers  (2022-03-08T18:46:09Z)
• Overlapped grouping measurement: A unified framework for measuring quantum states [2.1166716158060104]
  We propose a unified framework of quantum measurements, incorporating advanced measurement methods as special cases. An intuitive understanding of the scheme is to partition the measurements into overlapped groups with each one consisting of compatible measurements. Our numerical result shows significant improvements over existing schemes.
  arXiv  Detail & Related papers  (2021-05-27T12:38:18Z)
• Observing a Topological Transition in Weak-Measurement-Induced Geometric Phases [55.41644538483948]
  Weak measurements in particular, through their back-action on the system, may enable various levels of coherent control. We measure the geometric phases induced by sequences of weak measurements and demonstrate a topological transition in the geometric phase controlled by measurement strength. Our results open new horizons for measurement-enabled quantum control of many-body topological states.
  arXiv  Detail & Related papers  (2021-02-10T19:00:00Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.