Quantum Architecture Search via Continual Reinforcement Learning
- URL: http://arxiv.org/abs/2112.05779v1
- Date: Fri, 10 Dec 2021 19:07:56 GMT
- Title: Quantum Architecture Search via Continual Reinforcement Learning
- Authors: Esther Ye, Samuel Yen-Chi Chen
- Abstract summary: This paper proposes a machine learning-based method to construct quantum circuit architectures.
We present the Probabilistic Policy Reuse with deep Q-learning (PPR-DQL) framework to tackle this circuit design challenge.
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Quantum computing has promised significant improvement in solving difficult
computational tasks over classical computers. Designing quantum circuits for
practical use, however, is not a trivial objective and requires expert-level
knowledge. To aid this endeavor, this paper proposes a machine learning-based
method to construct quantum circuit architectures. Previous works have
demonstrated that classical deep reinforcement learning (DRL) algorithms can
successfully construct quantum circuit architectures without encoded physics
knowledge. However, these DRL-based works are not generalizable to settings
with changing device noises, thus requiring considerable amounts of training
resources to keep the RL models up-to-date. With this in mind, we incorporated
continual learning to enhance the performance of our algorithm. In this paper,
we present the Probabilistic Policy Reuse with deep Q-learning (PPR-DQL)
framework to tackle this circuit design challenge. By conducting numerical
simulations over various noise patterns, we demonstrate that the RL agent with
PPR was able to find the quantum gate sequence to generate the two-qubit Bell
state faster than the agent that was trained from scratch. The proposed
framework is general and can be applied to other quantum gate synthesis or
control problems -- including the automatic calibration of quantum devices.
Related papers
- Differentiable Quantum Architecture Search in Asynchronous Quantum Reinforcement Learning [3.6881738506505988]
We propose differentiable quantum architecture search (DiffQAS) to enable trainable circuit parameters and structure weights.
We show that our proposed DiffQAS-QRL approach achieves performance comparable to manually-crafted circuit architectures.
arXiv Detail & Related papers (2024-07-25T17:11:00Z) - Quantum Subroutine for Variance Estimation: Algorithmic Design and Applications [80.04533958880862]
Quantum computing sets the foundation for new ways of designing algorithms.
New challenges arise concerning which field quantum speedup can be achieved.
Looking for the design of quantum subroutines that are more efficient than their classical counterpart poses solid pillars to new powerful quantum algorithms.
arXiv Detail & Related papers (2024-02-26T09:32:07Z) - QuantumSEA: In-Time Sparse Exploration for Noise Adaptive Quantum
Circuits [82.50620782471485]
QuantumSEA is an in-time sparse exploration for noise-adaptive quantum circuits.
It aims to achieve two key objectives: (1) implicit circuits capacity during training and (2) noise robustness.
Our method establishes state-of-the-art results with only half the number of quantum gates and 2x time saving of circuit executions.
arXiv Detail & Related papers (2024-01-10T22:33:00Z) - Challenges for Reinforcement Learning in Quantum Circuit Design [8.894627352356302]
Hybrid quantum machine learning (QML) comprises both the application of QC to improve machine learning (ML) and ML to improve QC architectures.
We propose a concrete framework, formalized as a Markov decision process, to enable learning policies capable of controlling a universal set of continuously parameterized quantum gates.
arXiv Detail & Related papers (2023-12-18T16:41:30Z) - Quantum Annealing for Single Image Super-Resolution [86.69338893753886]
We propose a quantum computing-based algorithm to solve the single image super-resolution (SISR) problem.
The proposed AQC-based algorithm is demonstrated to achieve improved speed-up over a classical analog while maintaining comparable SISR accuracy.
arXiv Detail & Related papers (2023-04-18T11:57:15Z) - QNEAT: Natural Evolution of Variational Quantum Circuit Architecture [95.29334926638462]
We focus on variational quantum circuits (VQC), which emerged as the most promising candidates for the quantum counterpart of neural networks.
Although showing promising results, VQCs can be hard to train because of different issues, e.g., barren plateau, periodicity of the weights, or choice of architecture.
We propose a gradient-free algorithm inspired by natural evolution to optimize both the weights and the architecture of the VQC.
arXiv Detail & Related papers (2023-04-14T08:03:20Z) - Decoding surface codes with deep reinforcement learning and
probabilistic policy reuse [0.5999777817331317]
Current quantum hardware, also known as noisy intermediate-scale quantum computers (NISQ), are still unable to carry out computations faithfully.
Recent developments of machine learning (ML)-based techniques especially the reinforcement learning (RL) methods have been applied to the decoding problem.
We propose a continual reinforcement learning method to address these decoding challenges.
arXiv Detail & Related papers (2022-12-22T17:24:32Z) - Optimizing Tensor Network Contraction Using Reinforcement Learning [86.05566365115729]
We propose a Reinforcement Learning (RL) approach combined with Graph Neural Networks (GNN) to address the contraction ordering problem.
The problem is extremely challenging due to the huge search space, the heavy-tailed reward distribution, and the challenging credit assignment.
We show how a carefully implemented RL-agent that uses a GNN as the basic policy construct can address these challenges.
arXiv Detail & Related papers (2022-04-18T21:45:13Z) - Improving readout in quantum simulations with repetition codes [0.0]
We use repetition codes as scalable schemes with the potential to provide more accurate solutions to problems of interest in quantum chemistry and physics.
We showcase our approach in multiple IBM Quantum devices and validate our results using a simplified theoretical noise model.
arXiv Detail & Related papers (2021-05-27T18:01:05Z) - Quantum Architecture Search via Deep Reinforcement Learning [0.0]
It is non-trivial to design a quantum gate sequence for generating a particular quantum state with as fewer gates as possible.
We propose a quantum architecture search framework with the power of deep reinforcement learning (DRL) to address this challenge.
We demonstrate a successful generation of quantum gate sequences for multi-qubit GHZ states without encoding any knowledge of quantum physics in the agent.
arXiv Detail & Related papers (2021-04-15T18:53:26Z) - Electronic structure with direct diagonalization on a D-Wave quantum
annealer [62.997667081978825]
This work implements the general Quantum Annealer Eigensolver (QAE) algorithm to solve the molecular electronic Hamiltonian eigenvalue-eigenvector problem on a D-Wave 2000Q quantum annealer.
We demonstrate the use of D-Wave hardware for obtaining ground and electronically excited states across a variety of small molecular systems.
arXiv Detail & Related papers (2020-09-02T22:46:47Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.