Towards Faster Reinforcement Learning of Quantum Circuit Optimization: Exponential Reward Functions

• URL: http://arxiv.org/abs/2311.12509v1
• Date: Tue, 21 Nov 2023 10:33:26 GMT
• Title: Towards Faster Reinforcement Learning of Quantum Circuit Optimization: Exponential Reward Functions
• Authors: Ioana Moflic and Alexandru Paler
• Abstract summary: Reinforcement learning for the optimization of quantum circuits uses an agent whose goal is to maximize the value of a reward function. We propose an exponential reward function which is sensitive to structural properties of the circuit.
• Score: 55.616364225463066
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Reinforcement learning for the optimization of quantum circuits uses an agent whose goal is to maximize the value of a reward function that decides what is correct and what is wrong during the exploration of the search space. It is an open problem how to formulate reward functions that lead to fast and efficient learning. We propose an exponential reward function which is sensitive to structural properties of the circuit. We benchmark our function on circuits with known optimal depths, and conclude that our function is reducing the learning time and improves the optimization. Our results are a next step towards fast, large scale optimization of quantum circuits.

Related papers

• Optimizing Quantum Circuits, Fast and Slow [7.543907169342984]
  We present a framework for thinking of rewriting and resynthesis as abstract circuit transformations. We then present a radically simple algorithm, GUOQ, for optimizing quantum circuits.
  arXiv  Detail & Related papers  (2024-11-06T18:34:35Z)
• Quantum Circuit Optimization: Current trends and future direction [0.0]
  Recent advancements in quantum circuit optimization are explored. analytical algorithms, quantum algorithms, machine learning-based algorithms, and hybrid quantum-classical algorithms are discussed.
  arXiv  Detail & Related papers  (2024-08-16T15:07:51Z)
• Bayesian Parameterized Quantum Circuit Optimization (BPQCO): A task and hardware-dependent approach [49.89480853499917]
  Variational quantum algorithms (VQA) have emerged as a promising quantum alternative for solving optimization and machine learning problems. In this paper, we experimentally demonstrate the influence of the circuit design on the performance obtained for two classification problems. We also study the degradation of the obtained circuits in the presence of noise when simulating real quantum computers.
  arXiv  Detail & Related papers  (2024-04-17T11:00:12Z)
• Cost Explosion for Efficient Reinforcement Learning Optimisation of Quantum Circuits [55.616364225463066]
  Reinforcement Learning (RL) is a recent approach for learning strategies to optimise quantum circuits by increasing the reward of an optimisation agent. Our goal is to improve the agent's optimization strategy, by including hints about how quantum circuits are optimized manually. We show that allowing cost explosions offers significant advantages for RL training, such as reaching optimum circuits.
  arXiv  Detail & Related papers  (2023-11-21T10:16:03Z)
• Randomized Benchmarking of Local Zeroth-Order Optimizers for Variational Quantum Systems [65.268245109828]
  We compare the performance of classicals across a series of partially-randomized tasks. We focus on local zeroth-orders due to their generally favorable performance and query-efficiency on quantum systems.
  arXiv  Detail & Related papers  (2023-10-14T02:13:26Z)
• Quarl: A Learning-Based Quantum Circuit Optimizer [8.994999903946848]
  This paper presents Quarl, a learning-based quantum circuit. Applying reinforcement learning to quantum circuit optimization raises two main challenges: the large and varying action space and the non-uniform state representation.
  arXiv  Detail & Related papers  (2023-07-17T19:21:22Z)
• Graph Neural Network Autoencoders for Efficient Quantum Circuit Optimisation [69.43216268165402]
  We present for the first time how to use graph neural network (GNN) autoencoders for the optimisation of quantum circuits. We construct directed acyclic graphs from the quantum circuits, encode the graphs and use the encodings to represent RL states. Our method is the first realistic first step towards very large scale RL quantum circuit optimisation.
  arXiv  Detail & Related papers  (2023-03-06T16:51:30Z)
• QuACK: Accelerating Gradient-Based Quantum Optimization with Koopman Operator Learning [4.134992977596645]
  We present Quantum-circuit Controlled Alternating Koopman learning (QuACK), a novel framework that leverages an alternating algorithm for efficient prediction of gradient dynamics on quantum computers. We demonstrate QuACK's remarkable ability to accelerate gradient-based optimization across a range of applications in quantum optimization and machine learning.
  arXiv  Detail & Related papers  (2022-11-02T17:59:25Z)
• Variational Quantum Optimization with Multi-Basis Encodings [62.72309460291971]
  We introduce a new variational quantum algorithm that benefits from two innovations: multi-basis graph complexity and nonlinear activation functions. Our results in increased optimization performance, two increase in effective landscapes and a reduction in measurement progress.
  arXiv  Detail & Related papers  (2021-06-24T20:16:02Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.