Variational Quantum Soft Actor-Critic for Robotic Arm Control

• URL: http://arxiv.org/abs/2212.11681v1
• Date: Tue, 20 Dec 2022 19:02:24 GMT
• Title: Variational Quantum Soft Actor-Critic for Robotic Arm Control
• Authors: Alberto Acuto, Paola Barill\`a, Ludovico Bozzolo, Matteo Conterno, Mattia Pavese, Antonio Policicchio
• Abstract summary: This work aims at exploring and assessing the advantages of the application of Quantum Computing to one of the state-of-art Reinforcement Learning techniques for continuous control. Specifically, the performance of a Variational Quantum Soft Actor-Critic on the movement of a virtual robotic arm has been investigated by means of digital simulations of quantum circuits.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Deep Reinforcement Learning is emerging as a promising approach for the continuous control task of robotic arm movement. However, the challenges of learning robust and versatile control capabilities are still far from being resolved for real-world applications, mainly because of two common issues of this learning paradigm: the exploration strategy and the slow learning speed, sometimes known as "the curse of dimensionality". This work aims at exploring and assessing the advantages of the application of Quantum Computing to one of the state-of-art Reinforcement Learning techniques for continuous control - namely Soft Actor-Critic. Specifically, the performance of a Variational Quantum Soft Actor-Critic on the movement of a virtual robotic arm has been investigated by means of digital simulations of quantum circuits. A quantum advantage over the classical algorithm has been found in terms of a significant decrease in the amount of required parameters for satisfactory model training, paving the way for further promising developments.

Related papers

• Hybrid Quantum-Classical Reinforcement Learning in Latent Observation Spaces [0.36944296923226316]
  Recent progress in quantum machine learning has sparked interest in using quantum methods to tackle classical control problems. We propose to solve this dimensionality challenge by a classical autoencoder and a quantum agent together. A series of numerical experiments are designed for a performance analysis of the latent-space learning method.
  arXiv  Detail & Related papers  (2024-10-23T21:19:38Z)
• Large-scale quantum reservoir learning with an analog quantum computer [45.21335836399935]
  We develop a quantum reservoir learning algorithm that harnesses the quantum dynamics of neutral-atom analog quantum computers to process data. We experimentally implement the algorithm, achieving competitive performance across various categories of machine learning tasks. Our findings demonstrate the potential of utilizing classically intractable quantum correlations for effective machine learning.
  arXiv  Detail & Related papers  (2024-07-02T18:00:00Z)
• Machine-learning-inspired quantum control in many-body dynamics [6.817811305553492]
  We introduce a promising and versatile control neural network tailored to optimize control fields. We address the problem of suppressing defect density and enhancing cat-state fidelity during the passage across the critical point in the quantum Ising model. In comparison to gradient-based power-law quench methods, our approach demonstrates significant advantages for both small system sizes and long-term evolutions.
  arXiv  Detail & Related papers  (2024-04-09T01:47:55Z)
• Invariant-based control of quantum many-body systems across critical points [0.0]
  We introduce a control technique based on dynamical invariants tailored to ensure adiabatic-like evolution within the lowest-energy subspace of many-body systems. By tuning the controllable parameter according to analytical control results, we achieve high-fidelity evolutions operating close to the speed limit. Remarkably, our approach leads to the breakdown of Kibble-Zurek scaling laws, offering tunable and significantly improved time scaling behavior.
  arXiv  Detail & Related papers  (2023-09-11T14:09:37Z)
• Leveraging Sequentiality in Reinforcement Learning from a Single Demonstration [68.94506047556412]
  We propose to leverage a sequential bias to learn control policies for complex robotic tasks using a single demonstration. We show that DCIL-II can solve with unprecedented sample efficiency some challenging simulated tasks such as humanoid locomotion and stand-up.
  arXiv  Detail & Related papers  (2022-11-09T10:28:40Z)
• Dynamics with autoregressive neural quantum states: application to critical quench dynamics [41.94295877935867]
  We present an alternative general scheme that enables one to capture long-time dynamics of quantum systems in a stable fashion. We apply the scheme to time-dependent quench dynamics by investigating the Kibble-Zurek mechanism in the two-dimensional quantum Ising model.
  arXiv  Detail & Related papers  (2022-09-07T15:50:00Z)
• Quantum generative adversarial learning for simultaneous multiparameter estimation [7.6333322023084955]
  We report an experimental demonstration of quantum generative adversarial learning with the assistance of adaptive feedback. Results indicate the intriguing advantages of quantum generative adversarial learning even in the presence of deleterious noise.
  arXiv  Detail & Related papers  (2022-05-26T17:16:03Z)
• Variational Quantum Soft Actor-Critic [1.90365714903665]
  We develop a quantum reinforcement learning algorithm based on soft actor-critic -- one of the state-of-the-art methods for continuous control. We show that this quantum version of soft actor-critic is comparable with the original soft actor-critic, using much less adjustable parameters.
  arXiv  Detail & Related papers  (2021-12-20T06:31:06Z)
• Quantum algorithms for quantum dynamics: A performance study on the spin-boson model [68.8204255655161]
  Quantum algorithms for quantum dynamics simulations are traditionally based on implementing a Trotter-approximation of the time-evolution operator. variational quantum algorithms have become an indispensable alternative, enabling small-scale simulations on present-day hardware. We show that, despite providing a clear reduction of quantum gate cost, the variational method in its current implementation is unlikely to lead to a quantum advantage.
  arXiv  Detail & Related papers  (2021-08-09T18:00:05Z)
• On exploring the potential of quantum auto-encoder for learning quantum systems [60.909817434753315]
  We devise three effective QAE-based learning protocols to address three classically computational hard learning problems. Our work sheds new light on developing advanced quantum learning algorithms to accomplish hard quantum physics and quantum information processing tasks.
  arXiv  Detail & Related papers  (2021-06-29T14:01:40Z)
• Quantum Geometric Machine Learning for Quantum Circuits and Control [78.50747042819503]
  We review and extend the application of deep learning to quantum geometric control problems. We demonstrate enhancements in time-optimal control in the context of quantum circuit synthesis problems. Our results are of interest to researchers in quantum control and quantum information theory seeking to combine machine learning and geometric techniques for time-optimal control problems.
  arXiv  Detail & Related papers  (2020-06-19T19:12:14Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.