Quantum framework for Reinforcement Learning: Integrating Markov decision process, quantum arithmetic, and trajectory search

• URL: http://arxiv.org/abs/2412.18208v3
• Date: Wed, 28 May 2025 10:50:35 GMT
• Title: Quantum framework for Reinforcement Learning: Integrating Markov decision process, quantum arithmetic, and trajectory search
• Authors: Thet Htar Su, Shaswot Shresthamali, Masaaki Kondo,
• Abstract summary: This paper introduces a quantum framework for addressing reinforcement learning (RL) tasks.<n>By employing quantum concepts and a quantum search algorithm, this work presents the implementation and optimization of the agent-environment interactions.<n>Results demonstrate the capacity of a quantum model to achieve quantum enhancement in RL.
• Score: 0.6062751776009752
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: This paper introduces a quantum framework for addressing reinforcement learning (RL) tasks, grounded in the quantum principles and leveraging a fully quantum model of the classical Markov decision process (MDP). By employing quantum concepts and a quantum search algorithm, this work presents the implementation and optimization of the agent-environment interactions entirely within the quantum domain, eliminating reliance on classical computations. Key contributions include the quantum-based state transitions, return calculation, and trajectory search mechanism that utilize quantum principles to demonstrate the realization of RL processes through quantum phenomena. The implementation emphasizes the fundamental role of quantum superposition in enhancing computational efficiency for RL tasks. Results demonstrate the capacity of a quantum model to achieve quantum enhancement in RL, highlighting the potential of fully quantum implementations in decision-making tasks. This work not only underscores the applicability of quantum computing in machine learning but also contributes to the field of quantum reinforcement learning (QRL) by offering a robust framework for understanding and exploiting quantum computing in RL systems.

Related papers

• Quantum State Preparation Based on LimTDD [5.328178128965817]
  This paper proposes a novel approach for quantum state preparation based on the Local Invertible Map Diagram (LimTDD)<n>LimTDD combines the advantages of tensor networks and decision diagrams, enabling efficient representation of quantum states.
  arXiv  Detail & Related papers  (2025-07-19T06:00:27Z)
• VQC-MLPNet: An Unconventional Hybrid Quantum-Classical Architecture for Scalable and Robust Quantum Machine Learning [60.996803677584424]
  Variational Quantum Circuits (VQCs) offer a novel pathway for quantum machine learning.<n>Their practical application is hindered by inherent limitations such as constrained linear expressivity, optimization challenges, and acute sensitivity to quantum hardware noise.<n>This work introduces VQC-MLPNet, a scalable and robust hybrid quantum-classical architecture designed to overcome these obstacles.
  arXiv  Detail & Related papers  (2025-06-12T01:38:15Z)
• Hamiltonian Dynamics Learning: A Scalable Approach to Quantum Process Characterization [6.741097425426473]
  We introduce an efficient quantum process learning method specifically designed for short-time Hamiltonian dynamics. We demonstrate applications in quantum machine learning, where our protocol enables efficient training of variational quantum neural networks by directly learning unitary transformations. This work establishes a new theoretical foundation for practical quantum dynamics learning, paving the way for scalable quantum process characterization in both near-term and fault-tolerant quantum computing.
  arXiv  Detail & Related papers  (2025-03-31T14:50:00Z)
• Quantum Computing in Transport Science: A Review [0.8437187555622164]
  Quantum computing, leveraging the principles of quantum mechanics, has been found to significantly enhance computational capabilities in principle. This paper explores quantum computing's potential to address complex, large-scale problems in transportation systems.
  arXiv  Detail & Related papers  (2025-03-27T09:28:33Z)
• Classical post-processing approach for quantum amplitude estimation [0.0]
  We propose an approach for quantum amplitude estimation (QAE) designed to enhance computational efficiency while minimizing the reliance on quantum resources.<n>Our method leverages quantum computers to generate a sequence of signals, from which the quantum amplitude is inferred through classical post-processing techniques.
  arXiv  Detail & Related papers  (2025-02-08T15:51:31Z)
• Quantum Algorithms and Applications for Open Quantum Systems [1.7717834336854132]
  We provide a succinct summary of the fundamental theory of open quantum systems. We then delve into a discussion on recent quantum algorithms. We conclude with a discussion of pertinent applications, demonstrating the applicability of this field to realistic chemical, biological, and material systems.
  arXiv  Detail & Related papers  (2024-06-07T19:02:22Z)
• A quantum information theoretic analysis of reinforcement learning-assisted quantum architecture search [0.0]
  This study investigates RL-QAS for crafting ansatz tailored to variational quantum state diagonalisation problem. We leverage these insights to devise an entanglement-guided admissible ansatz in QAS to diagonalise random quantum states using optimal resources.
  arXiv  Detail & Related papers  (2024-04-09T09:54:59Z)
• Quantum Generative Adversarial Networks: Bridging Classical and Quantum Realms [0.6827423171182153]
  We explore the synergistic fusion of classical and quantum computing paradigms within the realm of Generative Adversarial Networks (GANs) Our objective is to seamlessly integrate quantum computational elements into the conventional GAN architecture, thereby unlocking novel pathways for enhanced training processes. This research is positioned at the forefront of quantum-enhanced machine learning, presenting a critical stride towards harnessing the computational power of quantum systems.
  arXiv  Detail & Related papers  (2023-12-15T16:51:36Z)
• Learning Quantum Processes with Quantum Statistical Queries [0.0]
  This paper introduces the first learning framework for studying quantum process learning within the Quantum Statistical Query model. We propose an efficient QPSQ learner for arbitrary quantum processes accompanied by a provable performance guarantee. This work marks a significant step towards understanding the learnability of quantum processes and shedding light on their security implications.
  arXiv  Detail & Related papers  (2023-10-03T14:15:20Z)
• Quantum data learning for quantum simulations in high-energy physics [55.41644538483948]
  We explore the applicability of quantum-data learning to practical problems in high-energy physics. We make use of ansatz based on quantum convolutional neural networks and numerically show that it is capable of recognizing quantum phases of ground states. The observation of non-trivial learning properties demonstrated in these benchmarks will motivate further exploration of the quantum-data learning architecture in high-energy physics.
  arXiv  Detail & Related papers  (2023-06-29T18:00:01Z)
• Quantum Machine Learning: from physics to software engineering [58.720142291102135]
  We show how classical machine learning approach can help improve the facilities of quantum computers. We discuss how quantum algorithms and quantum computers may be useful for solving classical machine learning tasks.
  arXiv  Detail & Related papers  (2023-01-04T23:37:45Z)
• Optimal Stochastic Resource Allocation for Distributed Quantum Computing [50.809738453571015]
  We propose a resource allocation scheme for distributed quantum computing (DQC) based on programming to minimize the total deployment cost for quantum resources. The evaluation demonstrates the effectiveness and ability of the proposed scheme to balance the utilization of quantum computers and on-demand quantum computers.
  arXiv  Detail & Related papers  (2022-09-16T02:37:32Z)
• Synergy Between Quantum Circuits and Tensor Networks: Short-cutting the Race to Practical Quantum Advantage [43.3054117987806]
  We introduce a scalable procedure for harnessing classical computing resources to provide pre-optimized initializations for quantum circuits. We show this method significantly improves the trainability and performance of PQCs on a variety of problems. By demonstrating a means of boosting limited quantum resources using classical computers, our approach illustrates the promise of this synergy between quantum and quantum-inspired models in quantum computing.
  arXiv  Detail & Related papers  (2022-08-29T15:24:03Z)
• Efficient criteria of quantumness for a large system of qubits [58.720142291102135]
  We discuss the dimensionless combinations of basic parameters of large, partially quantum coherent systems. Based on analytical and numerical calculations, we suggest one such number for a system of qubits undergoing adiabatic evolution.
  arXiv  Detail & Related papers  (2021-08-30T23:50:05Z)
• On exploring the potential of quantum auto-encoder for learning quantum systems [60.909817434753315]
  We devise three effective QAE-based learning protocols to address three classically computational hard learning problems. Our work sheds new light on developing advanced quantum learning algorithms to accomplish hard quantum physics and quantum information processing tasks.
  arXiv  Detail & Related papers  (2021-06-29T14:01:40Z)
• Quantum Federated Learning with Quantum Data [87.49715898878858]
  Quantum machine learning (QML) has emerged as a promising field that leans on the developments in quantum computing to explore large complex machine learning problems. This paper proposes the first fully quantum federated learning framework that can operate over quantum data and, thus, share the learning of quantum circuit parameters in a decentralized manner.
  arXiv  Detail & Related papers  (2021-05-30T12:19:27Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.