Quantum-inspired activation functions in the convolutional neural network
- URL: http://arxiv.org/abs/2404.05901v1
- Date: Mon, 8 Apr 2024 23:08:38 GMT
- Title: Quantum-inspired activation functions in the convolutional neural network
- Authors: Shaozhi Li, M Sabbir Salek, Yao Wang, Mashrur Chowdhury,
- Abstract summary: We study the expressibility of quantum circuits integrated within a convolutional neural network (CNN)
Through numerical training, our hybrid quantum-classical CNN model exhibited superior feature selection capabilities.
We demonstrate that a quantum activation function is more efficient in selecting important features and discarding unimportant information.
- Score: 6.09437748873686
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: Driven by the significant advantages offered by quantum computing, research in quantum machine learning has increased in recent years. While quantum speed-up has been demonstrated in some applications of quantum machine learning, a comprehensive understanding of its underlying mechanisms for improved performance remains elusive. Our study fills this gap by examining the expressibility of quantum circuits integrated within a convolutional neural network (CNN). Through numerical training on the MNIST dataset, our hybrid quantum-classical CNN model exhibited superior feature selection capabilities and significantly reduced the required training steps compared to the classical CNN. To understand the root of this enhanced performance, we conducted an analytical investigation of the functional expressibility of quantum circuits and derived a quantum activation function. We demonstrated that this quantum activation is more efficient in selecting important features and discarding unimportant information of input images. These findings not only deepen our comprehension of quantum-enhanced machine-learning models but also advance the classical machine-learning technique by introducing the quantum-inspired activation function.
Related papers
- Large-scale quantum reservoir learning with an analog quantum computer [45.21335836399935]
We develop a quantum reservoir learning algorithm that harnesses the quantum dynamics of neutral-atom analog quantum computers to process data.
We experimentally implement the algorithm, achieving competitive performance across various categories of machine learning tasks.
Our findings demonstrate the potential of utilizing classically intractable quantum correlations for effective machine learning.
arXiv Detail & Related papers (2024-07-02T18:00:00Z) - Quantum Visual Feature Encoding Revisited [8.839645003062456]
This paper revisits the quantum visual encoding strategies, the initial step in quantum machine learning.
Investigating the root cause, we uncover that the existing quantum encoding design fails to ensure information preservation of the visual features after the encoding process.
We introduce a new loss function named Quantum Information Preserving to minimize this gap, resulting in enhanced performance of quantum machine learning algorithms.
arXiv Detail & Related papers (2024-05-30T06:15:08Z) - Quantum Mixed-State Self-Attention Network [3.1280831148667105]
This paper introduces a novel Quantum Mixed-State Attention Network (QMSAN), which integrates the principles of quantum computing with classical machine learning algorithms.
QMSAN model employs a quantum attention mechanism based on mixed states, enabling efficient direct estimation of similarity between queries and keys within the quantum domain.
Our study investigates the model's robustness in different quantum noise environments, showing that QMSAN possesses commendable robustness to low noise.
arXiv Detail & Related papers (2024-03-05T11:29:05Z) - Neural auto-designer for enhanced quantum kernels [59.616404192966016]
We present a data-driven approach that automates the design of problem-specific quantum feature maps.
Our work highlights the substantial role of deep learning in advancing quantum machine learning.
arXiv Detail & Related papers (2024-01-20T03:11:59Z) - Quantum Generative Adversarial Networks: Bridging Classical and Quantum
Realms [0.6827423171182153]
We explore the synergistic fusion of classical and quantum computing paradigms within the realm of Generative Adversarial Networks (GANs)
Our objective is to seamlessly integrate quantum computational elements into the conventional GAN architecture, thereby unlocking novel pathways for enhanced training processes.
This research is positioned at the forefront of quantum-enhanced machine learning, presenting a critical stride towards harnessing the computational power of quantum systems.
arXiv Detail & Related papers (2023-12-15T16:51:36Z) - Quantum data learning for quantum simulations in high-energy physics [55.41644538483948]
We explore the applicability of quantum-data learning to practical problems in high-energy physics.
We make use of ansatz based on quantum convolutional neural networks and numerically show that it is capable of recognizing quantum phases of ground states.
The observation of non-trivial learning properties demonstrated in these benchmarks will motivate further exploration of the quantum-data learning architecture in high-energy physics.
arXiv Detail & Related papers (2023-06-29T18:00:01Z) - Quantum Machine Learning: from physics to software engineering [58.720142291102135]
We show how classical machine learning approach can help improve the facilities of quantum computers.
We discuss how quantum algorithms and quantum computers may be useful for solving classical machine learning tasks.
arXiv Detail & Related papers (2023-01-04T23:37:45Z) - QuanGCN: Noise-Adaptive Training for Robust Quantum Graph Convolutional
Networks [124.7972093110732]
We propose quantum graph convolutional networks (QuanGCN), which learns the local message passing among nodes with the sequence of crossing-gate quantum operations.
To mitigate the inherent noises from modern quantum devices, we apply sparse constraint to sparsify the nodes' connections.
Our QuanGCN is functionally comparable or even superior than the classical algorithms on several benchmark graph datasets.
arXiv Detail & Related papers (2022-11-09T21:43:16Z) - Recent Advances for Quantum Neural Networks in Generative Learning [98.88205308106778]
Quantum generative learning models (QGLMs) may surpass their classical counterparts.
We review the current progress of QGLMs from the perspective of machine learning.
We discuss the potential applications of QGLMs in both conventional machine learning tasks and quantum physics.
arXiv Detail & Related papers (2022-06-07T07:32:57Z) - Storage properties of a quantum perceptron [0.0]
We investigate the storage capacity of a particular quantum perceptron architecture.
We focus on a specific quantum perceptron model and explore its storage properties in the limit of a large number of inputs.
arXiv Detail & Related papers (2021-11-16T12:32:34Z) - Experimental Quantum Generative Adversarial Networks for Image
Generation [93.06926114985761]
We experimentally achieve the learning and generation of real-world hand-written digit images on a superconducting quantum processor.
Our work provides guidance for developing advanced quantum generative models on near-term quantum devices.
arXiv Detail & Related papers (2020-10-13T06:57:17Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.