Hyperparameter Importance of Quantum Neural Networks Across Small Datasets

• URL: http://arxiv.org/abs/2206.09992v1
• Date: Mon, 20 Jun 2022 20:26:20 GMT
• Title: Hyperparameter Importance of Quantum Neural Networks Across Small Datasets
• Authors: Charles Moussa, Jan N. van Rijn, Thomas B\"ack, Vedran Dunjko
• Abstract summary: A quantum neural network can play a similar role to a neural network. Very little is known about suitable circuit architectures for machine learning. This work introduces new methodologies to study quantum machine learning models.
• Score: 1.1470070927586014
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: As restricted quantum computers are slowly becoming a reality, the search for meaningful first applications intensifies. In this domain, one of the more investigated approaches is the use of a special type of quantum circuit - a so-called quantum neural network -- to serve as a basis for a machine learning model. Roughly speaking, as the name suggests, a quantum neural network can play a similar role to a neural network. However, specifically for applications in machine learning contexts, very little is known about suitable circuit architectures, or model hyperparameters one should use to achieve good learning performance. In this work, we apply the functional ANOVA framework to quantum neural networks to analyze which of the hyperparameters were most influential for their predictive performance. We analyze one of the most typically used quantum neural network architectures. We then apply this to $7$ open-source datasets from the OpenML-CC18 classification benchmark whose number of features is small enough to fit on quantum hardware with less than $20$ qubits. Three main levels of importance were detected from the ranking of hyperparameters obtained with functional ANOVA. Our experiment both confirmed expected patterns and revealed new insights. For instance, setting well the learning rate is deemed the most critical hyperparameter in terms of marginal contribution on all datasets, whereas the particular choice of entangling gates used is considered the least important except on one dataset. This work introduces new methodologies to study quantum machine learning models and provides new insights toward quantum model selection.

Related papers

• Quantum Convolutional Neural Network: A Hybrid Quantum-Classical Approach for Iris Dataset Classification [0.0]
  We present a hybrid quantum-classical machine learning model for classification tasks, integrating a 4-qubit quantum circuit with a classical neural network. The model was trained over 20 epochs, achieving a perfect 100% accuracy on the Iris dataset test set on 16 epoch. This work contributes to the growing body of research on hybrid quantum-classical models and their applicability to real-world datasets.
  arXiv  Detail & Related papers  (2024-10-21T13:15:12Z)
• Studying the Impact of Quantum-Specific Hyperparameters on Hybrid Quantum-Classical Neural Networks [4.951980887762045]
  hybrid quantum-classical neural networks (HQNNs) represent a promising solution that combines the strengths of classical machine learning with quantum computing capabilities. In this paper, we investigate the impact of these variations on different HQNN models for image classification tasks, implemented on the PennyLane framework. We aim to uncover intuitive and counter-intuitive learning patterns of HQNN models within granular levels of controlled quantum perturbations, to form a sound basis for their correlation to accuracy and training time.
  arXiv  Detail & Related papers  (2024-02-16T11:44:25Z)
• Neural auto-designer for enhanced quantum kernels [59.616404192966016]
  We present a data-driven approach that automates the design of problem-specific quantum feature maps. Our work highlights the substantial role of deep learning in advancing quantum machine learning.
  arXiv  Detail & Related papers  (2024-01-20T03:11:59Z)
• Bridging Classical and Quantum Machine Learning: Knowledge Transfer From Classical to Quantum Neural Networks Using Knowledge Distillation [0.0]
  This paper introduces a new method to transfer knowledge from classical to quantum neural networks using knowledge distillation. We adapt classical convolutional neural network (CNN) architectures like LeNet and AlexNet to serve as teacher networks. Quantum models achieve an average accuracy improvement of 0.80% on the MNIST dataset and 5.40% on the more complex Fashion MNIST dataset.
  arXiv  Detail & Related papers  (2023-11-23T05:06:43Z)
• ShadowNet for Data-Centric Quantum System Learning [188.683909185536]
  We propose a data-centric learning paradigm combining the strength of neural-network protocols and classical shadows. Capitalizing on the generalization power of neural networks, this paradigm can be trained offline and excel at predicting previously unseen systems. We present the instantiation of our paradigm in quantum state tomography and direct fidelity estimation tasks and conduct numerical analysis up to 60 qubits.
  arXiv  Detail & Related papers  (2023-08-22T09:11:53Z)
• Quantum HyperNetworks: Training Binary Neural Networks in Quantum Superposition [16.1356415877484]
  We introduce quantum hypernetworks as a mechanism to train binary neural networks on quantum computers. We show that our approach effectively finds optimal parameters, hyperparameters and architectural choices with high probability on classification problems. Our unified approach provides an immense scope for other applications in the field of machine learning.
  arXiv  Detail & Related papers  (2023-01-19T20:06:48Z)
• A didactic approach to quantum machine learning with a single qubit [68.8204255655161]
  We focus on the case of learning with a single qubit, using data re-uploading techniques. We implement the different proposed formulations in toy and real-world datasets using the qiskit quantum computing SDK.
  arXiv  Detail & Related papers  (2022-11-23T18:25:32Z)
• Multiclass classification using quantum convolutional neural networks with hybrid quantum-classical learning [0.5999777817331318]
  We propose a quantum machine learning approach based on quantum convolutional neural networks for solving multiclass classification problems. We use the proposed approach to demonstrate the 4-class classification for the case of the MNIST dataset using eight qubits for data encoding and four acnilla qubits. Our results demonstrate comparable accuracy of our solution with classical convolutional neural networks with comparable numbers of trainable parameters.
  arXiv  Detail & Related papers  (2022-03-29T09:07:18Z)
• Quantum-tailored machine-learning characterization of a superconducting qubit [50.591267188664666]
  We develop an approach to characterize the dynamics of a quantum device and learn device parameters. This approach outperforms physics-agnostic recurrent neural networks trained on numerically generated and experimental data. This demonstration shows how leveraging domain knowledge improves the accuracy and efficiency of this characterization task.
  arXiv  Detail & Related papers  (2021-06-24T15:58:57Z)
• Quantum Federated Learning with Quantum Data [87.49715898878858]
  Quantum machine learning (QML) has emerged as a promising field that leans on the developments in quantum computing to explore large complex machine learning problems. This paper proposes the first fully quantum federated learning framework that can operate over quantum data and, thus, share the learning of quantum circuit parameters in a decentralized manner.
  arXiv  Detail & Related papers  (2021-05-30T12:19:27Z)
• Machine learning transfer efficiencies for noisy quantum walks [62.997667081978825]
  We show that the process of finding requirements on both a graph type and a quantum system coherence can be automated. The automation is done by using a convolutional neural network of a particular type that learns to understand with which network and under which coherence requirements quantum advantage is possible. Our results are of importance for demonstration of advantage in quantum experiments and pave the way towards automating scientific research and discoveries.
  arXiv  Detail & Related papers  (2020-01-15T18:36:53Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.