Towards Practical Quantum Neural Network Diagnostics with Neural Tangent Kernels

• URL: http://arxiv.org/abs/2503.01966v1
• Date: Mon, 03 Mar 2025 19:00:02 GMT
• Title: Towards Practical Quantum Neural Network Diagnostics with Neural Tangent Kernels
• Authors: Francesco Scala, Christa Zoufal, Dario Gerace, Francesco Tacchino,
• Abstract summary: We propose a framework allowing to employ the Quantum Neural Tangent Kernel (QNTK) for Quantum Neural Network (QNN) performance diagnostics.<n>We show how a critical learning rate and a characteristic decay time for the average training error can be estimated from the spectrum of the QNTK evaluated.<n>We then show how a QNTK-based kernel formula can be used to analyze, up to a first-order approximation, the expected inference capabilities of the quantum model under study.
• Score: 0.8437187555622164
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Knowing whether a Quantum Machine Learning model would perform well on a given dataset before training it can help to save critical resources. However, gathering a priori information about model performance (e.g., training speed, critical hyperparameters, or inference capabilities on unseen data) is a highly non-trivial task, in general. Recently, the Quantum Neural Tangent Kernel (QNTK) has been proposed as a powerful mathematical tool to describe the behavior of Quantum Neural Network (QNN) models. In this work, we propose a practical framework allowing to employ the QNTK for QNN performance diagnostics. More specifically, we show how a critical learning rate and a characteristic decay time for the average training error can be estimated from the spectrum of the QNTK evaluated at the initialization stage. We then show how a QNTK-based kernel formula can be used to analyze, up to a first-order approximation, the expected inference capabilities of the quantum model under study. We validate our proposed approach with extensive numerical simulations, using different QNN architectures and datasets. Our results demonstrate that QNTK diagnostics yields accurate approximations of QNN behavior for sufficiently deep circuits, can provide insights for shallow QNNs, and enables detecting - hence also addressing - potential shortcomings in model design.

Related papers

• Benchmarking Quantum Convolutional Neural Networks for Signal Classification in Simulated Gamma-Ray Burst Detection [29.259008600842517]
  This study evaluates the use of Quantum Convolutional Neural Networks (QCNNs) for identifying signals resembling Gamma-Ray Bursts (GRBs)<n>We implement a hybrid quantum-classical machine learning technique using the Qiskit framework, with the QCNNs trained on a quantum simulator.<n>QCNNs showed robust performance on time-series datasets, successfully detecting GRB signals with high precision.
  arXiv  Detail & Related papers  (2025-01-28T16:07:12Z)
• Optimizer-Dependent Generalization Bound for Quantum Neural Networks [5.641998714611475]
  Quantum neural networks (QNNs) play a pivotal role in addressing complex tasks within quantum machine learning.<n>We investigate the generalization properties of QNNs through the lens of learning algorithm stability.<n>Our work offers practical insights for applying QNNs in quantum machine learning.
  arXiv  Detail & Related papers  (2025-01-27T17:22:34Z)
• Coherent Feed Forward Quantum Neural Network [2.1178416840822027]
  Quantum machine learning, focusing on quantum neural networks (QNNs), remains a vastly uncharted field of study. We introduce a bona fide QNN model, which seamlessly aligns with the versatility of a traditional FFNN in terms of its adaptable intermediate layers and nodes. We test our proposed model on various benchmarking datasets such as the diagnostic breast cancer (Wisconsin) and credit card fraud detection datasets.
  arXiv  Detail & Related papers  (2024-02-01T15:13:26Z)
• How neural networks learn to classify chaotic time series [77.34726150561087]
  We study the inner workings of neural networks trained to classify regular-versus-chaotic time series. We find that the relation between input periodicity and activation periodicity is key for the performance of LKCNN models.
  arXiv  Detail & Related papers  (2023-06-04T08:53:27Z)
• Analyzing Convergence in Quantum Neural Networks: Deviations from Neural Tangent Kernels [20.53302002578558]
  A quantum neural network (QNN) is a parameterized mapping efficiently implementable on near-term Noisy Intermediate-Scale Quantum (NISQ) computers. Despite the existing empirical and theoretical investigations, the convergence of QNN training is not fully understood.
  arXiv  Detail & Related papers  (2023-03-26T22:58:06Z)
• Problem-Dependent Power of Quantum Neural Networks on Multi-Class Classification [83.20479832949069]
  Quantum neural networks (QNNs) have become an important tool for understanding the physical world, but their advantages and limitations are not fully understood. Here we investigate the problem-dependent power of QCs on multi-class classification tasks. Our work sheds light on the problem-dependent power of QNNs and offers a practical tool for evaluating their potential merit.
  arXiv  Detail & Related papers  (2022-12-29T10:46:40Z)
• Quantization-aware Interval Bound Propagation for Training Certifiably Robust Quantized Neural Networks [58.195261590442406]
  We study the problem of training and certifying adversarially robust quantized neural networks (QNNs) Recent work has shown that floating-point neural networks that have been verified to be robust can become vulnerable to adversarial attacks after quantization. We present quantization-aware interval bound propagation (QA-IBP), a novel method for training robust QNNs.
  arXiv  Detail & Related papers  (2022-11-29T13:32:38Z)
• Branching Quantum Convolutional Neural Networks [0.0]
  Small-scale quantum computers are already showing potential gains in learning tasks on large quantum and very large classical data sets. We present a generalization of QCNN, the branching quantum convolutional neural network, or bQCNN, with substantially higher expressibility.
  arXiv  Detail & Related papers  (2020-12-28T19:00:03Z)
• Toward Trainability of Quantum Neural Networks [87.04438831673063]
  Quantum Neural Networks (QNNs) have been proposed as generalizations of classical neural networks to achieve the quantum speed-up. Serious bottlenecks exist for training QNNs due to the vanishing with gradient rate exponential to the input qubit number. We show that QNNs with tree tensor and step controlled structures for the application of binary classification. Simulations show faster convergent rates and better accuracy compared to QNNs with random structures.
  arXiv  Detail & Related papers  (2020-11-12T08:32:04Z)
• Decentralizing Feature Extraction with Quantum Convolutional Neural Network for Automatic Speech Recognition [101.69873988328808]
  We build upon a quantum convolutional neural network (QCNN) composed of a quantum circuit encoder for feature extraction. An input speech is first up-streamed to a quantum computing server to extract Mel-spectrogram. The corresponding convolutional features are encoded using a quantum circuit algorithm with random parameters. The encoded features are then down-streamed to the local RNN model for the final recognition.
  arXiv  Detail & Related papers  (2020-10-26T03:36:01Z)
• On the learnability of quantum neural networks [132.1981461292324]
  We consider the learnability of the quantum neural network (QNN) built on the variational hybrid quantum-classical scheme. We show that if a concept can be efficiently learned by QNN, then it can also be effectively learned by QNN even with gate noise.
  arXiv  Detail & Related papers  (2020-07-24T06:34:34Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.