Generalization despite overfitting in quantum machine learning models

• URL: http://arxiv.org/abs/2209.05523v2
• Date: Fri, 15 Dec 2023 00:43:11 GMT
• Title: Generalization despite overfitting in quantum machine learning models
• Authors: Evan Peters and Maria Schuld
• Abstract summary: We provide a characterization of benign overfitting in quantum models. We show how a class of quantum models exhibits analogous features. We intuitively explain these features according to the ability of the quantum model to interpolate noisy data with locally "spiky" behavior.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The widespread success of deep neural networks has revealed a surprise in classical machine learning: very complex models often generalize well while simultaneously overfitting training data. This phenomenon of benign overfitting has been studied for a variety of classical models with the goal of better understanding the mechanisms behind deep learning. Characterizing the phenomenon in the context of quantum machine learning might similarly improve our understanding of the relationship between overfitting, overparameterization, and generalization. In this work, we provide a characterization of benign overfitting in quantum models. To do this, we derive the behavior of a classical interpolating Fourier features models for regression on noisy signals, and show how a class of quantum models exhibits analogous features, thereby linking the structure of quantum circuits (such as data-encoding and state preparation operations) to overparameterization and overfitting in quantum models. We intuitively explain these features according to the ability of the quantum model to interpolate noisy data with locally "spiky" behavior and provide a concrete demonstration example of benign overfitting.

Related papers

• Emergence of global receptive fields capturing multipartite quantum correlations [0.565473932498362]
  In quantum physics, even simple data with a well-defined structure at the wave function level can be characterized by extremely complex correlations. We show that monitoring the neural network weight space while learning quantum statistics allows to develop physical intuition about complex multipartite patterns. Our findings suggest a fresh look at constructing convolutional neural networks for processing data with non-local patterns.
  arXiv  Detail & Related papers  (2024-08-23T12:45:40Z)
• A General Approach to Dropout in Quantum Neural Networks [1.5771347525430772]
  "Overfitting" is the phenomenon occurring when a given model learns the training data excessively well. With the advent of Quantum Neural Networks as learning models, overfitting might soon become an issue.
  arXiv  Detail & Related papers  (2023-10-06T09:39:30Z)
• Quantum data learning for quantum simulations in high-energy physics [55.41644538483948]
  We explore the applicability of quantum-data learning to practical problems in high-energy physics. We make use of ansatz based on quantum convolutional neural networks and numerically show that it is capable of recognizing quantum phases of ground states. The observation of non-trivial learning properties demonstrated in these benchmarks will motivate further exploration of the quantum-data learning architecture in high-energy physics.
  arXiv  Detail & Related papers  (2023-06-29T18:00:01Z)
• Understanding quantum machine learning also requires rethinking generalization [0.3683202928838613]
  We show that traditional approaches to understanding generalization fail to explain the behavior of quantum models. Experiments reveal that state-of-the-art quantum neural networks accurately fit random states and random labeling of training data.
  arXiv  Detail & Related papers  (2023-06-23T12:04:13Z)
• The Quantum Path Kernel: a Generalized Quantum Neural Tangent Kernel for Deep Quantum Machine Learning [52.77024349608834]
  Building a quantum analog of classical deep neural networks represents a fundamental challenge in quantum computing. Key issue is how to address the inherent non-linearity of classical deep learning. We introduce the Quantum Path Kernel, a formulation of quantum machine learning capable of replicating those aspects of deep machine learning.
  arXiv  Detail & Related papers  (2022-12-22T16:06:24Z)
• A didactic approach to quantum machine learning with a single qubit [68.8204255655161]
  We focus on the case of learning with a single qubit, using data re-uploading techniques. We implement the different proposed formulations in toy and real-world datasets using the qiskit quantum computing SDK.
  arXiv  Detail & Related papers  (2022-11-23T18:25:32Z)
• Generalization Metrics for Practical Quantum Advantage in Generative Models [68.8204255655161]
  Generative modeling is a widely accepted natural use case for quantum computers. We construct a simple and unambiguous approach to probe practical quantum advantage for generative modeling by measuring the algorithm's generalization performance. Our simulation results show that our quantum-inspired models have up to a $68 times$ enhancement in generating unseen unique and valid samples.
  arXiv  Detail & Related papers  (2022-01-21T16:35:35Z)
• Phase diagram of quantum generalized Potts-Hopfield neural networks [0.0]
  We introduce and analyze an open quantum generalization of the q-state Potts-Hopfield neural network. The dynamics of this many-body system is formulated in terms of a Markovian master equation of Lindblad type.
  arXiv  Detail & Related papers  (2021-09-21T12:48:49Z)
• Quantum algorithms for quantum dynamics: A performance study on the spin-boson model [68.8204255655161]
  Quantum algorithms for quantum dynamics simulations are traditionally based on implementing a Trotter-approximation of the time-evolution operator. variational quantum algorithms have become an indispensable alternative, enabling small-scale simulations on present-day hardware. We show that, despite providing a clear reduction of quantum gate cost, the variational method in its current implementation is unlikely to lead to a quantum advantage.
  arXiv  Detail & Related papers  (2021-08-09T18:00:05Z)
• The Hintons in your Neural Network: a Quantum Field Theory View of Deep Learning [84.33745072274942]
  We show how to represent linear and non-linear layers as unitary quantum gates, and interpret the fundamental excitations of the quantum model as particles. On top of opening a new perspective and techniques for studying neural networks, the quantum formulation is well suited for optical quantum computing.
  arXiv  Detail & Related papers  (2021-03-08T17:24:29Z)
• Enhancing Generative Models via Quantum Correlations [1.6099403809839032]
  Generative modeling using samples drawn from the probability distribution constitutes a powerful approach for unsupervised machine learning. We show theoretically that such quantum correlations provide a powerful resource for generative modeling. We numerically test this separation on standard machine learning data sets and show that it holds for practical problems.
  arXiv  Detail & Related papers  (2021-01-20T22:57:22Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.