Generalization Bounds for Quantum Learning via Rényi Divergences

• URL: http://arxiv.org/abs/2505.11025v1
• Date: Fri, 16 May 2025 09:21:31 GMT
• Title: Generalization Bounds for Quantum Learning via Rényi Divergences
• Authors: Naqueeb Ahmad Warsi, Ayanava Dasgupta, Masahito Hayashi,
• Abstract summary: This work advances the theoretical understanding of quantum learning by establishing a new family of upper bounds on the expected generalization error of quantum learning algorithms.<n>Our primary contribution is the derivation of these bounds in terms of quantum and classical R'enyi divergences.
• Score: 45.45698347373077
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: This work advances the theoretical understanding of quantum learning by establishing a new family of upper bounds on the expected generalization error of quantum learning algorithms, leveraging the framework introduced by Caro et al. (2024) and a new definition for the expected true loss. Our primary contribution is the derivation of these bounds in terms of quantum and classical R\'enyi divergences, utilizing a variational approach for evaluating quantum R\'enyi divergences, specifically the Petz and a newly introduced modified sandwich quantum R\'enyi divergence. Analytically and numerically, we demonstrate the superior performance of the bounds derived using the modified sandwich quantum R\'enyi divergence compared to those based on the Petz divergence. Furthermore, we provide probabilistic generalization error bounds using two distinct techniques: one based on the modified sandwich quantum R\'enyi divergence and classical R\'enyi divergence, and another employing smooth max R\'enyi divergence.

Related papers

• Reducing the sampling complexity of energy estimation in quantum many-body systems using empirical variance information [45.18582668677648]
  We consider the problem of estimating the energy of a quantum state preparation for a given Hamiltonian in Pauli decomposition.<n>We construct an adaptive estimator using the state's actual variance.
  arXiv  Detail & Related papers  (2025-02-03T19:00:01Z)
• Generalized quantum asymptotic equipartition [11.59751616011475]
  We prove that all operationally relevant divergences converge to the quantum relative entropy between two sets of quantum states.<n>We give three applications of this result: (i) The generalized AEP directly implies a new generalized quantum Stein's lemma for conducting quantum hypothesis testing between two sets of quantum states.<n>We derive a relative entropy accumulation theorem stating that the smoothed min-relative entropy between two sequential processes of quantum channels can be lower bounded by the sum of the regularized minimum output channel divergences.
  arXiv  Detail & Related papers  (2024-11-06T16:33:16Z)
• Limit Distribution Theory for Quantum Divergences [8.11839312231511]
  We show that a limit distribution theory which characterizes the fluctuations of the estimation error is still premature. As an application of our results, we consider an estimator of quantum relative entropy based on Pauli tomography of quantum states and show that the resulting distribution is a normal, with its variance characterized in terms of the Pauli operators and states. We utilize the knowledge of the aforementioned limit distribution to obtain performance guarantees for a multi-hypothesis testing problem.
  arXiv  Detail & Related papers  (2023-11-22T21:06:41Z)
• Normal quantum channels and Markovian correlated two-qubit quantum errors [77.34726150561087]
  We study general normally'' distributed random unitary transformations. On the one hand, a normal distribution induces a unital quantum channel. On the other hand, the diffusive random walk defines a unital quantum process.
  arXiv  Detail & Related papers  (2023-07-25T15:33:28Z)
• Quantum Rényi and $f$-divergences from integral representations [11.74020933567308]
  Smooth Csisz'ar $f$-divergences can be expressed as integrals over so-called hockey stick divergences. We find that the R'enyi divergences defined via our new quantum $f$-divergences are not additive in general. We derive various inequalities, including new reverse Pinsker inequalities with applications in differential privacy.
  arXiv  Detail & Related papers  (2023-06-21T15:39:38Z)
• The Quantum Path Kernel: a Generalized Quantum Neural Tangent Kernel for Deep Quantum Machine Learning [52.77024349608834]
  Building a quantum analog of classical deep neural networks represents a fundamental challenge in quantum computing. Key issue is how to address the inherent non-linearity of classical deep learning. We introduce the Quantum Path Kernel, a formulation of quantum machine learning capable of replicating those aspects of deep machine learning.
  arXiv  Detail & Related papers  (2022-12-22T16:06:24Z)
• Theory of Quantum Generative Learning Models with Maximum Mean Discrepancy [67.02951777522547]
  We study learnability of quantum circuit Born machines (QCBMs) and quantum generative adversarial networks (QGANs) We first analyze the generalization ability of QCBMs and identify their superiorities when the quantum devices can directly access the target distribution. Next, we prove how the generalization error bound of QGANs depends on the employed Ansatz, the number of qudits, and input states.
  arXiv  Detail & Related papers  (2022-05-10T08:05:59Z)
• Stochastic approximate state conversion for entanglement and general quantum resource theories [41.94295877935867]
  An important problem in any quantum resource theory is to determine how quantum states can be converted into each other. Very few results have been presented on the intermediate regime between probabilistic and approximate transformations. We show that these bounds imply an upper bound on the rates for various classes of states under probabilistic transformations. We also show that the deterministic version of the single copy bounds can be applied for drawing limitations on the manipulation of quantum channels.
  arXiv  Detail & Related papers  (2021-11-24T17:29:43Z)
• Near-Optimal Quantum Algorithms for Multivariate Mean Estimation [0.0]
  We propose the first near-optimal quantum algorithm for estimating in Euclidean norm the mean of a vector-valued random variable. We exploit a variety of additional algorithmic techniques such as amplitude amplification, the Bernstein-Vazirani algorithm, and quantum singular value transformation.
  arXiv  Detail & Related papers  (2021-11-18T16:35:32Z)
• Quantum R\'enyi divergences and the strong converse exponent of state discrimination in operator algebras [0.0]
  The sandwiched R'enyi divergences of two finite-dimensional quantum states play a distinguished role among the many quantum versions of R'enyi divergences. We show the same for the sandwiched R'enyi divergences of two normal states on an injective von Neumann algebra. We also initiate the study of the sandwiched R'enyi divergences of pairs of states on a $C*$-algebra.
  arXiv  Detail & Related papers  (2021-10-14T12:54:57Z)
• Experimental violations of Leggett-Garg's inequalities on a quantum computer [77.34726150561087]
  We experimentally observe the violations of Leggett-Garg-Bell's inequalities on single and multi-qubit systems. Our analysis highlights the limits of nowadays quantum platforms, showing that the above-mentioned correlation functions deviate from theoretical prediction as the number of qubits and the depth of the circuit grow.
  arXiv  Detail & Related papers  (2021-09-06T14:35:15Z)
• R\'enyi divergence inequalities via interpolation, with applications to generalised entropic uncertainty relations [91.3755431537592]
  We investigate quantum R'enyi entropic quantities, specifically those derived from'sandwiched' divergence. We present R'enyi mutual information decomposition rules, a new approach to the R'enyi conditional entropy tripartite chain rules and a more general bipartite comparison.
  arXiv  Detail & Related papers  (2021-06-19T04:06:23Z)
• On the quantumness of multiparameter estimation problems for qubit systems [0.0]
  We consider several estimation problems for qubit systems and evaluate the corresponding quantumness R. R is an upper bound for the renormalized difference between the (asymptotically achievable) Holevo bound and the SLD Cram'er-Rao bound.
  arXiv  Detail & Related papers  (2020-10-23T19:21:50Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.