Entanglement Induced Barren Plateaus
- URL: http://arxiv.org/abs/2010.15968v2
- Date: Wed, 10 Mar 2021 14:02:00 GMT
- Title: Entanglement Induced Barren Plateaus
- Authors: Carlos Ortiz Marrero, M\'aria Kieferov\'a, Nathan Wiebe
- Abstract summary: We argue that an excess in entanglement between the visible and hidden units in a Quantum Neural Network can hinder learning.
We show that quantum neural networks that satisfy a volume-law in the entanglement entropy will give rise to models not suitable for learning with high probability.
- Score: 2.8038382295783943
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: We argue that an excess in entanglement between the visible and hidden units
in a Quantum Neural Network can hinder learning. In particular, we show that
quantum neural networks that satisfy a volume-law in the entanglement entropy
will give rise to models not suitable for learning with high probability. Using
arguments from quantum thermodynamics, we then show that this volume law is
typical and that there exists a barren plateau in the optimization landscape
due to entanglement. More precisely, we show that for any bounded objective
function on the visible layers, the Lipshitz constants of the expectation value
of that objective function will scale inversely with the dimension of the
hidden-subsystem with high probability. We show how this can cause both
gradient descent and gradient-free methods to fail. We note that similar
problems can happen with quantum Boltzmann machines, although stronger
assumptions on the coupling between the hidden/visible subspaces are necessary.
We highlight how pretraining such generative models may provide a way to
navigate these barren plateaus.
Related papers
- Fourier Neural Operators for Learning Dynamics in Quantum Spin Systems [77.88054335119074]
We use FNOs to model the evolution of random quantum spin systems.
We apply FNOs to a compact set of Hamiltonian observables instead of the entire $2n$ quantum wavefunction.
arXiv Detail & Related papers (2024-09-05T07:18:09Z) - Exploiting hidden structures in non-convex games for convergence to Nash
equilibrium [62.88214569402201]
A wide array of modern machine learning applications can be formulated as non-cooperative Nashlibria.
We provide explicit convergence guarantees for both deterministic and deterministic environments.
arXiv Detail & Related papers (2023-12-27T15:21:25Z) - Does provable absence of barren plateaus imply classical simulability? Or, why we need to rethink variational quantum computing [0.0]
We ask: Can the structure that allows one to avoid barren plateaus also be leveraged to efficiently simulate the loss classically?
We present strong evidence that commonly used models with provable absence of barren plateaus are also classically simulable.
Our analysis sheds serious doubt on the non-classicality of the information processing capabilities of parametrized quantum circuits for barren plateau-free landscapes.
arXiv Detail & Related papers (2023-12-14T16:54:57Z) - Tight and Efficient Gradient Bounds for Parameterized Quantum Circuits [7.0379869298557844]
Training a parameterized model largely depends on the landscape of the underlying loss function.
We show that these bounds, as well as the variance of the loss itself, can be estimated efficiently and classically-versa--providing practical tools to study the loss landscapes of VQA models.
This insight has direct implications for hybrid Quantum Generative Adrial Networks (qGANs), a generative model that can be reformulated as a VQA with an observable composed of local and global terms.
arXiv Detail & Related papers (2023-09-22T07:38:13Z) - Laziness, Barren Plateau, and Noise in Machine Learning [10.058827198658252]
We discuss the difference between laziness and emphbarren plateau in quantum machine learning.
We show that variational quantum algorithms are noise-resilient in the overparametrization regime.
arXiv Detail & Related papers (2022-06-19T02:58:14Z) - Transition to chaos in extended systems and their quantum impurity
models [0.0]
Chaos sets a fundamental limit to quantum-information processing schemes.
We study the onset of chaos in spatially extended quantum many-body systems that are relevant to quantum optical devices.
arXiv Detail & Related papers (2022-05-02T18:01:09Z) - Diagnosing Barren Plateaus with Tools from Quantum Optimal Control [0.0]
Variational Quantum Algorithms (VQAs) have received considerable attention due to their potential for achieving near-term quantum advantage.
One known scaling result for VQAs is barren plateaus, where certain circumstances lead to exponentially vanishing gradients.
We employ tools from quantum optimal control to develop a framework that can diagnose the presence or absence of barren plateaus for problem-inspired ansatzes.
arXiv Detail & Related papers (2021-05-29T21:36:24Z) - The Hintons in your Neural Network: a Quantum Field Theory View of Deep
Learning [84.33745072274942]
We show how to represent linear and non-linear layers as unitary quantum gates, and interpret the fundamental excitations of the quantum model as particles.
On top of opening a new perspective and techniques for studying neural networks, the quantum formulation is well suited for optical quantum computing.
arXiv Detail & Related papers (2021-03-08T17:24:29Z) - Continuous-time dynamics and error scaling of noisy highly-entangling
quantum circuits [58.720142291102135]
We simulate a noisy quantum Fourier transform processor with up to 21 qubits.
We take into account microscopic dissipative processes rather than relying on digital error models.
We show that depending on the dissipative mechanisms at play, the choice of input state has a strong impact on the performance of the quantum algorithm.
arXiv Detail & Related papers (2021-02-08T14:55:44Z) - Quantum anomalous Hall phase in synthetic bilayers via twistless
twistronics [58.720142291102135]
We propose quantum simulators of "twistronic-like" physics based on ultracold atoms and syntheticdimensions.
We show that our system exhibits topologicalband structures under appropriate conditions.
arXiv Detail & Related papers (2020-08-06T19:58:05Z) - The role of boundary conditions in quantum computations of scattering
observables [58.720142291102135]
Quantum computing may offer the opportunity to simulate strongly-interacting field theories, such as quantum chromodynamics, with physical time evolution.
As with present-day calculations, quantum computation strategies still require the restriction to a finite system size.
We quantify the volume effects for various $1+1$D Minkowski-signature quantities and show that these can be a significant source of systematic uncertainty.
arXiv Detail & Related papers (2020-07-01T17:43:11Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.