Statistical analysis of barren plateaus in variational quantum algorithms

• URL: http://arxiv.org/abs/2508.08915v1
• Date: Tue, 12 Aug 2025 13:08:33 GMT
• Title: Statistical analysis of barren plateaus in variational quantum algorithms
• Authors: Le Bin Ho, Jesus Urbaneja, Sahel Ashhab,
• Abstract summary: We investigate barren plateau (BP) phenomenon in variational quantum algorithms using a statistical approach.<n>The first type, which we called localized-dip BPs, occurs in landscapes that are mostly flat but contain a dip point where the gradient is large.<n>The second type, called localized-gorge BPs, which are somewhat similar to the localized-dip BPs but contain a gorge line.
• Score: 0.0
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: We investigate the barren plateau (BP) phenomenon in variational quantum algorithms using a statistical approach. Using Gaussian function models, we identify three distinct types of BPs. The first type, which we called localized-dip BPs, occurs in landscapes that are mostly flat but contain a dip point where the gradient is large in a small region around the minimum. The second type, called localized-gorge BPs, which are somewhat similar to the localized-dip BPs but contain a gorge line. The third type, called everywhere-flat BPs, appears when the entire landscape is uniformly flat with almost vanishing gradients, making optimization significantly more difficult. After illustrating these behaviors in the Gaussian function models, we extend the analysis to the variational quantum eigensolver (VQE). We consider two types of ans\"atze: the hardware-efficient ansatz and the random Pauli ansatz. For both ans\"atze, we only observe the everywhere-flat BPs. Using our statistical approach, we searched for localized-dip and localized-gorge BPs but found no evidence of such features in the examples studied, suggesting that everywhere-flat BPs dominate in these ans\"atze. Our method effectively probes landscape features by capturing the gradient scaling across parameter space, making it a useful tool for diagnosing BPs in variational algorithms. To mitigate BPs in the VQE, we employ a genetic algorithm (GA) to optimize the random gates generated in the ans\"atze, thereby reshaping the cost function landscape to enhance the optimization efficiency. A comparison with an unoptimized ansatz shows how the ansatz design can improve the scalability and reliability of variational quantum algorithms.

Related papers

• Hessian-guided Perturbed Wasserstein Gradient Flows for Escaping Saddle Points [54.06226763868876]
  Wasserstein flow (WGF) is a common method to perform optimization over the space of measures.<n>We show that PWGF converges to a global optimum in terms of general non objectives.
  arXiv  Detail & Related papers  (2025-09-21T08:14:20Z)
• Gaussian Process Tilted Nonparametric Density Estimation using Fisher Divergence Score Matching [3.7969209746164325]
  We present three Fisher divergence (FD) algorithms for learning Gaussian process (GP) based score models.<n>We show that all learning problems can be solved in closed form.<n>We demonstrate our three learning algorithms, as well as a MAP baseline algorithm, on several low dimensional density estimation problems.
  arXiv  Detail & Related papers  (2025-04-04T14:41:41Z)
• Local Loss Optimization in the Infinite Width: Stable Parameterization of Predictive Coding Networks and Target Propagation [8.35644084613785]
  We introduce the maximal update parameterization ($mu$P) in the infinite-width limit for two representative designs of local targets.<n>By analyzing deep linear networks, we found that PC's gradients interpolate between first-order and Gauss-Newton-like gradients.<n>We demonstrate that, in specific standard settings, PC in the infinite-width limit behaves more similarly to the first-order gradient.
  arXiv  Detail & Related papers  (2024-11-04T11:38:27Z)
• LAWS: Look Around and Warm-Start Natural Gradient Descent for Quantum Neural Networks [11.844238544360149]
  Vari quantum algorithms (VQAs) have recently received significant attention due to their promising performance in Noisy Intermediate-Scale Quantum computers (NISQ) VQAs run on parameterized quantum circuits (PQC) with randomlyational parameters are characterized by barren plateaus (BP) where the gradient vanishes exponentially in the number of qubits. In this paper, we first quantum natural gradient (QNG), which is one of the most popular algorithms used in VQA, from the classical first-order point of optimization. Then, we proposed a underlineAround underline
  arXiv  Detail & Related papers  (2022-05-05T14:16:40Z)
• Improved Convergence Rate of Stochastic Gradient Langevin Dynamics with Variance Reduction and its Application to Optimization [50.83356836818667]
  gradient Langevin Dynamics is one of the most fundamental algorithms to solve non-eps optimization problems. In this paper, we show two variants of this kind, namely the Variance Reduced Langevin Dynamics and the Recursive Gradient Langevin Dynamics.
  arXiv  Detail & Related papers  (2022-03-30T11:39:00Z)
• Scalable Bayesian Optimization Using Vecchia Approximations of Gaussian Processes [0.0]
  We adapt the Vecchia approximation, a popular GP approximation from spatial statistics, to enable scalable high-dimensional Bayesian optimization. We focus on the use of our warped Vecchia GP in trust-region Bayesian optimization via Thompson sampling.
  arXiv  Detail & Related papers  (2022-03-02T23:55:14Z)
• Planning and Learning with Adaptive Lookahead [74.39132848733847]
  Policy Iteration (PI) algorithm alternates between greedy one-step policy improvement and policy evaluation. Recent literature shows that multi-step lookahead policy improvement leads to a better convergence rate at the expense of increased complexity per iteration. We propose for the first time to dynamically adapt the multi-step lookahead horizon as a function of the state and of the value estimate.
  arXiv  Detail & Related papers  (2022-01-28T20:26:55Z)
• Avoiding barren plateaus using classical shadows [1.5749416770494702]
  Variational quantum algorithms are promising algorithms for achieving quantum advantage on near-term devices. The optimization landscape of expressive variational ans"atze is dominated by large regions in parameter space, known as barren plateaus.
  arXiv  Detail & Related papers  (2022-01-20T14:19:36Z)
• Scaling Structured Inference with Randomization [64.18063627155128]
  We propose a family of dynamic programming (RDP) randomized for scaling structured models to tens of thousands of latent states. Our method is widely applicable to classical DP-based inference. It is also compatible with automatic differentiation so can be integrated with neural networks seamlessly.
  arXiv  Detail & Related papers  (2021-12-07T11:26:41Z)
• Correcting Momentum with Second-order Information [50.992629498861724]
  We develop a new algorithm for non-critical optimization that finds an $O(epsilon)$epsilon point in the optimal product. We validate our results on a variety of large-scale deep learning benchmarks and architectures.
  arXiv  Detail & Related papers  (2021-03-04T19:01:20Z)
• Private Stochastic Non-Convex Optimization: Adaptive Algorithms and Tighter Generalization Bounds [72.63031036770425]
  We propose differentially private (DP) algorithms for bound non-dimensional optimization. We demonstrate two popular deep learning methods on the empirical advantages over standard gradient methods.
  arXiv  Detail & Related papers  (2020-06-24T06:01:24Z)
• Towards Better Understanding of Adaptive Gradient Algorithms in Generative Adversarial Nets [71.05306664267832]
  Adaptive algorithms perform gradient updates using the history of gradients and are ubiquitous in training deep neural networks. In this paper we analyze a variant of OptimisticOA algorithm for nonconcave minmax problems. Our experiments show that adaptive GAN non-adaptive gradient algorithms can be observed empirically.
  arXiv  Detail & Related papers  (2019-12-26T22:10:10Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.