Convergence analysis of particle swarm optimization using stochastic Lyapunov functions and quantifier elimination

• URL: http://arxiv.org/abs/2002.01673v1
• Date: Wed, 5 Feb 2020 07:47:07 GMT
• Title: Convergence analysis of particle swarm optimization using stochastic Lyapunov functions and quantifier elimination
• Authors: Maximilian Gerwien, Rick Vo{\ss}winkel, and Hendrik Richter
• Abstract summary: We employ Lyapunov functions to determine the convergence set by quantifier elimination. We show that this approach leads to reevaluation and extension of previously know stability regions for PSO.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: This paper adds to the discussion about theoretical aspects of particle swarm stability by proposing to employ stochastic Lyapunov functions and to determine the convergence set by quantifier elimination. We present a computational procedure and show that this approach leads to reevaluation and extension of previously know stability regions for PSO using a Lyapunov approach under stagnation assumptions.

Related papers

• Asymptotically Optimal Change Detection for Unnormalized Pre- and Post-Change Distributions [65.38208224389027]
  This paper addresses the problem of detecting changes when only unnormalized pre- and post-change distributions are accessible. Our approach is based on the estimation of the Cumulative Sum statistics, which is known to produce optimal performance.
  arXiv  Detail & Related papers  (2024-10-18T17:13:29Z)
• A Unified Theory of Stochastic Proximal Point Methods without Smoothness [52.30944052987393]
  Proximal point methods have attracted considerable interest owing to their numerical stability and robustness against imperfect tuning. This paper presents a comprehensive analysis of a broad range of variations of the proximal point method (SPPM)
  arXiv  Detail & Related papers  (2024-05-24T21:09:19Z)
• Understanding Diffusion Models by Feynman's Path Integral [2.4373900721120285]
  We introduce a novel formulation of diffusion models using Feynman's integral path. We find this formulation providing comprehensive descriptions of score-based generative models. We also demonstrate the derivation of backward differential equations and loss functions.
  arXiv  Detail & Related papers  (2024-03-17T16:24:29Z)
• Generalization Bounds for Heavy-Tailed SDEs through the Fractional Fokker-Planck Equation [1.8416014644193066]
  We prove high-probability bounds generalization for heavy-tailed SDEs with no nontrivial information theoretic terms. Our results suggest that heavy tails can be either beneficial or harmful depending on the problem structure.
  arXiv  Detail & Related papers  (2024-02-12T15:35:32Z)
• PAPAL: A Provable PArticle-based Primal-Dual ALgorithm for Mixed Nash Equilibrium [62.51015395213579]
  We consider the non-AL equilibrium nonconptotic objective function in two-player zero-sum continuous games. The proposed algorithm employs the movements of particles to represent the updates of random strategies for the $ilon$-mixed Nash equilibrium.
  arXiv  Detail & Related papers  (2023-03-02T05:08:15Z)
• A Concentration Bound for Distributed Stochastic Approximation [0.0]
  We revisit the classical model of Tsitsiklis, Bertsekas and Athans for distributed approximation with consensus. The main result is an analysis of this scheme using the ODE approach, leading to a high probability bound for the tracking error between suitably iterates.
  arXiv  Detail & Related papers  (2022-10-09T13:00:32Z)
• Capacity dependent analysis for functional online learning algorithms [8.748563565641279]
  This article provides convergence analysis of online gradient descent algorithms for functional linear models. We show that capacity assumption can alleviate the saturation of the convergence rate as the regularity of the target function increases.
  arXiv  Detail & Related papers  (2022-09-25T11:21:18Z)
• Counting Phases and Faces Using Bayesian Thermodynamic Integration [77.34726150561087]
  We introduce a new approach to reconstruction of the thermodynamic functions and phase boundaries in two-parametric statistical mechanics systems. We use the proposed approach to accurately reconstruct the partition functions and phase diagrams of the Ising model and the exactly solvable non-equilibrium TASEP.
  arXiv  Detail & Related papers  (2022-05-18T17:11:23Z)
• A Stochastic Newton Algorithm for Distributed Convex Optimization [62.20732134991661]
  We analyze a Newton algorithm for homogeneous distributed convex optimization, where each machine can calculate gradients of the same population objective. We show that our method can reduce the number, and frequency, of required communication rounds compared to existing methods without hurting performance.
  arXiv  Detail & Related papers  (2021-10-07T17:51:10Z)
• Stability Analysis of Quantum Systems: a Lyapunov Criterion and an Invariance Principle [1.7360163137925997]
  We show that the set of invariant density operators is both closed and convex. We then show how to analyze the stability of this set via a candidate Lyapunov operator.
  arXiv  Detail & Related papers  (2020-08-01T06:53:20Z)
• Optimization with Momentum: Dynamical, Control-Theoretic, and Symplectic Perspectives [97.16266088683061]
  The article rigorously establishes why symplectic discretization schemes are important for momentum-based optimization algorithms. It provides a characterization of algorithms that exhibit accelerated convergence.
  arXiv  Detail & Related papers  (2020-02-28T00:32:47Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.