Influence of Binomial Crossover on Approximation Error of Evolutionary
Algorithms
- URL: http://arxiv.org/abs/2109.14195v3
- Date: Mon, 15 Aug 2022 15:13:34 GMT
- Title: Influence of Binomial Crossover on Approximation Error of Evolutionary
Algorithms
- Authors: Cong Wang and Jun He and Yu Chen and Xiufen Zou
- Abstract summary: This paper aims to answer whether binomial crossover can reduce the approximation error of evolutionary algorithms.
It is proven that using binomial crossover leads to the dominance of transition matrices.
An adaptive parameter strategy is proposed which can strengthen the superiority of binomial crossover on Deceptive.
- Score: 10.984298685238445
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Although differential evolution (DE) algorithms perform well on a large
variety of complicated optimization problems, only a few theoretical studies
are focused on the working principle of DE algorithms. To make the first
attempt to reveal the function of binomial crossover, this paper aims to answer
whether it can reduce the approximation error of evolutionary algorithms. By
investigating the expected approximation error and the probability of not
finding the optimum, we conduct a case study comparing two evolutionary
algorithms with and without binomial crossover on two classical benchmark
problems: OneMax and Deceptive. It is proven that using binomial crossover
leads to the dominance of transition matrices. As a result, the algorithm with
binomial crossover asymptotically outperforms that without crossover on both
OneMax and Deceptive, and outperforms on OneMax, however, not on Deceptive.
Furthermore, an adaptive parameter strategy is proposed which can strengthen
the superiority of binomial crossover on Deceptive.
Related papers
- Runtime Analysis of a Multi-Valued Compact Genetic Algorithm on Generalized OneMax [2.07180164747172]
We provide a first runtime analysis of a generalized OneMax function.
We show that the r-cGA solves this r-valued OneMax problem efficiently.
At the end of experiments, we state one conjecture related to the expected runtime of another variant of multi-valued OneMax function.
arXiv Detail & Related papers (2024-04-17T10:40:12Z) - Stochastic Optimization for Non-convex Problem with Inexact Hessian
Matrix, Gradient, and Function [99.31457740916815]
Trust-region (TR) and adaptive regularization using cubics have proven to have some very appealing theoretical properties.
We show that TR and ARC methods can simultaneously provide inexact computations of the Hessian, gradient, and function values.
arXiv Detail & Related papers (2023-10-18T10:29:58Z) - Crossover Can Guarantee Exponential Speed-Ups in Evolutionary
Multi-Objective Optimisation [4.212663349859165]
We provide a theoretical analysis of the well-known EMO algorithms GSEMO and NSGA-II.
We show that immune-inspired hypermutations cannot avoid exponential optimisation times.
arXiv Detail & Related papers (2023-01-31T15:03:34Z) - Fast Computation of Optimal Transport via Entropy-Regularized Extragradient Methods [75.34939761152587]
Efficient computation of the optimal transport distance between two distributions serves as an algorithm that empowers various applications.
This paper develops a scalable first-order optimization-based method that computes optimal transport to within $varepsilon$ additive accuracy.
arXiv Detail & Related papers (2023-01-30T15:46:39Z) - An Application of a Multivariate Estimation of Distribution Algorithm to
Cancer Chemotherapy [59.40521061783166]
Chemotherapy treatment for cancer is a complex optimisation problem with a large number of interacting variables and constraints.
We show that the more sophisticated algorithm would yield better performance on a complex problem like this.
We hypothesise that this is caused by the more sophisticated algorithm being impeded by the large number of interactions in the problem.
arXiv Detail & Related papers (2022-05-17T15:28:46Z) - A novel multiobjective evolutionary algorithm based on decomposition and
multi-reference points strategy [14.102326122777475]
Multiobjective evolutionary algorithm based on decomposition (MOEA/D) has been regarded as a significantly promising approach for solving multiobjective optimization problems (MOPs)
We propose an improved MOEA/D algorithm by virtue of the well-known Pascoletti-Serafini scalarization method and a new strategy of multi-reference points.
arXiv Detail & Related papers (2021-10-27T02:07:08Z) - Recent Theoretical Advances in Non-Convex Optimization [56.88981258425256]
Motivated by recent increased interest in analysis of optimization algorithms for non- optimization in deep networks and other problems in data, we give an overview of recent results of theoretical optimization algorithms for non- optimization.
arXiv Detail & Related papers (2020-12-11T08:28:51Z) - Bilevel Optimization: Convergence Analysis and Enhanced Design [63.64636047748605]
Bilevel optimization is a tool for many machine learning problems.
We propose a novel stoc-efficientgradient estimator named stoc-BiO.
arXiv Detail & Related papers (2020-10-15T18:09:48Z) - Benchmarking a $(\mu+\lambda)$ Genetic Algorithm with Configurable
Crossover Probability [4.33419118449588]
We investigate a family of $(mu+lambda)$ Genetic Algorithms (GAs) which creates offspring either from mutation or by recombining two randomly chosen parents.
By scaling the crossover probability, we can thus interpolate from a fully mutation-only algorithm towards a fully crossover-based GA.
arXiv Detail & Related papers (2020-06-10T15:22:44Z) - Optimal Randomized First-Order Methods for Least-Squares Problems [56.05635751529922]
This class of algorithms encompasses several randomized methods among the fastest solvers for least-squares problems.
We focus on two classical embeddings, namely, Gaussian projections and subsampled Hadamard transforms.
Our resulting algorithm yields the best complexity known for solving least-squares problems with no condition number dependence.
arXiv Detail & Related papers (2020-02-21T17:45:32Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.