Cooperative coevolutionary Modified Differential Evolution with
Distance-based Selection for Large-Scale Optimization Problems in noisy
environments through an automatic Random Grouping
- URL: http://arxiv.org/abs/2209.00777v2
- Date: Tue, 6 Sep 2022 06:54:33 GMT
- Title: Cooperative coevolutionary Modified Differential Evolution with
Distance-based Selection for Large-Scale Optimization Problems in noisy
environments through an automatic Random Grouping
- Authors: Rui Zhong and Masaharu Munetomo
- Abstract summary: We propose an automatic Random Grouping (aRG) to solve large-scale optimization problems in noisy environments.
We also introduce Modified Evolution with Distance-based Selection (MDE-DS) to enhance the ability in noisy environments.
Our proposal has broad prospects to solve LSOPs in noisy environments and can be easily extended to higher-dimensional problems.
- Score: 3.274290296343038
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Many optimization problems suffer from noise, and nonlinearity check-based
decomposition methods (e.g. Differential Grouping) will completely fail to
detect the interactions between variables in multiplicative noisy environments,
thus, it is difficult to decompose the large-scale optimization problems
(LSOPs) in noisy environments. In this paper, we propose an automatic Random
Grouping (aRG), which does not need any explicit hyperparameter specified by
users. Simulation experiments and mathematical analysis show that aRG can
detect the interactions between variables without the fitness landscape
knowledge, and the sub-problems decomposed by aRG have smaller scales, which is
easier for EAs to optimize. Based on the cooperative coevolution (CC)
framework, we introduce an advanced optimizer named Modified Differential
Evolution with Distance-based Selection (MDE-DS) to enhance the search ability
in noisy environments. Compared with canonical DE, the parameter
self-adaptation, the balance between diversification and intensification, and
the distance-based probability selection endow MDE-DS with stronger ability in
exploration and exploitation. To evaluate the performance of our proposal, we
design $500$-D and $1000$-D problems with various separability in noisy
environments based on the CEC2013 LSGO Suite. Numerical experiments show that
our proposal has broad prospects to solve LSOPs in noisy environments and can
be easily extended to higher-dimensional problems.
Related papers
- Parameter optimization comparison in QAOA using Stochastic Hill Climbing with Random Re-starts and Local Search with entangled and non-entangled mixing operators [0.0]
This study investigates the efficacy of Hill Climbing with Random Restarts (SHC-RR) compared to Local Search (LS) strategies.
Our results consistently show that SHC-RR outperforms LS approaches, showcasing superior efficacy despite its ostensibly simpler optimization mechanism.
arXiv Detail & Related papers (2024-05-14T20:12:17Z) - Adaptive Differential Evolution with Diversification: Addressing
Optimization Challenges [0.0]
ADED distinguishes itself with its adaptive diverse approach, which includes adaptive mutation and Z-rates, diverse mutation tactics, diversification mechanisms, and monitoring scenarios.
arXiv Detail & Related papers (2023-12-22T06:33:56Z) - CAMEO: A Causal Transfer Learning Approach for Performance Optimization
of Configurable Computer Systems [16.75106122540052]
We propose CAMEO, a method that identifies invariant causal predictors under environmental changes.
We demonstrate significant performance improvements over state-of-the-art optimization methods in MLperf deep learning systems, a video analytics pipeline, and a database system.
arXiv Detail & Related papers (2023-06-13T16:28:37Z) - Vector Autoregressive Evolution for Dynamic Multi-Objective Optimisation [7.5104598146227]
Dynamic multi-objective optimisation (DMO) handles optimisation problems with multiple objectives in varying environments.
This paper proposes vector autoregressive evolution (VARE) consisting of vector autoregression ( VAR) and environment-aware hypermutation to address environmental changes in DMO.
arXiv Detail & Related papers (2023-05-22T06:24:25Z) - Cooperative coevolutionary hybrid NSGA-II with Linkage Measurement
Minimization for Large-scale Multi-objective optimization [3.274290296343038]
We propose a variable grouping method based on cooperative coevolution for large-scale multi-objective problems (LSMOPs)
For the sub-problem optimization stage, a hybrid NSGA-II with a Gaussian sampling operator based on an estimated convergence point is proposed.
arXiv Detail & Related papers (2022-08-29T08:18:15Z) - Differentiable Invariant Causal Discovery [106.87950048845308]
Learning causal structure from observational data is a fundamental challenge in machine learning.
This paper proposes Differentiable Invariant Causal Discovery (DICD) to avoid learning spurious edges and wrong causal directions.
Extensive experiments on synthetic and real-world datasets verify that DICD outperforms state-of-the-art causal discovery methods up to 36% in SHD.
arXiv Detail & Related papers (2022-05-31T09:29:07Z) - Neural Stochastic Dual Dynamic Programming [99.80617899593526]
We introduce a trainable neural model that learns to map problem instances to a piece-wise linear value function.
$nu$-SDDP can significantly reduce problem solving cost without sacrificing solution quality.
arXiv Detail & Related papers (2021-12-01T22:55:23Z) - Multi-Objective Constrained Optimization for Energy Applications via
Tree Ensembles [55.23285485923913]
Energy systems optimization problems are complex due to strongly non-linear system behavior and multiple competing objectives.
In some cases, proposed optimal solutions need to obey explicit input constraints related to physical properties or safety-critical operating conditions.
This paper proposes a novel data-driven strategy using tree ensembles for constrained multi-objective optimization of black-box problems.
arXiv Detail & Related papers (2021-11-04T20:18:55Z) - Result Diversification by Multi-objective Evolutionary Algorithms with
Theoretical Guarantees [94.72461292387146]
We propose to reformulate the result diversification problem as a bi-objective search problem, and solve it by a multi-objective evolutionary algorithm (EA)
We theoretically prove that the GSEMO can achieve the optimal-time approximation ratio, $1/2$.
When the objective function changes dynamically, the GSEMO can maintain this approximation ratio in running time, addressing the open question proposed by Borodin et al.
arXiv Detail & Related papers (2021-10-18T14:00:22Z) - Robust Reconfigurable Intelligent Surfaces via Invariant Risk and Causal
Representations [55.50218493466906]
In this paper, the problem of robust reconfigurable intelligent surface (RIS) system design under changes in data distributions is investigated.
Using the notion of invariant risk minimization (IRM), an invariant causal representation across multiple environments is used such that the predictor is simultaneously optimal for each environment.
A neural network-based solution is adopted to seek the predictor and its performance is validated via simulations against an empirical risk minimization-based design.
arXiv Detail & Related papers (2021-05-04T21:36:31Z) - EOS: a Parallel, Self-Adaptive, Multi-Population Evolutionary Algorithm
for Constrained Global Optimization [68.8204255655161]
EOS is a global optimization algorithm for constrained and unconstrained problems of real-valued variables.
It implements a number of improvements to the well-known Differential Evolution (DE) algorithm.
Results prove that EOSis capable of achieving increased performance compared to state-of-the-art single-population self-adaptive DE algorithms.
arXiv Detail & Related papers (2020-07-09T10:19:22Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.