Ensemble Genetic Programming
- URL: http://arxiv.org/abs/2001.07553v1
- Date: Tue, 21 Jan 2020 14:10:37 GMT
- Title: Ensemble Genetic Programming
- Authors: Nuno M. Rodrigues, Jo\~ao E. Batista, Sara Silva
- Abstract summary: Ensemble GP follows the same steps as other Genetic Programming systems, but with differences in the population structure,fitness evaluation and genetic operators.
We have tested this method oneight binary classification problems, achieving results significantly betterthan standard GP, with much smaller models.
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Ensemble learning is a powerful paradigm that has been usedin the top
state-of-the-art machine learning methods like Random Forestsand XGBoost.
Inspired by the success of such methods, we have devel-oped a new Genetic
Programming method called Ensemble GP. The evo-lutionary cycle of Ensemble GP
follows the same steps as other GeneticProgramming systems, but with
differences in the population structure,fitness evaluation and genetic
operators. We have tested this method oneight binary classification problems,
achieving results significantly betterthan standard GP, with much smaller
models. Although other methodslike M3GP and XGBoost were the best overall,
Ensemble GP was able toachieve exceptionally good generalization results on a
particularly hardproblem where none of the other methods was able to succeed.
Related papers
- Classifier-guided Gradient Modulation for Enhanced Multimodal Learning [50.7008456698935]
Gradient-Guided Modulation (CGGM) is a novel method to balance multimodal learning with gradients.
We conduct extensive experiments on four multimodal datasets: UPMC-Food 101, CMU-MOSI, IEMOCAP and BraTS.
CGGM outperforms all the baselines and other state-of-the-art methods consistently.
arXiv Detail & Related papers (2024-11-03T02:38:43Z) - Liquid State Genetic Programming [0.0]
A new Genetic Programming variant called Liquid State Genetic Programming (LSGP) is proposed in this paper.
LSGP is a hybrid method combining a dynamic memory for storing the inputs (the liquid) and a Genetic Programming technique used for the problem solving part.
Numerical experiments show that LSGP performs similarly and sometimes even better than standard Genetic Programming for the considered test problems.
arXiv Detail & Related papers (2023-12-05T17:09:21Z) - A Reinforcement Learning-assisted Genetic Programming Algorithm for Team
Formation Problem Considering Person-Job Matching [70.28786574064694]
A reinforcement learning-assisted genetic programming algorithm (RL-GP) is proposed to enhance the quality of solutions.
The hyper-heuristic rules obtained through efficient learning can be utilized as decision-making aids when forming project teams.
arXiv Detail & Related papers (2023-04-08T14:32:12Z) - Interactive Segmentation as Gaussian Process Classification [58.44673380545409]
Click-based interactive segmentation (IS) aims to extract the target objects under user interaction.
Most of the current deep learning (DL)-based methods mainly follow the general pipelines of semantic segmentation.
We propose to formulate the IS task as a Gaussian process (GP)-based pixel-wise binary classification model on each image.
arXiv Detail & Related papers (2023-02-28T14:01:01Z) - Weighted Ensembles for Active Learning with Adaptivity [60.84896785303314]
This paper presents an ensemble of GP models with weights adapted to the labeled data collected incrementally.
Building on this novel EGP model, a suite of acquisition functions emerges based on the uncertainty and disagreement rules.
An adaptively weighted ensemble of EGP-based acquisition functions is also introduced to further robustify performance.
arXiv Detail & Related papers (2022-06-10T11:48:49Z) - Scaling Gaussian Process Optimization by Evaluating a Few Unique
Candidates Multiple Times [119.41129787351092]
We show that sequential black-box optimization based on GPs can be made efficient by sticking to a candidate solution for multiple evaluation steps.
We modify two well-established GP-Opt algorithms, GP-UCB and GP-EI to adapt rules from batched GP-Opt.
arXiv Detail & Related papers (2022-01-30T20:42:14Z) - Incremental Ensemble Gaussian Processes [53.3291389385672]
We propose an incremental ensemble (IE-) GP framework, where an EGP meta-learner employs an it ensemble of GP learners, each having a unique kernel belonging to a prescribed kernel dictionary.
With each GP expert leveraging the random feature-based approximation to perform online prediction and model update with it scalability, the EGP meta-learner capitalizes on data-adaptive weights to synthesize the per-expert predictions.
The novel IE-GP is generalized to accommodate time-varying functions by modeling structured dynamics at the EGP meta-learner and within each GP learner.
arXiv Detail & Related papers (2021-10-13T15:11:25Z) - Solving classification problems using Traceless Genetic Programming [0.0]
Traceless Genetic Programming (TGP) is a new Genetic Programming (GP) that may be used for solving difficult real-world problems.
In this paper, TGP is used for solving real-world classification problems taken from PROBEN1.
arXiv Detail & Related papers (2021-10-07T06:13:07Z) - Using Traceless Genetic Programming for Solving Multiobjective
Optimization Problems [1.9493449206135294]
Traceless Genetic Programming (TGP) is a Genetic Programming (GP) variant that is used in cases where the focus is rather the output of the program than the program itself.
Two genetic operators are used in conjunction with TGP: crossover and insertion.
Numerical experiments show that TGP is able to solve very fast and very well the considered test problems.
arXiv Detail & Related papers (2021-10-07T05:55:55Z) - Solving even-parity problems using traceless genetic programming [0.0]
TGP is a hybrid technique combining a technique for building individuals and a technique for representing individuals.
Two genetic operators are used in conjunction with TGP: crossover and insertion.
TGP is applied for evolving digital circuits for the even-parity problem.
arXiv Detail & Related papers (2021-10-04T13:23:32Z) - Genetic Programming is Naturally Suited to Evolve Bagging Ensembles [0.0]
We show that minor changes to fitness evaluation and selection are sufficient to make a simple and otherwise-traditional GP algorithm evolve efficiently.
Our algorithm fares very well against state-of-the-art ensemble and non-ensemble GP algorithms.
arXiv Detail & Related papers (2020-09-13T16:28:11Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.