Evolutionary Reinforcement Learning: A Systematic Review and Future Directions

• URL: http://arxiv.org/abs/2402.13296v1
• Date: Tue, 20 Feb 2024 02:07:57 GMT
• Title: Evolutionary Reinforcement Learning: A Systematic Review and Future Directions
• Authors: Yuanguo Lin, Fan Lin, Guorong Cai, Hong Chen, Lixin Zou and Pengcheng Wu
• Abstract summary: Evolutionary Reinforcement Learning (EvoRL) is a solution to the limitations of reinforcement learning and evolutionary algorithms (EAs) in complex problem-solving. EvoRL integrates EAs and reinforcement learning, presenting a promising avenue for training intelligent agents. This systematic review provides insights into the current state of EvoRL and offers a guide for advancing its capabilities in the ever-evolving landscape of artificial intelligence.
• Score: 18.631418642768132
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In response to the limitations of reinforcement learning and evolutionary algorithms (EAs) in complex problem-solving, Evolutionary Reinforcement Learning (EvoRL) has emerged as a synergistic solution. EvoRL integrates EAs and reinforcement learning, presenting a promising avenue for training intelligent agents. This systematic review firstly navigates through the technological background of EvoRL, examining the symbiotic relationship between EAs and reinforcement learning algorithms. We then delve into the challenges faced by both EAs and reinforcement learning, exploring their interplay and impact on the efficacy of EvoRL. Furthermore, the review underscores the need for addressing open issues related to scalability, adaptability, sample efficiency, adversarial robustness, ethic and fairness within the current landscape of EvoRL. Finally, we propose future directions for EvoRL, emphasizing research avenues that strive to enhance self-adaptation and self-improvement, generalization, interpretability, explainability, and so on. Serving as a comprehensive resource for researchers and practitioners, this systematic review provides insights into the current state of EvoRL and offers a guide for advancing its capabilities in the ever-evolving landscape of artificial intelligence.

Related papers

• O1 Replication Journey: A Strategic Progress Report -- Part 1 [52.062216849476776]
  This paper introduces a pioneering approach to artificial intelligence research, embodied in our O1 Replication Journey. Our methodology addresses critical challenges in modern AI research, including the insularity of prolonged team-based projects. We propose the journey learning paradigm, which encourages models to learn not just shortcuts, but the complete exploration process.
  arXiv  Detail & Related papers  (2024-10-08T15:13:01Z)
• A Survey on Self-Evolution of Large Language Models [116.54238664264928]
  Large language models (LLMs) have significantly advanced in various fields and intelligent agent applications. To address this issue, self-evolution approaches that enable LLMs to autonomously acquire, refine, and learn from experiences generated by the model itself are rapidly growing.
  arXiv  Detail & Related papers  (2024-04-22T17:43:23Z)
• Bringing Generative AI to Adaptive Learning in Education [58.690250000579496]
  We shed light on the intersectional studies of generative AI and adaptive learning. We argue that this union will contribute significantly to the development of the next-stage learning format in education.
  arXiv  Detail & Related papers  (2024-02-02T23:54:51Z)
• Bridging Evolutionary Algorithms and Reinforcement Learning: A Comprehensive Survey on Hybrid Algorithms [50.91348344666895]
  Evolutionary Reinforcement Learning (ERL) integrates Evolutionary Algorithms (EAs) and Reinforcement Learning (RL) for optimization. This survey offers a comprehensive overview of the diverse research branches in ERL.
  arXiv  Detail & Related papers  (2024-01-22T14:06:37Z)
• When large language models meet evolutionary algorithms [48.213640761641926]
  Pre-trained large language models (LLMs) have powerful capabilities for generating creative natural text. Evolutionary algorithms (EAs) can discover diverse solutions to complex real-world problems. Motivated by the common collective and directionality of text generation and evolution, this paper illustrates the parallels between LLMs and EAs.
  arXiv  Detail & Related papers  (2024-01-19T05:58:30Z)
• Multimodality of AI for Education: Towards Artificial General Intelligence [14.121655991753483]
  multimodal artificial intelligence (AI) approaches are paving the way towards the realization of Artificial General Intelligence (AGI) in educational contexts. This research delves deeply into the key facets of AGI, including cognitive frameworks, advanced knowledge representation, adaptive learning mechanisms, and the integration of diverse multimodal data sources. The paper also discusses the implications of multimodal AI's role in education, offering insights into future directions and challenges in AGI development.
  arXiv  Detail & Related papers  (2023-12-10T23:32:55Z)
• Reinforcement Learning-assisted Evolutionary Algorithm: A Survey and Research Opportunities [63.258517066104446]
  Reinforcement learning integrated as a component in the evolutionary algorithm has demonstrated superior performance in recent years. We discuss the RL-EA integration method, the RL-assisted strategy adopted by RL-EA, and its applications according to the existing literature. In the applications of RL-EA section, we also demonstrate the excellent performance of RL-EA on several benchmarks and a range of public datasets.
  arXiv  Detail & Related papers  (2023-08-25T15:06:05Z)
• Evolutionary Reinforcement Learning: A Survey [31.112066295496003]
  Reinforcement learning (RL) is a machine learning approach that trains agents to maximize cumulative rewards through interactions with environments. This article presents a comprehensive survey of state-of-the-art methods for integrating EC into RL, referred to as evolutionary reinforcement learning (EvoRL)
  arXiv  Detail & Related papers  (2023-03-07T01:38:42Z)
• EVO-RL: Evolutionary-Driven Reinforcement Learning [11.93391780461501]
  We propose a novel approach for reinforcement learning driven by evolutionary computation. Our algorithm, dubbed as Evolutionary-Driven Reinforcement Learning (evo-RL), embeds the reinforcement learning algorithm in an evolutionary cycle. Results show that reinforcement learning algorithms embedded within our evo-RL approach significantly outperform the stand-alone versions of the same RL algorithms on OpenAI Gym.
  arXiv  Detail & Related papers  (2020-07-09T11:52:19Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.