Evolutionary Reinforcement Learning (ERL), which integrates Evolutionary Algorithms (EAs) and Reinforcement Learning (RL) for optimization, has demonstrated remarkable performance advancements. By fusing the strengths of both approaches, ERL has emerged as a promising research direction. This survey offers a comprehensive overview of the diverse research branches in ERL. Specifically, we systematically summarize recent advancements in relevant algorithms and identify three primary research directions: EA-assisted optimization of RL, RL-assisted optimization of EA, and synergistic optimization of EA and RL. Following that, we conduct an in-depth analysis of each research direction, organizing multiple research branches. We elucidate the problems that each branch aims to tackle and how the integration of EA and RL addresses these challenges. In conclusion, we discuss potential challenges and prospective future research directions across various research directions. To facilitate researchers in delving into ERL, we organize the algorithms and codes involved on https://github.com/yeshenpy/Awesome-Evolutionary-Reinforcement-Learning.

翻译：进化强化学习（ERL）将进化算法（EA）与强化学习（RL）相结合进行优化，已展现出显著的性能提升。通过融合两种方法的优势，ERL已成为一个颇具前景的研究方向。本综述全面概述了ERL中的不同研究分支。具体而言，我们系统总结了相关算法的最新进展，并确定了三个主要研究方向：EA辅助的RL优化、RL辅助的EA优化以及EA与RL的协同优化。随后，我们对每个研究方向进行了深入分析，并组织了多个研究分支。我们阐明了每个分支旨在解决的问题，以及EA与RL的融合如何应对这些挑战。最后，我们讨论了各研究方向面临的潜在挑战及未来前景。为便于研究人员深入探索ERL，我们将涉及的算法和代码整理在https://github.com/yeshenpy/Awesome-Evolutionary-Reinforcement-Learning。