Games are widely used as research environments for multi-agent reinforcement learning (MARL), but they pose three significant challenges: limited customization, high computational demands, and oversimplification. To address these issues, we introduce the first publicly available map editor for the popular mobile game Honor of Kings and design a lightweight environment, Mini Honor of Kings (Mini HoK), for researchers to conduct experiments. Mini HoK is highly efficient, allowing experiments to be run on personal PCs or laptops while still presenting sufficient challenges for existing MARL algorithms. We have tested our environment on common MARL algorithms and demonstrated that these algorithms have yet to find optimal solutions within this environment. This facilitates the dissemination and advancement of MARL methods within the research community. Additionally, we hope that more researchers will leverage the Honor of Kings map editor to develop innovative and scientifically valuable new maps. Our code and user manual are available at: https://github.com/tencent-ailab/mini-hok.
翻译:游戏被广泛用作多智能体强化学习(MARL)的研究环境,但它们带来了三大挑战:定制化程度有限、计算需求高以及过度简化。为解决这些问题,我们为热门手机游戏《王者荣耀》推出了首个公开的地图编辑器,并设计了一个轻量化环境——Mini Honor of Kings(Mini HoK),供研究人员开展实验。Mini HoK 具有极高的运行效率,实验可在个人电脑或笔记本电脑上执行,同时仍对现有的 MARL 算法构成充分挑战。我们已在常见的 MARL 算法上测试了该环境,结果表明这些算法尚未能在该环境中找到最优解。这有助于 MARL 方法在研究社区内的传播与推进。此外,我们希望更多研究者能利用《王者荣耀》地图编辑器,开发出具有创新性和科学价值的新地图。我们的代码与用户手册发布于:https://github.com/tencent-ailab/mini-hok。