MOBA games, e.g., Dota2 and Honor of Kings, have been actively used as the testbed for the recent AI research on games, and various AI systems have been developed at the human level so far. However, these AI systems mainly focus on how to compete with humans, less on exploring how to collaborate with humans. To this end, this paper makes the first attempt to investigate human-agent collaboration in MOBA games. In this paper, we propose to enable humans and agents to collaborate through explicit communication by designing an efficient and interpretable Meta-Command Communication-based framework, dubbed MCC, for accomplishing effective human-agent collaboration in MOBA games. The MCC framework consists of two pivotal modules: 1) an interpretable communication protocol, i.e., the Meta-Command, to bridge the communication gap between humans and agents; 2) a meta-command value estimator, i.e., the Meta-Command Selector, to select a valuable meta-command for each agent to achieve effective human-agent collaboration. Experimental results in Honor of Kings demonstrate that MCC agents can collaborate reasonably well with human teammates and even generalize to collaborate with different levels and numbers of human teammates. Videos are available at https://sites.google.com/view/mcc-demo.
翻译:MOBA游戏(如Dota2和《王者荣耀》)已被广泛用作近期游戏AI研究的测试平台,目前已有多种达到人类水平的AI系统被开发出来。然而,这些AI系统主要关注如何与人类竞争,较少探索如何与人类协作。为此,本文首次尝试研究MOBA游戏中的人机协作。我们提出通过显式通信实现人与智能体的协作,设计了一个高效且可解释的基于元命令通信的框架(简称MCC),以在MOBA游戏中实现有效的人机协作。MCC框架包含两个关键模块:1)一个可解释的通信协议,即元命令,用于弥合人类与智能体之间的通信鸿沟;2)一个元命令价值评估器,即元命令选择器,用于为每个智能体选择有价值的元命令,以实现有效的人机协作。在《王者荣耀》中的实验结果表明,MCC智能体能够与人类队友进行相当合理的协作,甚至能够泛化到与不同水平和数量的人类队友进行协作。视频资料可访问 https://sites.google.com/view/mcc-demo。