A significant challenge facing researchers in the area of multi-agent reinforcement learning (MARL) pertains to the identification of a library that can offer fast and compatible development for multi-agent tasks and algorithm combinations, while obviating the need to consider compatibility issues. In this paper, we present MARLlib, a library designed to address the aforementioned challenge by leveraging three key mechanisms: 1) a standardized multi-agent environment wrapper, 2) an agent-level algorithm implementation, and 3) a flexible policy mapping strategy. By utilizing these mechanisms, MARLlib can effectively disentangle the intertwined nature of the multi-agent task and the learning process of the algorithm, with the ability to automatically alter the training strategy based on the current task's attributes. The MARLlib library's source code is publicly accessible on GitHub: \url{https://github.com/Replicable-MARL/MARLlib}.
翻译:多智能体强化学习(MARL)领域的研究人员面临的一个重大挑战在于:如何找到一个能够为多智能体任务和算法组合提供快速且兼容的开发支持,同时无需考虑兼容性问题的库。本文提出MARLlib,该库通过利用三种关键机制来解决上述挑战:1)标准化的多智能体环境封装器;2)基于智能体级别的算法实现;3)灵活的策略映射策略。通过运用这些机制,MARLlib能够有效解耦多智能体任务与算法学习过程之间的相互交织关系,并能够根据当前任务的属性自动调整训练策略。MARLlib库的源代码已在GitHub上公开获取:\url{https://github.com/Replicable-MARL/MARLlib}。