In role-playing games a Game Master (GM) is the player in charge of the game, who must design the challenges the players face and narrate the outcomes of their actions. In this work we discuss some challenges to model GMs from an Interactive Storytelling and Natural Language Processing perspective. Following those challenges we propose three test categories to evaluate such dialogue systems, and we use them to test ChatGPT, Bard and OpenAssistant as out-of-the-box GMs.

翻译：在角色扮演游戏中，游戏主持人（GM）是负责掌控游戏的玩家，负责设计玩家面临的挑战并叙述其行动结果。本文从交互式叙事与自然语言处理视角探讨了建模游戏主持人所面临的一些挑战。基于这些挑战，我们提出了三类评估此类对话系统的测试维度，并利用这些测试对ChatGPT、Bard及OpenAssistant作为即用型游戏主持人的表现进行了评估。