We propose a new benchmark for planning tasks based on the Minecraft game. Our benchmark contains 45 tasks overall, but also provides support for creating both propositional and numeric instances of new Minecraft tasks automatically. We benchmark numeric and propositional planning systems on these tasks, with results demonstrating that state-of-the-art planners are currently incapable of dealing with many of the challenges advanced by our new benchmark, such as scaling to instances with thousands of objects. Based on these results, we identify areas of improvement for future planners. Our framework is made available at https://github.com/IretonLiu/mine-pddl/.

翻译：我们提出了一种基于Minecraft游戏的规划任务新基准。该基准共包含45个任务，同时支持自动创建新任务的命题与数值化实例。我们在这些任务上对数值与命题规划系统进行了评测，结果表明当前最先进的规划器无法应对本基准提出的诸多挑战，例如扩展至包含数千个对象的实例。基于这些结果，我们指出了未来规划器需改进的领域。相关框架已开源在https://github.com/IretonLiu/mine-pddl/。