While Swarm User Interfaces (SUIs) have succeeded in enriching tangible interaction experiences, their limitations in autonomous action planning have hindered the potential for personalized and dynamic interaction generation in tabletop games. Based on the AI-Gadget Kit we developed, this paper explores how to integrate LLM-driven agents within tabletop games to enable SUIs to execute complex interaction tasks. After defining the design space of this kit, we elucidate the method for designing agents that can extend the meta-actions of SUIs to complex motion planning. Furthermore, we introduce an add-on prompt method that simplifies the design process for four interaction behaviors and four interaction relationships in tabletop games. Lastly, we present several application scenarios that illustrate the potential of AI-Gadget Kit to construct personalized interaction in SUI tabletop games. We expect to use our work as a case study to inspire research on multi-agent-driven SUI for other scenarios with complex interaction tasks.

翻译：尽管群体用户界面（SUIs）在丰富实体交互体验方面取得了成功，但其在自主行动规划方面的局限性阻碍了桌面游戏中个性化与动态交互生成的潜力。基于我们开发的AI-Gadget Kit，本文探讨了如何将LLM驱动的智能体集成到桌面游戏中，使SUIs能够执行复杂的交互任务。在定义该工具包的设计空间后，我们阐述了设计智能体的方法，以将SUIs的元动作扩展至复杂的运动规划。此外，我们介绍了一种附加提示方法，该方法简化了桌面游戏中四种交互行为与四种交互关系的设计流程。最后，我们展示了若干应用场景，以说明AI-Gadget Kit在构建SUI桌面游戏个性化交互方面的潜力。我们期望以本研究作为案例，启发针对其他复杂交互任务场景的多智能体驱动SUI研究。