To create rich experiences in virtual reality (VR) environments, it is essential to define the behavior of virtual objects through programming. However, programming in 3D spaces requires a wide range of background knowledge and programming skills. Although Large Language Models (LLMs) have provided programming support, they are still primarily aimed at programmers. In metaverse platforms, where many users inhabit VR spaces, most users are unfamiliar with programming, making it difficult for them to modify the behavior of objects in the VR environment easily. Existing LLM-based script generation methods for VR spaces require multiple lengthy iterations to implement the desired behaviors and are difficult to integrate into the operation of metaverse platforms. To address this issue, we propose a tool that generates behaviors for objects in VR spaces from natural language within Cluster, a metaverse platform with a large user base. By integrating LLMs with the Cluster Script provided by this platform, we enable users with limited programming experience to define object behaviors within the platform freely. We have also integrated our tool into a commercial metaverse platform and are conducting online experiments with 63 general users of the platform. The experiments show that even users with no programming background can successfully generate behaviors for objects in VR spaces, resulting in a highly satisfying system. Our research contributes to democratizing VR content creation by enabling non-programmers to design dynamic behaviors for virtual objects in metaverse platforms.
翻译:在虚拟现实(VR)环境中创建丰富体验,必须通过编程定义虚拟对象的行为。然而,三维空间编程需要广泛的背景知识与编程技能。尽管大语言模型(LLM)已提供编程支持,但其主要仍面向程序员。在众多用户栖居VR空间的元宇宙平台中,大多数用户不熟悉编程,难以便捷地修改VR环境中的对象行为。现有基于LLM的VR空间脚本生成方法需多次冗长迭代才能实现预期行为,且难以融入元宇宙平台的运营流程。为解决此问题,我们提出一种工具,可在用户基数庞大的元宇宙平台Cluster中,根据自然语言生成VR空间对象行为。通过将LLM与该平台提供的Cluster Script相集成,我们使编程经验有限的用户能够在平台内自由定义对象行为。我们还将该工具集成至商业元宇宙平台,并对63位平台普通用户开展在线实验。实验表明,即使无编程背景的用户也能成功生成VR空间对象行为,系统获得高度满意度评价。本研究通过赋能非编程人员设计元宇宙平台中虚拟对象的动态行为,推动了VR内容创作的民主化进程。