As technological advancements in extended reality (XR) amplify the demand for more XR content, traditional development processes face several challenges: 1) a steep learning curve for inexperienced developers, 2) a disconnect between 2D development environments and 3D user experiences inside headsets, and 3) slow iteration cycles due to context switching between development and testing environments. To address these challenges, we introduce AtomXR, a streamlined, immersive, no-code XR prototyping tool designed to empower both experienced and inexperienced developers in creating applications using natural language, eye-gaze, and touch interactions. AtomXR consists of: 1) AtomScript, a high-level human-interpretable scripting language for rapid prototyping, 2) a natural language interface that integrates LLMs and multimodal inputs for AtomScript generation, and 3) an immersive in-headset authoring environment. Empirical evaluation through two user studies offers insights into natural language-based and immersive prototyping, and shows AtomXR provides significant improvements in speed and user experience compared to traditional systems.
翻译:随着扩展现实技术的进步加剧了对更多XR内容的需求,传统开发流程面临多个挑战:1)初学者开发者面临陡峭的学习曲线,2)二维开发环境与头戴设备内三维用户体验之间存在脱节,以及3)因开发与测试环境间的上下文切换导致迭代周期缓慢。为应对这些挑战,我们提出AtomXR——一种简化、沉浸式、无代码的XR原型设计工具,旨在赋能经验丰富与初学者开发者通过自然语言、视线追踪及触摸交互创建应用程序。AtomXR包含:1)AtomScript——一种面向人类可理解的高级脚本语言,支持快速原型设计;2)集成大语言模型与多模态输入以生成AtomScript的自然语言接口;以及3)沉浸式头戴设备内创作环境。通过两项用户研究进行的实证评估,揭示了基于自然语言与沉浸式原型设计的见解,并表明AtomXR相比传统系统在速度与用户体验方面提供了显著提升。