Advances in artificial intelligence and human-computer interaction will likely lead to extended reality (XR) becoming pervasive. While XR can provide users with interactive, engaging, and immersive experiences, non-player characters are often utilized in pre-scripted and conventional ways. This paper argues for using large language models (LLMs) in XR by embedding them in avatars or as narratives to facilitate inclusion through prompt engineering and fine-tuning the LLMs. We argue that this inclusion will promote diversity for XR use. Furthermore, the versatile conversational capabilities of LLMs will likely increase engagement in XR, helping XR become ubiquitous. Lastly, we speculate that combining the information provided to LLM-powered spaces by users and the biometric data obtained might lead to novel privacy invasions. While exploring potential privacy breaches, examining user privacy concerns and preferences is also essential. Therefore, despite challenges, LLM-powered XR is a promising area with several opportunities.

翻译：人工智能与人机交互的进步将可能使扩展现实（XR）变得无处不在。尽管XR能够为用户提供交互式、引人入胜且沉浸式的体验，但非玩家角色通常以预设脚本和传统方式被使用。本文主张通过将大型语言模型（LLMs）嵌入虚拟化身或作为叙事元素，并借助提示工程与模型微调，以促进XR中的包容性。我们认为，这种包容性将推动XR应用的多元化发展。此外，LLMs强大的对话能力有望提升用户在XR中的参与度，从而助力XR的普及。最后，我们推测，结合用户提供给LLM驱动空间的信息与可能获取的生物特征数据，或许会催生新型隐私侵犯行为。在探索潜在隐私泄露风险的同时，审视用户的隐私关切与偏好也至关重要。因此，尽管面临挑战，由LLM驱动的XR仍是一个充满机遇的前沿领域。