Advancements in sensor technology, artificial intelligence (AI), and augmented reality (AR) have unlocked opportunities across various domains. AR and large language models like GPT have witnessed substantial progress and are increasingly being employed in diverse fields. One such promising application is in operations and maintenance (O&M). O&M tasks often involve complex procedures and sequences that can be challenging to memorize and execute correctly, particularly for novices or under high-stress situations. By marrying the advantages of superimposing virtual objects onto the physical world, and generating human-like text using GPT, we can revolutionize O&M operations. This study introduces a system that combines AR, Optical Character Recognition (OCR), and the GPT language model to optimize user performance while offering trustworthy interactions and alleviating workload in O&M tasks. This system provides an interactive virtual environment controlled by the Unity game engine, facilitating a seamless interaction between virtual and physical realities. A case study (N=15) is conducted to illustrate the findings and answer the research questions. The results indicate that users can complete similarly challenging tasks in less time using our proposed AR and AI system. Moreover, the collected data also suggests a reduction in cognitive load and an increase in trust when executing the same operations using the AR and AI system.

翻译：传感器技术、人工智能（AI）与增强现实（AR）的进步为多个领域带来了发展机遇。AR与大语言模型（如GPT）已取得显著进展，并被广泛应用于各个领域。在运维（O&M）领域，这类技术展现出重要应用前景。运维任务往往涉及复杂流程与操作序列，尤其在经验不足或高压环境下，操作者难以准确记忆与执行。通过融合虚拟信息叠加至物理世界的优势，以及GPT生成类人文本的能力，可彻底革新运维操作模式。本研究提出一种集成AR、光学字符识别（OCR）与GPT语言模型的系统，旨在优化操作者绩效、提供可信交互并减轻运维任务中的工作负荷。该系统通过Unity游戏引擎构建交互式虚拟环境，实现虚实无缝衔接。通过案例研究（N=15）验证发现并解答研究问题：结果表明，使用所提出的AR与AI系统，操作者能以更短时间完成同等难度任务。此外，数据采集显示，采用该系统执行相同操作时，操作者认知负荷有所降低，信任水平显著提升。