Advanced digital assistants can significantly enhance task performance, reduce user burden, and provide personalized guidance to improve users' abilities. However, the development of such intelligent digital assistants presents a formidable challenge. To address this, we introduce TOM, a conceptual architecture and software platform (https://github.com/TOM-Platform) designed to support the development of intelligent wearable assistants that are contextually aware of both the user and the environment. This system was developed collaboratively with AR/MR researchers, HCI researchers, AI/Robotic researchers, and software developers, and it continues to evolve to meet the diverse requirements of these stakeholders. TOM facilitates the creation of intelligent assistive AR applications for daily activities and supports the recording and analysis of user interactions, integration of new devices, and the provision of assistance for various activities. Additionally, we showcase several proof-of-concept assistive services and discuss the challenges involved in developing such services.
翻译:先进的数字助手能够显著提升任务执行效率、减轻用户负担,并提供个性化指导以增强用户能力。然而,此类智能数字助手的开发面临巨大挑战。为此,我们提出了TOM——一个概念性架构与软件平台(https://github.com/TOM-Platform),旨在支持开发能够感知用户与环境情境的智能可穿戴助手。该系统由增强现实/混合现实研究者、人机交互研究者、人工智能/机器人学研究者及软件开发者协同构建,并持续演进以满足各利益相关方的多样化需求。TOM支持为日常活动创建智能辅助增强现实应用,同时协助记录与分析用户交互、集成新设备,并为各类活动提供辅助支持。此外,我们展示了若干概念验证型辅助服务,并探讨了开发此类服务所涉及的关键挑战。