Egocentric, multi-modal data as available on future augmented reality (AR) devices provides unique challenges and opportunities for machine perception. These future devices will need to be all-day wearable in a socially acceptable form-factor to support always available, context-aware and personalized AI applications. Our team at Meta Reality Labs Research built the Aria device, an egocentric, multi-modal data recording and streaming device with the goal to foster and accelerate research in this area. In this paper, we describe the Aria device hardware including its sensor configuration and the corresponding software tools that enable recording and processing of such data.
翻译:未来增强现实(AR)设备所具备的自我中心、多模态数据,为机器感知带来了独特的挑战与机遇。这些未来设备需以社会可接受的外形设计实现全天候佩戴,以支持始终可用、情境感知且个性化的AI应用。我们的Meta Reality Labs研究团队打造了Aria设备——一种用于记录和传输自我中心多模态数据的装置,旨在促进并加速该领域研究。本文详细介绍了Aria设备硬件(包括其传感器配置)及相应的软件工具,这些工具能够实现此类数据的记录与处理。