Egocentric, multi-modal data as available on future augmented reality (AR) devices provides unique challenges and opportunities for machine perception. These future devices will need to be all-day wearable in a socially acceptable form-factor to support always available, context-aware and personalized AI applications. Our team at Meta Reality Labs Research built the Aria device, an egocentric, multi-modal data recording and streaming device with the goal to foster and accelerate research in this area. In this paper, we describe the Aria device hardware including its sensor configuration and the corresponding software tools that enable recording and processing of such data.
翻译:自我中心多模态数据(如未来增强现实设备所采集的数据)为机器感知带来了独特挑战与机遇。这些未来设备需具备全天候可穿戴性,并采用符合社会接受度的外形设计,以支持始终在线、情境感知及个性化的AI应用。我们Meta现实实验室研究团队开发了Aria设备——一款面向自我中心的多模态数据记录与流式传输设备,旨在促进并加速该领域研究。本文阐述了Aria设备硬件(包括传感器配置)及对应的软件工具,这些工具支持此类数据的记录与处理。