Egocentric, multi-modal data as available on future augmented reality (AR) devices provides unique challenges and opportunities for machine perception. These future devices will need to be all-day wearable in a socially acceptable form-factor to support always available, context-aware and personalized AI applications. Our team at Meta Reality Labs Research built the Aria device, an egocentric, multi-modal data recording and streaming device with the goal to foster and accelerate research in this area. In this paper, we describe the Aria device hardware including its sensor configuration and the corresponding software tools that enable recording and processing of such data.
翻译:以未来增强现实(AR)设备上可用的以自我为中心的多模态数据,为机器感知带来了独特的挑战和机遇。这些未来设备需要以社会可接受的外观形态实现全天候可穿戴,以支持始终可用、上下文感知和个性化的人工智能应用。我们在Meta现实实验室研究团队构建了阿里亚设备,这是一种以自我为中心的多模态数据记录与流式传输设备,旨在促进并加速该领域的研究。本文描述了阿里亚设备的硬件,包括其传感器配置,以及支持记录和处理此类数据的相应软件工具。