With recent computer vision techniques and user-generated content, we can augment the physical world with metadata that describes attributes, such as names, geo-locations, and visual features of physical objects. To assess the benefits of these potentially ubiquitous labels for foreign vocabulary learning, we built a proof-of-concept system that displays bilingual text and sound labels on physical objects outdoors using augmented reality. Established tools for language learning have focused on effective content delivery methods such as books and flashcards. However, recent research and consumer learning tools have begun to focus on how learning can become more mobile, ubiquitous, and desirable. To test whether our system supports vocabulary learning, we conducted a preliminary between-subjects (N=44) study. Our results indicate that participants preferred learning with virtual labels on real-world objects outdoors over learning with flashcards. Our findings motivate further investigation into mobile AR-based learning systems in outdoor settings.

翻译：借助最新的计算机视觉技术和用户生成内容，我们能够为物理世界添加描述物体属性（如名称、地理位置和视觉特征）的元数据。为评估这些可能无处不在的标签对外语词汇学习的益处，我们开发了一个概念验证系统，该系统利用增强现实技术在户外物理对象上显示双语文本与音频标签。现有的语言学习工具主要专注于书籍和闪卡等高效内容传递方式。然而，近期研究和消费级学习工具已开始关注如何使学习过程更具移动性、普适性和吸引力。为验证本系统对词汇学习的支持效果，我们开展了初步的组间对照研究（N=44）。结果表明，与使用闪卡学习相比，参与者更倾向于通过户外真实物体上的虚拟标签进行学习。这一发现为在户外场景中进一步研究基于移动增强现实的学习系统提供了实践依据。