This paper introduces Teachable Reality, an augmented reality (AR) prototyping tool for creating interactive tangible AR applications with arbitrary everyday objects. Teachable Reality leverages vision-based interactive machine teaching (e.g., Teachable Machine), which captures real-world interactions for AR prototyping. It identifies the user-defined tangible and gestural interactions using an on-demand computer vision model. Based on this, the user can easily create functional AR prototypes without programming, enabled by a trigger-action authoring interface. Therefore, our approach allows the flexibility, customizability, and generalizability of tangible AR applications that can address the limitation of current marker-based approaches. We explore the design space and demonstrate various AR prototypes, which include tangible and deformable interfaces, context-aware assistants, and body-driven AR applications. The results of our user study and expert interviews confirm that our approach can lower the barrier to creating functional AR prototypes while also allowing flexible and general-purpose prototyping experiences.

翻译：本文介绍了可教现实（Teachable Reality），这是一种增强现实（AR）原型制作工具，用于利用任意日常物体创建交互式可触AR应用。可教现实利用基于视觉的交互式机器教学（例如，可教机器），捕捉现实世界中的交互行为以进行AR原型开发。它通过按需计算机视觉模型识别用户定义的可触和手势交互。在此基础上，用户无需编程即可轻松创建功能性AR原型，这得益于触发器-动作编辑界面。因此，我们的方法为可触AR应用提供了灵活性、可定制性和通用性，从而解决了当前基于标记方法的局限性。我们探索了设计空间，并展示了多种AR原型，包括可触和可变形界面、上下文感知助手以及身体驱动的AR应用。我们的用户研究和专家访谈结果证实，我们的方法可以降低创建功能性AR原型的门槛，同时提供灵活且通用的原型设计体验。