Augmented reality (AR) is emerging in visual search tasks for increasingly immersive interactions with virtual objects. We propose an AR approach providing visual and audio hints along with gaze-assisted instant post-task feedback for search tasks based on mobile head-mounted display (HMD). The target case was a book-searching task, in which we aimed to explore the effect of the hints together with the task feedback with two hypotheses. H1: Since visual and audio hints can positively affect AR search tasks, the combination outperforms the individuals. H2: The gaze-assisted instant post-task feedback can positively affect AR search tasks. The proof-of-concept was demonstrated by an AR app in HMD and a comprehensive user study (n=96) consisting of two sub-studies, Study I (n=48) without task feedback and Study II (n=48) with task feedback. Following quantitative and qualitative analysis, our results partially verified H1 and completely verified H2, enabling us to conclude that the synthesis of visual and audio hints conditionally improves the AR visual search task efficiency when coupled with task feedback.
翻译:增强现实(AR)正逐步应用于视觉搜索任务,以支持与虚拟对象日益沉浸式的交互。我们提出一种基于移动头戴式显示器(HMD)的AR方法,为搜索任务提供视觉与音频提示,并结合视线辅助的即时任务后反馈。目标场景为书籍搜索任务,旨在通过两个假设探究提示与任务反馈的共同作用:H1:视觉与音频提示能积极影响AR搜索任务,且二者组合优于单一提示;H2:视线辅助的即时任务后反馈能积极影响AR搜索任务。通过HMD端AR应用与原位用户研究(n=96)验证概念可行性,该研究包含两个子实验:无任务反馈的学习I(n=48)与有任务反馈的学习II(n=48)。定量与定性分析结果表明,H1得到部分验证,H2得到完全验证。据此我们得出结论:视觉与音频提示的合成在配合任务反馈时,能条件性地提升AR视觉搜索任务效率。