Augmented reality (AR) is emerging in visual search tasks for increasingly immersive interactions with virtual objects. We propose an AR approach providing visual and audio hints along with gaze-assisted instant post-task feedback for search tasks based on mobile head-mounted display (HMD). The target case was a book-searching task, in which we aimed to explore the effect of the hints together with the task feedback with two hypotheses. H1: Since visual and audio hints can positively affect AR search tasks, the combination outperforms the individuals. H2: The gaze-assisted instant post-task feedback can positively affect AR search tasks. The proof-of-concept was demonstrated by an AR app in HMD and a comprehensive user study (n=96) consisting of two sub-studies, Study I (n=48) without task feedback and Study II (n=48) with task feedback. Following quantitative and qualitative analysis, our results partially verified H1 and completely verified H2, enabling us to conclude that the synthesis of visual and audio hints conditionally improves the AR visual search task efficiency when coupled with task feedback.
翻译:增强现实(AR)正逐渐应用于视觉搜索任务,以实现日益沉浸式的虚拟对象交互。我们提出了一种基于移动头戴式显示器(HMD)的AR方法,在搜索任务中提供视觉和音频提示及视线辅助的即时任务后反馈。目标案例为图书搜索任务,我们旨在通过两个假设探讨提示与任务反馈的协同效应。H1:由于视觉和音频提示能积极影响AR搜索任务,两者结合的效果优于单一提示方式。H2:视线辅助的即时任务后反馈能积极影响AR搜索任务。我们通过HMD上的AR应用及一项包含两个子研究的综合用户研究(n=96)验证了概念可行性:研究I(n=48)无任务反馈,研究II(n=48)有任务反馈。基于定量与定性分析,结果部分验证了H1,完全验证了H2,从而得出结论:视觉与音频提示的结合在与任务反馈配合时,能在条件性提升AR视觉搜索任务效率。