Smart mirrors have emerged as a new form of augmented reality (AR) interface for home environments. However, due to the parallax in human vision, one major challenge hindering their development is the depth misalignment between the 3D mirror reflection and the 2D screen display. This misalignment causes the display content to appear as if it is floating above the mirror, thereby disrupting the seamless integration of the two components and impacting the overall quality and functionality of the mirror. In this study, we introduce 3D-Mirrorcle, an innovative augmented reality (AR) mirror system that effectively addresses the issue of depth disparity through a hardware-software co-design on a lenticular grating setup. With our implemented real-time position adjustment and depth adaptation algorithms, the screen display can be dynamically aligned to the user's depth perception for a highly realistic and engaging experience. Our method has been validated through a prototype and hands-on user experiments that engaged 36 participants, and the results show significant improvements in terms of accuracy (24.72% $\uparrow$), immersion(31.4% $\uparrow$), and user satisfaction (44.4% $\uparrow$) compared to the existing works.
翻译:智能镜子已成为家庭环境中增强现实(AR)界面的一种新形式。然而,由于人类视觉中的视差现象,阻碍其发展的一个主要挑战在于3D镜面反射与2D屏幕显示之间的深度错位。这种错位会导致显示内容看起来像是漂浮在镜面上方,从而破坏了两者的无缝融合,并影响了镜子的整体质量和功能性。在本研究中,我们提出了3D-Mirrorcle——一种创新的增强现实(AR)镜子系统,通过在透镜光栅装置上进行硬件-软件协同设计,有效解决了深度差异问题。借助我们实现的实时位置调整和深度适应算法,屏幕显示能够动态与用户的深度感知对齐,从而提供高度真实且引人入胜的体验。我们的方法已通过原型系统及涉及36名参与者的动手用户实验得到验证,结果显示,与现有工作相比,在准确度(提升24.72%)、沉浸感(提升31.4%)和用户满意度(提升44.4%)方面均有显著改进。