We investigate hybrid user interfaces (HUIs), aiming to establish a cohesive understanding and adopt consistent terminology for this nascent research area. HUIs combine heterogeneous devices in complementary roles, leveraging the distinct benefits of each. Our work focuses on cross-device interaction between 2D devices and mixed reality environments, which are particularly compelling, leveraging the familiarity of traditional 2D platforms while providing spatial awareness and immersion. Although such HUIs have been prominently explored in the context of mixed reality by prior work, we still lack a cohesive understanding of the unique design possibilities and challenges of such combinations, resulting in a fragmented research landscape. We conducted a systematic survey and present a taxonomy of HUIs that combine conventional display technology and mixed reality environments. Based on this, we discuss past and current challenges, the evolution of definitions, and prospective opportunities to tie together the past 30 years of research with our vision of future HUIs.
翻译:本研究探讨混合用户界面,旨在为这一新兴研究领域建立统一认知并采用一致术语。混合用户界面通过整合异构设备形成互补角色,充分发挥各类设备的独特优势。我们聚焦于二维设备与混合现实环境间的跨设备交互——这种组合尤其引人注目,既能利用传统二维平台的熟悉度,又可提供空间感知与沉浸体验。尽管先前研究已在混合现实背景下对此类混合用户界面进行了深入探索,但学界仍缺乏对其独特设计可能性与挑战的系统性认知,导致研究格局呈现碎片化。我们通过系统调研提出了结合传统显示技术与混合现实环境的混合用户界面分类体系,并以此为基础探讨历史与当下的挑战、定义的演变过程以及未来机遇,从而将过去三十年的研究成果与我们设想的未来混合用户界面发展愿景相联结。