This paper introduces holographic cross-device interaction, a new class of remote cross-device interactions between local physical devices and holographically rendered remote devices. Cross-device interactions have enabled a rich set of interactions with device ecologies. Most existing research focuses on co-located settings (meaning when users and devices are in the same physical space) to achieve these rich interactions and affordances. In contrast, holographic cross-device interaction allows remote interactions between devices at distant locations by providing a rich visual affordance through real-time holographic rendering of the device's motion, content, and interactions on mixed reality head-mounted displays. This maintains the advantages of having a physical device, such as precise input through touch and pen interaction. Through holographic rendering, not only can remote devices interact as if they are co-located, but they can also be virtually augmented to further enrich interactions, going beyond what is possible with existing cross-device systems. To demonstrate this concept, we developed HoloDevice, a prototype system for holographic cross-device interaction using the Microsoft Hololens 2 augmented reality headset. Our contribution is threefold. First, we introduce the concept of holographic cross-device interaction. Second, we present a design space containing three unique benefits, which include: (1) spatial visualization of interaction and motion, (2) rich visual affordances for intermediate transition, and (3) dynamic and fluid configuration. Last we discuss a set of implementation demonstrations and use-case scenarios that further explore the space.

翻译：本文提出全息跨设备交互这一新型远程跨设备交互范式，实现本地物理设备与全息化呈现的远程设备之间的交互。跨设备交互技术已为设备生态体系带来丰富的交互方式。现有研究多聚焦于共位场景（即用户与设备处于同一物理空间）以实现此类丰富的交互与功能可供性。相比之下，全息跨设备交互通过混合现实头戴显示器对远程设备的运动状态、内容界面及交互操作进行实时全息渲染，提供丰富的视觉可供性，从而支持远距离设备间的远程交互。该技术既保留了物理设备的固有优势（如通过触控与笔式交互实现的精确输入），又借助全息渲染使远程设备不仅能实现类共位交互，还可通过虚拟增强进一步拓展交互维度，突破现有跨设备系统的能力边界。为验证该概念，我们基于Microsoft Hololens 2增强现实头显开发了HoloDevice原型系统。本研究的贡献包含三方面：首先，提出全息跨设备交互的概念框架；其次，构建包含三大独特优势的设计空间，具体包括：（1）交互与运动的空间可视化，（2）中间态转换的丰富视觉可供性，（3）动态流畅的系统配置；最后通过系列实现案例与应用场景探讨该设计空间的拓展潜力。