In this poster, we present RealityDrop, a novel multimodal framework that uses Mixed Reality (MR) technology to manipulate, display, and transfer virtual content across different display systems. Employing MR as the centre of control, RealityDrop affords concise information dissemination among diverse collaborators, through varied representations that best fit each display system's unique features using `superhuman' gaze and gesture interactions. Three multimodal interaction techniques, a customised content interpreter, and two cross-system interfaces are incorporated for fluent content manipulation and presentation.
翻译:在本海报中,我们提出RealityDrop——一种新颖的多模态框架,它利用混合现实技术在不同显示系统间操控、展示及传输虚拟内容。RealityDrop以混合现实为控制中心,通过“超人”凝视与手势交互,采用最适配各显示系统特性的多样化表征,实现多元协作者间信息的精准分发。该框架集成了三种多模态交互技术、一个定制化内容解释器及两个跨系统接口,以支撑流畅的内容操控与展示。