We design and evaluate a mixed reality real-time communication system for remote assistance during CPR emergencies. Our system allows an expert to guide a first responder, remotely, on how to give first aid. RGBD cameras capture a volumetric view of the local scene including the patient, the first responder, and the environment. The volumetric capture is augmented onto the remote expert's view to spatially guide the first responder using visual and verbal instructions. We evaluate the mixed reality communication system in a research study in which participants face a simulated emergency. The first responder moves the patient to the recovery position and performs chest compressions as well as mouth-to-mask ventilation. Our study compares mixed reality against videoconferencing-based assistance using CPR performance measures, cognitive workload surveys, and semi-structured interviews. We find that more visual communication including gestures and objects is used by the remote expert when assisting in mixed reality compared to videoconferencing. Moreover, the performance and the workload of the first responder during simulation do not differ significantly between the two technologies.

翻译：我们设计并评估了一种用于心肺复苏（CPR）紧急情况下远程援助的混合现实实时通信系统。该系统允许专家远程指导急救人员如何实施急救。RGBD摄像头捕捉包括患者、急救人员和环境在内的本地场景的立体视图。该立体捕捉内容被叠加到远程专家的视野中，以通过视觉和口头指令在空间上引导急救人员。我们在参与者面对模拟紧急情况的研究中评估了该混合现实通信系统。急救人员将患者移至恢复体位，并执行胸外按压以及口对面罩通气。我们的研究通过CPR表现指标、认知工作量调查和半结构化访谈，将混合现实与基于视频会议的援助进行了比较。我们发现，与视频会议相比，远程专家在混合现实协助中使用了更多的视觉交流，包括手势和物体。此外，在模拟过程中，急救人员的表现和工作量在两种技术之间没有显著差异。