We present the design of a mixed reality (MR) telehealth training system that aims to close the gap between in-person and distance training and re-training for medical procedures. Our system uses real-time volumetric capture as a means for communicating and relating spatial information between the non-colocated trainee and instructor. The system's design is based on a requirements elicitation study performed in situ, at a medical school simulation training center. The focus is on the lightweight real-time transmission of volumetric data - meaning the use of consumer hardware, easy and quick deployment, and low-demand computations. We evaluate the MR system design by analyzing the workload for the users during medical training. We compare in-person, video, and MR training workloads. The results indicate that the overall workload for central line placement training with MR does not increase significantly compared to video communication. Our work shows that, when designed strategically together with domain experts, an MR communication system can be used effectively for complex medical procedural training without increasing the overall workload for users significantly. Moreover, MR systems offer new opportunities for teaching due to spatial information, hand tracking, and augmented communication.
翻译:我们提出了一种混合现实(MR)远程医疗培训系统的设计,旨在缩小面对面培训与远程培训及再培训之间的差距,用于医学操作流程。我们的系统采用实时体积捕捉作为非共处学员与教练之间传递和关联空间信息的通信手段。该系统设计基于在医学院模拟培训中心现场进行的需求启发研究,重点在于轻量级实时体积数据传输——即使用消费级硬件、实现简便快速的部署以及低计算需求。我们通过分析用户在医学培训期间的工作负载来评估MR系统设计,并比较了面对面、视频和MR三种培训方式的工作负载。结果表明,与视频通信相比,采用MR进行中心静脉置管培训的整体工作负载并未显著增加。我们的工作表明,当与领域专家进行战略性协作设计时,MR通信系统可有效用于复杂医学操作培训,且不会显著增加用户的整体工作负载。此外,MR系统因其空间信息、手部追踪和增强通信能力,为教学提供了新的可能性。