Purpose: A fully immersive virtual reality system (FIVRS), where surgeons can practice procedures on virtual anatomies, is a scalable and cost-effective alternative to cadaveric training. The fully digitized virtual surgeries can also be used to assess the surgeon's skills automatically using metrics that are otherwise hard to collect in reality. Thus, we present FIVRS, a virtual reality (VR) system designed for skull-base surgery, which combines high-fidelity surgical simulation software with a real hardware setup. Methods: FIVRS integrates software and hardware features to allow surgeons to use normal clinical workflows for VR. FIVRS uses advanced rendering designs and drilling algorithms for realistic surgery. We also design a head-mounted display with ergonomics similar to that of surgical microscopes. A plethora of digitized data of VR surgery are recorded, including eye gaze, motion, force and video of the surgery for post-analysis. A user-friendly interface is also designed to ease the learning curve of using FIVRS. Results: We present results from a user study involving surgeons to showcase the efficacy FIVRS and its generated data. Conclusion: We present FIVRS, a fully immersive VR system for skull base surgery. FIVRS features a realistic software simulation coupled with modern hardware for improved realism. The system is completely open-source and provides feature-rich data in an industry-standard format.
翻译:摘要:目的:全沉浸式虚拟现实系统(FIVRS)允许外科医生在虚拟解剖结构上进行手术操作,是一种可扩展且成本效益高的传统尸体培训替代方案。全数字化虚拟手术还可通过常规现实难以采集的指标自动评估外科医生技能。因此,我们提出专为颅底手术设计的虚拟现实系统FIVRS,该系统将高保真手术仿真软件与真实硬件装置相结合。方法:FIVRS集成软件与硬件功能,使外科医生能够以常规临床工作流程进行虚拟现实操作。该系统采用先进的渲染设计与钻削算法实现逼真手术效果。我们还设计了具有类似手术显微镜人体工学的头戴式显示器,并记录包括眼动轨迹、运动数据、力学参数及手术视频在内的多种数字化信息用于后期分析。为降低学习曲线,系统还配备了用户友好界面。结果:我们展示了包含外科医生参与的用户研究成果,验证了FIVRS及其生成数据的有效性。结论:我们提出了面向颅底手术的全沉浸式虚拟现实系统FIVRS。该系统通过逼真的软件仿真与现代化硬件结合提升真实感,完全开源且以工业标准格式提供丰富特征数据。