Shared gaze visualizations have been found to enhance collaboration and communication outcomes in diverse HCI scenarios including computer supported collaborative work and learning contexts. Given the importance of gaze in surgery operations, especially when a surgeon trainer and trainee need to coordinate their actions, research on the use of gaze to facilitate intra-operative coordination and instruction has been limited and shows mixed implications. We performed a field observation of 8 surgeries and an interview study with 14 surgeons to understand their visual needs during operations, informing ways to leverage and augment gaze to enhance intra-operative coordination and instruction. We found that trainees have varying needs in receiving visual guidance which are often unfulfilled by the trainers' instructions. It is critical for surgeons to control the timing of the gaze-based visualizations and effectively interpret gaze data. We suggest overlay technologies, e.g., gaze-based summaries and depth sensing, to augment raw gaze in support of surgical coordination and instruction.
翻译:共享注视可视化已被发现能在人机交互场景(包括计算机支持的协作工作与学习环境)中增强协作与沟通效果。鉴于注视在手术操作中的重要性(尤其当外科培训师与受训者需协调行动时),当前关于利用注视促进术中协调与指导的研究仍十分有限,且结论存在矛盾。我们通过8场手术的实地观察及对14名外科医生的访谈研究,深入理解其术中视觉需求,从而探索如何借助并增强注视技术以优化术中协调与指导。研究发现,受训者在接收视觉指导方面存在多样化的需求,而这些需求往往无法通过培训师的指令得到满足。外科医生需精准控制基于注视的可视化技术的触发时机,并有效解读注视数据。我们提出叠加技术(例如基于注视的摘要与深度感知)来增强原始注视信息,以支撑手术协调与指导。