Mixed Reality (MR) and Virtual Reality (VR) simulations are hampered by requirements for hand controllers or attempts to perseverate in use of two-dimensional computer interface paradigms from the 1980s. From our efforts to produce more naturalistic interactions for combat medic training for the military, USC has developed an open-source toolkit that enables direct hand controlled responsive interactions that is sensor independent and can function with depth sensing cameras, webcams or sensory gloves. Natural approaches we have examined include the ability to manipulate virtual smart objects in a similar manner to how they are used in the real world. From this research and review of current literature, we have discerned several best approaches for hand-based human computer interactions which provide intuitive, responsive, useful, and low frustration experiences for VR users.

翻译：混合现实（MR）和虚拟现实（VR）模拟因对手持控制器的需求，或固守20世纪80年代二维计算机界面范式的使用方式而受到制约。为在军事医疗兵训练中实现更自然的交互，南加州大学开发了一套开源工具包，该工具包支持直接手控响应式交互，且不依赖特定传感器，可与深度感应摄像头、网络摄像头或感知手套配合使用。我们研究的自然交互方法包括：以类似真实世界操作方式操控虚拟智能对象的能力。基于此项研究及对现有文献的梳理，我们归纳出若干基于手部的人机交互最佳方案，这些方案能够为VR用户提供直观、响应迅速、实用且低挫败感的体验。