With respect to machine operation tasks, the experiences from different skill level operators, especially novices, can provide worthy understanding about the manner in which they perceive the operational environment and formulate knowledge to deal with various operation situations. In this study, we describe the operator's behaviors by utilizing the relations among their head, hand, and operation location (hotspot) during the operation. A total of 40 experiences associated with a sewing machine operation task performed by amateur operators was recorded via a head-mounted RGB-D camera. We examined important features of operational behaviors in different skill level operators and confirmed their correlation to the difficulties of the operation steps. The result shows that the pure-gazing behavior is significantly reduced when the operator's skill improved. Moreover, the hand-approaching duration and the frequency of attention movement before operation are strongly correlated to the operational difficulty in such machine operating environments.
翻译:关于机器操作任务,不同技能水平操作者(尤其是新手)的经验,能够为理解他们如何感知操作环境并构建知识以应对各类操作情境提供宝贵见解。本研究通过分析操作过程中操作者头部、手部与操作位置(热点)之间的关联来描述其行为。我们使用头戴式RGB-D相机记录了40名业余操作者执行缝纫机操作任务的相关经验。我们检验了不同技能水平操作者行为的关键特征,并确认了这些特征与操作步骤难度之间的相关性。结果表明,当操作者技能提升时,纯凝视行为显著减少。此外,在此类机器操作环境中,手部接近操作的持续时间以及操作前注意力转移的频率与操作难度存在强相关性。