A novel method to control the Spot robot of Boston Dynamics by Hololens 2 is proposed. This method is mainly designed for people with physical disabilities, users can control the robot's movement and robot arm without using their hands. The eye gaze tracking and head motion tracking technologies of Hololens 2 are utilized for sending control commands. The movement of the robot would follow the eye gaze and the robot arm would mimic the pose of the user's head. Through our experiment, our method is comparable with the traditional control method by joystick in both time efficiency and user experience. Demo can be found on our project webpage: https://zhangganlin.github.io/Holo-Spot-Page/index.html

翻译：本文提出了一种利用Hololens 2控制波士顿动力公司Spot机器人的新方法。该方法主要面向肢体残疾人士，用户无需使用双手即可控制机器人移动及机械臂。通过利用Hololens 2的眼动追踪与头部运动追踪技术发送控制指令，机器人移动将跟随用户视线方向，而机械臂则模仿用户头部姿态。实验表明，本方法在时间效率与用户体验方面可与传统摇杆控制方法相媲美。演示视频可访问项目网页：https://zhangganlin.github.io/Holo-Spot-Page/index.html