We present Neural Signal Operated Intelligent Robots (NOIR), a general-purpose, intelligent brain-robot interface system that enables humans to command robots to perform everyday activities through brain signals. Through this interface, humans communicate their intended objects of interest and actions to the robots using electroencephalography (EEG). Our novel system demonstrates success in an expansive array of 20 challenging, everyday household activities, including cooking, cleaning, personal care, and entertainment. The effectiveness of the system is improved by its synergistic integration of robot learning algorithms, allowing for NOIR to adapt to individual users and predict their intentions. Our work enhances the way humans interact with robots, replacing traditional channels of interaction with direct, neural communication. Project website: https://noir-corl.github.io/.
翻译:我们提出神经信号驱动的智能机器人系统(NOIR),这是一种通用的智能脑机接口系统,能够使人类通过脑信号指挥机器人完成日常活动。通过该接口,人类利用脑电图(EEG)向机器人传达其感兴趣的目标对象与操作意图。本系统在20项具有挑战性的日常家庭活动中展现出优异性能,涵盖烹饪、清洁、个人护理及娱乐等多个场景。通过将机器人学习算法与系统进行协同集成,NOIR能够适应个体用户并预测其意图,从而显著提升系统效能。本研究革新了人机交互方式,以直接的神经通信取代传统交互通道。项目网站:https://noir-corl.github.io/。