Imitation learning from human demonstrations has shown impressive performance in robotics. However, most results focus on table-top manipulation, lacking the mobility and dexterity necessary for generally useful tasks. In this work, we develop a system for imitating mobile manipulation tasks that are bimanual and require whole-body control. We first present Mobile ALOHA, a low-cost and whole-body teleoperation system for data collection. It augments the ALOHA system with a mobile base, and a whole-body teleoperation interface. Using data collected with Mobile ALOHA, we then perform supervised behavior cloning and find that co-training with existing static ALOHA datasets boosts performance on mobile manipulation tasks. With 50 demonstrations for each task, co-training can increase success rates by up to 90%, allowing Mobile ALOHA to autonomously complete complex mobile manipulation tasks such as sauteing and serving a piece of shrimp, opening a two-door wall cabinet to store heavy cooking pots, calling and entering an elevator, and lightly rinsing a used pan using a kitchen faucet. Project website: https://mobile-aloha.github.io
翻译:从人类示范中进行模仿学习已在机器人领域展现出显著性能。然而,大多数成果集中于桌面操作,缺乏通用任务所需的移动性与灵巧性。本研究开发了一套系统,用于模仿需要全身控制的双臂移动操作任务。我们首先提出Mobile ALOHA——一种用于数据采集的低成本全身遥操作系统。该系统通过移动基座和全身遥操作接口对ALOHA系统进行扩展。利用Mobile ALOHA采集的数据,我们执行有监督行为克隆,发现与现有静态ALOHA数据集联合训练可提升移动操作任务的表现。对于每项任务仅需50个示范样本,联合训练可使成功率提升高达90%,使Mobile ALOHA能够自主完成复杂的移动操作任务,例如翻炒并盛出虾仁、打开双开门壁柜存放沉重锅具、呼叫并进入电梯、以及用厨房水龙头轻洗用过的平底锅。项目网站:https://mobile-aloha.github.io