This paper presents a sim-to-real approach that enables legged robots to dynamically manipulate large and heavy objects with whole-body dexterity. Our key insight is that by performing test-time steering of a pre-trained whole-body control policy with a sample-based planner, we can enable these robots to solve a variety of dynamic loco-manipulation tasks. Interestingly, we find our method generalizes to a diverse set of objects and tasks with no additional tuning or training, and can be further enhanced by flexibly adjusting the cost function at test time. We demonstrate the capabilities of our approach through a variety of challenging loco-manipulation tasks on a Spot quadruped robot in the real world, including uprighting a tire heavier than the robot's nominal lifting capacity and dragging a crowd-control barrier larger and taller than the robot itself. Additionally, we show that the same approach can be generalized to humanoid loco-manipulation tasks, such as opening a door and pushing a table, in simulation. Project code and videos are available at \href{https://sumo.rai-inst.com/}{https://sumo.rai-inst.com/}.
翻译:本文提出了一种从仿真到现实的方法,使足式机器人能够以全身灵巧性动态操控大型重物。我们的核心洞见在于:通过结合预训练全身控制策略与基于采样的规划器,在测试阶段对控制策略进行实时引导,使机器人能够解决多种动态运动操控任务。值得注意的是,我们发现该方法无需额外调优或训练即可泛化至多样化的物体与任务,且能通过灵活调整测试阶段的代价函数进一步增强性能。我们在一台Spot四足机器人上通过一系列具有挑战性的现实世界运动操控任务验证了该方法的能力,包括扶起超过机器人额定举升重量的轮胎、拖拽比机器人更大更高的隔离柱。此外,仿真实验表明,相同方法可泛化至人形机器人的运动操控任务(如开门、推桌)。项目代码与演示视频见 \href{https://sumo.rai-inst.com/}{https://sumo.rai-inst.com/}。