This paper demonstrates how OpenAI's ChatGPT can be used in a few-shot setting to convert natural language instructions into a sequence of executable robot actions. The paper proposes easy-to-customize input prompts for ChatGPT that meet common requirements in practical applications, such as easy integration with robot execution systems and applicability to various environments while minimizing the impact of ChatGPT's token limit. The prompts encourage ChatGPT to output a sequence of predefined robot actions, represent the operating environment in a formalized style, and infer the updated state of the operating environment. Experiments confirmed that the proposed prompts enable ChatGPT to act according to requirements in various environments, and users can adjust ChatGPT's output with natural language feedback for safe and robust operation. The proposed prompts and source code are open-source and publicly available at https://github.com/microsoft/ChatGPT-Robot-Manipulation-Prompts
翻译:本文展示了如何在少样本场景下利用OpenAI的ChatGPT,将自然语言指令转换为一系列可执行的机器人动作。论文提出了易于定制的ChatGPT输入提示,这些提示满足实际应用中的常见需求,例如易于与机器人执行系统集成、适用于各种环境,同时最小化ChatGPT令牌限制的影响。这些提示鼓励ChatGPT输出一系列预定义的机器人动作,以形式化风格表示操作环境,并推断操作环境更新后的状态。实验证实,所提出的提示使ChatGPT能够在各种环境中按照要求行动,用户可以通过自然语言反馈调整ChatGPT的输出,实现安全稳健的操作。所提出的提示和源代码已开源,并公开于https://github.com/microsoft/ChatGPT-Robot-Manipulation-Prompts。