Imaginative play is an area of creativity that could allow robots to engage with the world around them in a much more personified way. Imaginary play can be seen as taking real objects and locations and using them as imaginary objects and locations in virtual scenarios. We adopted the story generation capability of large language models (LLMs) to obtain the stories used for imaginary play with human-written prompts. Those generated stories will be simplified and mapped into action sequences that can guide the agent in imaginary play. To evaluate whether the agent can successfully finish the imaginary play, we also designed a text adventure game to simulate a house as the playground for the agent to interact.
翻译:想象力游戏是一种创造力领域,能让机器人以更拟人化的方式与周围世界互动。假想游戏可被视为将真实物体和地点作为虚拟场景中的想象物体和地点来使用。我们利用大型语言模型的叙事生成能力,通过人类撰写的提示词获取用于假想游戏的故事。这些生成的故事将被简化并映射为可指导智能体进行假想游戏的动作序列。为了评估智能体能否成功完成假想游戏,我们还设计了一款文字冒险游戏,模拟房屋作为智能体互动的游乐场。