Human intelligence thrives on cognitive synergy, where collaboration among different minds yield superior outcomes compared to isolated individuals. In this work, we propose Solo Performance Prompting (SPP), which transforms a single LLM into a cognitive synergist by engaging in multi-turn self-collaboration with multiple personas. A cognitive synergist is an intelligent agent that collaboratively combines multiple minds' strengths and knowledge to enhance problem-solving in complex tasks. By dynamically identifying and simulating different personas based on task inputs, SPP unleashes the potential of cognitive synergy in LLMs. Our in-depth analysis shows that assigning multiple fine-grained personas in LLMs improves problem-solving abilities compared to using a single or fixed number of personas. We evaluate SPP on three challenging tasks: Trivia Creative Writing, Codenames Collaborative, and Logic Grid Puzzle, encompassing both knowledge-intensive and reasoning-intensive types. Unlike previous works, such as Chain-of-Thought, that solely enhance the reasoning abilities in LLMs, experimental results demonstrate that SPP effectively reduces factual hallucination, and maintains strong reasoning capabilities. Additionally, comparative experiments show that cognitive synergy only emerges in GPT-4 and does not appear in less capable models, such as GPT-3.5-turbo and Llama2-13b-chat, which draws an interesting analogy to human development. Code, data, and prompts can be found at: https://github.com/MikeWangWZHL/Solo-Performance-Prompting.git.
翻译:人类智能依赖于认知协同效应,即不同思维主体间的协作相较于个体独立运作能产生更优结果。本工作提出单人绩效提示(SPP)方法,通过使单个大语言模型与多重角色进行多轮自我协作,将其转化为认知协同体。认知协同体是一种智能体,通过协作整合多重思维的优势与知识来增强复杂任务的问题求解能力。SPP基于任务输入动态识别并模拟不同角色,从而释放大语言模型中认知协同的潜力。深入分析表明,相较于使用单一或固定数量角色,为大语言模型分配多个精细化角色能够提升问题求解能力。我们在三项具有挑战性的任务上评估SPP:琐事创意写作、代号协作与逻辑网格谜题,涵盖知识密集型和推理密集型类型。与仅增强大语言模型推理能力的链式思维等先前工作不同,实验结果表明SPP能有效减少事实性幻觉,同时保持强大推理能力。此外,对比实验显示认知协同效应仅出现在GPT-4中,而在GPT-3.5-turbo和Llama2-13b-chat等能力较弱的模型中未出现,这与人类发展过程形成了有趣的类比。代码、数据及提示词详见:https://github.com/MikeWangWZHL/Solo-Performance-Prompting.git