Pre-trained language models (PLMs) leverage chains-of-thought (CoT) to simulate human reasoning and inference processes, achieving proficient performance in multi-hop QA. However, a gap persists between PLMs' reasoning abilities and those of humans when tackling complex problems. Psychological studies suggest a vital connection between explicit information in passages and human prior knowledge during reading. Nevertheless, current research has given insufficient attention to linking input passages and PLMs' pre-training-based knowledge from the perspective of human cognition studies. In this study, we introduce a \textbf{P}rompting \textbf{E}xplicit and \textbf{I}mplicit knowledge (PEI) framework, which uses prompts to connect explicit and implicit knowledge, aligning with human reading process for multi-hop QA. We consider the input passages as explicit knowledge, employing them to elicit implicit knowledge through unified prompt reasoning. Furthermore, our model incorporates type-specific reasoning via prompts, a form of implicit knowledge. Experimental results show that PEI performs comparably to the state-of-the-art on HotpotQA. Ablation studies confirm the efficacy of our model in bridging and integrating explicit and implicit knowledge.
翻译:预训练语言模型(PLMs)利用思维链(CoT)模拟人类的推理过程,在多跳问答任务中取得了卓越性能。然而,在解决复杂问题时,PLMs的推理能力与人类之间仍存在差距。心理学研究表明,在阅读过程中,篇章中的显性信息与人类先验知识之间存在重要关联。但现有研究尚未从人类认知研究的视角充分关注输入篇章与PLMs预训练知识之间的关联。本研究提出一种统一的\textbf{显}性与\textbf{隐}性知识提示(PEI)框架,通过提示机制连接显性与隐性知识,以契合人类阅读过程实现多跳问答。我们将输入篇章视为显性知识,通过统一提示推理来诱发隐性知识。此外,我们的模型通过提示推理引入类型特定的隐式知识。实验结果表明,PEI在HotpotQA上取得了与当前最优方法相当的性能。消融实验证实了该模型在桥接与整合显隐性知识方面的有效性。