Causal reasoning ability is crucial for numerous NLP applications. Despite the impressive emerging ability of ChatGPT in various NLP tasks, it is unclear how well ChatGPT performs in causal reasoning. In this paper, we conduct the first comprehensive evaluation of the ChatGPT's causal reasoning capabilities. Experiments show that ChatGPT is not a good causal reasoner, but a good causal explainer. Besides, ChatGPT has a serious hallucination on causal reasoning, possibly due to the reporting biases between causal and non-causal relationships in natural language, as well as ChatGPT's upgrading processes, such as RLHF. The In-Context Learning (ICL) and Chain-of-Thought (CoT) techniques can further exacerbate such causal hallucination. Additionally, the causal reasoning ability of ChatGPT is sensitive to the words used to express the causal concept in prompts, and close-ended prompts perform better than open-ended prompts. For events in sentences, ChatGPT excels at capturing explicit causality rather than implicit causality, and performs better in sentences with lower event density and smaller lexical distance between events. The code is available on https://github.com/ArrogantL/ChatGPT4CausalReasoning .

翻译：因果推理能力对于众多自然语言处理应用至关重要。尽管ChatGPT在各种NLP任务中展现出令人瞩目的新兴能力，但其在因果推理任务中的表现尚不明确。本文首次对ChatGPT的因果推理能力进行全面评估。实验表明，ChatGPT并非出色的因果推理者，而是一个优秀的因果解释者。此外，ChatGPT在因果推理中存在严重幻觉，这可能是由于自然语言中因果与非因果关系之间的报告偏差，以及ChatGPT的升级过程（如RLHF）所致。上下文学习（ICL）与思维链（CoT）技术会进一步加剧此类因果幻觉。同时，ChatGPT的因果推理能力对提示中表达因果概念的词汇敏感，封闭式提示的表现优于开放式提示。就句子中的事件而言，ChatGPT更擅长捕捉显式因果而非隐式因果，且在事件密度较低、事件间词汇距离较短的句子中表现更佳。代码开源地址：https://github.com/ArrogantL/ChatGPT4CausalReasoning