The prevalent use of Large Language Models (LLMs) has necessitated studying their mental models, yielding noteworthy theoretical and practical implications. Current research has demonstrated that state-of-the-art LLMs, such as ChatGPT, exhibit certain theory of mind capabilities and possess relatively stable Big Five and/or MBTI personality traits. In addition, cognitive process features form an essential component of these mental models. Research in cultural psychology indicated significant differences in the cognitive processes of Eastern and Western people when processing information and making judgments. While Westerners predominantly exhibit analytical thinking that isolates things from their environment to analyze their nature independently, Easterners often showcase holistic thinking, emphasizing relationships and adopting a global viewpoint. In our research, we probed the cultural cognitive traits of ChatGPT. We employed two scales that directly measure the cognitive process: the Analysis-Holism Scale (AHS) and the Triadic Categorization Task (TCT). Additionally, we used two scales that investigate the value differences shaped by cultural thinking: the Dialectical Self Scale (DSS) and the Self-construal Scale (SCS). In cognitive process tests (AHS/TCT), ChatGPT consistently tends towards Eastern holistic thinking, but regarding value judgments (DSS/SCS), ChatGPT does not significantly lean towards the East or the West. We suggest that the result could be attributed to both the training paradigm and the training data in LLM development. We discuss the potential value of this finding for AI research and directions for future research.
翻译:大型语言模型(LLMs)的广泛应用促使研究者探究其心智模型,这具有重要的理论和实践意义。当前研究表明,以ChatGPT为代表的最先进LLMs展现出一定的心理理论能力,并具有相对稳定的大五人格和/或MBTI人格特质。此外,认知过程特征构成了这些心智模型的重要组成部分。文化心理学研究表明,东方人和西方人在处理信息和做出判断时的认知过程存在显著差异:西方人主要表现出分析性思维,倾向于将事物与其环境分离以独立分析其本质;而东方人则常展现整体性思维,强调关系性并从全局视角出发。在本研究中,我们探究了ChatGPT的文化认知特征。我们采用了两种直接测量认知过程的量表:分析-整体性量表(AHS)和三组分类任务(TCT)。此外,我们还使用了两种探究文化思维塑造的价值观差异的量表:辩证自我量表(DSS)和自我建构量表(SCS)。在认知过程测试(AHS/TCT)中,ChatGPT始终倾向于东方整体性思维;但在价值观判断(DSS/SCS)方面,ChatGPT并未显著倾向东方或西方。我们认为这一结果可能归因于LLM开发过程中的训练范式与训练数据。我们讨论了该发现对人工智能研究的潜在价值及未来研究方向。