In this study, we delve into the validity of conventional personality questionnaires in capturing the human-like personality traits of Large Language Models (LLMs). Our objective is to assess the congruence between the personality traits LLMs claim to possess and their demonstrated tendencies in real-world scenarios. By conducting an extensive examination of LLM outputs against observed human response patterns, we aim to understand the disjunction between self-knowledge and action in LLMs.
翻译:本研究深入探讨了传统人格问卷在捕捉大语言模型类人化人格特质方面的有效性。我们的目标是评估大语言模型所声称具备的人格特质与其在现实场景中表现出的行为倾向之间的一致性。通过将大语言模型的输出与观察到的人类反应模式进行广泛比对,我们旨在理解大语言模型中自我认知与实际行动之间的脱节现象。