The interplay between artificial intelligence (AI) and psychology, particularly in personality assessment, represents an important emerging area of research. Accurate personality trait estimation is crucial not only for enhancing personalization in human-computer interaction but also for a wide variety of applications ranging from mental health to education. This paper analyzes the capability of a generic chatbot, ChatGPT, to effectively infer personality traits from short texts. We report the results of a comprehensive user study featuring texts written in Czech by a representative population sample of 155 participants. Their self-assessments based on the Big Five Inventory (BFI) questionnaire serve as the ground truth. We compare the personality trait estimations made by ChatGPT against those by human raters and report ChatGPT's competitive performance in inferring personality traits from text. We also uncover a 'positivity bias' in ChatGPT's assessments across all personality dimensions and explore the impact of prompt composition on accuracy. This work contributes to the understanding of AI capabilities in psychological assessment, highlighting both the potential and limitations of using large language models for personality inference. Our research underscores the importance of responsible AI development, considering ethical implications such as privacy, consent, autonomy, and bias in AI applications.
翻译:人工智能(AI)与心理学之间的相互作用,尤其是在人格评估领域,代表着一个重要的新兴研究方向。准确的人格特质估计不仅对于提升人机交互的个性化至关重要,而且在从心理健康到教育等广泛的应用中都具有重要意义。本文分析了一个通用聊天机器人ChatGPT从短文本中有效推断人格特质的能力。我们报告了一项全面的用户研究结果,该研究包含155名具有代表性的人口样本参与者用捷克语撰写的文本。他们基于大五人格量表(BFI)问卷的自我评估作为基准真值。我们将ChatGPT的人格特质估计结果与人类评估者的结果进行比较,并报告了ChatGPT在从文本推断人格特质方面具有竞争力的表现。我们还发现了ChatGPT在所有人格维度评估中存在的“积极性偏差”,并探讨了提示语构成对准确性的影响。这项工作有助于理解AI在心理评估中的能力,突显了使用大语言模型进行人格推断的潜力与局限性。我们的研究强调了负责任的AI开发的重要性,需考虑AI应用中的伦理影响,如隐私、同意、自主权和偏见。