The interplay between artificial intelligence (AI) and psychology, particularly in personality assessment, represents an important emerging area of research. Accurate personality trait estimation is crucial not only for enhancing personalization in human-computer interaction but also for a wide variety of applications ranging from mental health to education. This paper analyzes the capability of a generic chatbot, ChatGPT, to effectively infer personality traits from short texts. We report the results of a comprehensive user study featuring texts written in Czech by a representative population sample of 155 participants. Their self-assessments based on the Big Five Inventory (BFI) questionnaire serve as the ground truth. We compare the personality trait estimations made by ChatGPT against those by human raters and report ChatGPT's competitive performance in inferring personality traits from text. We also uncover a 'positivity bias' in ChatGPT's assessments across all personality dimensions and explore the impact of prompt composition on accuracy. This work contributes to the understanding of AI capabilities in psychological assessment, highlighting both the potential and limitations of using large language models for personality inference. Our research underscores the importance of responsible AI development, considering ethical implications such as privacy, consent, autonomy, and bias in AI applications.

翻译：人工智能与心理学之间的相互作用，特别是人格评估领域，是一个重要的新兴研究方向。准确的人格特质评估不仅对增强人机交互中的个性化至关重要，还对从心理健康到教育等广泛应用具有关键意义。本文分析了通用聊天机器人ChatGPT从短文本中有效推断人格特质的能力。我们报告了一项包含155名参与者（均以捷克语撰写文本）的代表性人群样本的全面用户研究结果。基于大五人格量表（BFI）问卷的参与者自我评估被作为基准真实数据。我们将ChatGPT的人格特质评估与人类评估者的结果进行了比较，报告了ChatGPT在从文本推断人格特质方面的竞争性表现。我们还发现ChatGPT在所有人格维度上的评估均存在"积极偏差"，并探讨了提示词组成对准确性的影响。这项工作有助于理解人工智能在心理评估中的能力，揭示了使用大语言模型进行人格推断的潜力与局限性。我们的研究强调了负责任地开发人工智能的重要性，需考虑隐私、知情同意、自主性及偏差等伦理问题在AI应用中的影响。