This contribution analyzes the self-perception and political biases of OpenAI's Large Language Model ChatGPT. Taking into account the first small-scale reports and studies that have emerged, claiming that ChatGPT is politically biased towards progressive and libertarian points of view, this contribution aims to provide further clarity on this subject. For this purpose, ChatGPT was asked to answer the questions posed by the political compass test as well as similar questionnaires that are specific to the respective politics of the G7 member states. These eight tests were repeated ten times each and revealed that ChatGPT seems to hold a bias towards progressive views. The political compass test revealed a bias towards progressive and libertarian views, with the average coordinates on the political compass being (-6.48, -5.99) (with (0, 0) the center of the compass, i.e., centrism and the axes ranging from -10 to 10), supporting the claims of prior research. The political questionnaires for the G7 member states indicated a bias towards progressive views but no significant bias between authoritarian and libertarian views, contradicting the findings of prior reports, with the average coordinates being (-3.27, 0.58). In addition, ChatGPT's Big Five personality traits were tested using the OCEAN test and its personality type was queried using the Myers-Briggs Type Indicator (MBTI) test. Finally, the maliciousness of ChatGPT was evaluated using the Dark Factor test. These three tests were also repeated ten times each, revealing that ChatGPT perceives itself as highly open and agreeable, has the Myers-Briggs personality type ENFJ, and is among the 15% of test-takers with the least pronounced dark traits.
翻译:本研究分析了OpenAI大型语言模型ChatGPT的自我认知与政治偏见。基于早期小规模报告和研究中声称ChatGPT对进步主义与自由意志主义观点存在政治偏见的发现,本文旨在进一步阐明该问题。为此,我们要求ChatGPT回答政治指南针测试中的问题,以及针对七国集团成员国政治立场设计的类似问卷。上述八项测试各重复十次,结果表明ChatGPT对进步主义观点存在明显偏见。政治指南针测试显示其对进步主义与自由意志主义观点存在偏见,平均坐标值为(-6.48, -5.99)(其中(0,0)为指南针中心即中间立场,坐标轴范围从-10到10),这一结果支持了先前研究的论断。针对七国集团成员国的政治问卷则表明:ChatGPT对进步主义观点存在偏见,但在威权主义与自由意志主义维度上未呈现显著偏向(平均坐标值(-3.27, 0.58)),这与先前报告结论存在矛盾。此外,研究通过OCEAN测试评估了ChatGPT的大五人格特质,并利用迈尔斯-布里格斯类型指标(MBTI)测试探查其人格类型,最后采用暗黑因子测试评估其恶意倾向。这三项测试同样各重复十次,结果显示ChatGPT自认为具有高开放性和宜人性,人格类型为ENFJ,且属于暗黑特质最弱的15%测试者群体。