This paper examines how individuals perceive the credibility of content originating from human authors versus content generated by large language models, like the GPT language model family that powers ChatGPT, in different user interface versions. Surprisingly, our results demonstrate that regardless of the user interface presentation, participants tend to attribute similar levels of credibility. While participants also do not report any different perceptions of competence and trustworthiness between human and AI-generated content, they rate AI-generated content as being clearer and more engaging. The findings from this study serve as a call for a more discerning approach to evaluating information sources, encouraging users to exercise caution and critical thinking when engaging with content generated by AI systems.
翻译:本文探讨了在不同用户界面版本中,用户如何感知来自人类作者和大型语言模型(如驱动ChatGPT的GPT语言模型家族)生成内容的可信度。令人意外的是,我们的结果表明,无论用户界面呈现方式如何,参与者倾向于赋予相似的可信度水平。尽管参与者对人和AI生成内容的胜任力与可信赖性感知并无差异,但他们认为AI生成的内容更清晰且更具吸引力。本研究的发现呼吁采取更具辨别力的信息源评估方法,鼓励用户在接触AI系统生成的内容时保持谨慎并运用批判性思维。