The emergence of generative AI technologies, such as OpenAI's ChatGPT chatbot, has expanded the scope of tasks that AI tools can accomplish and enabled AI-generated creative content. In this study, we explore how disclosure regarding the use of AI in the creation of creative content affects human evaluation of such content. In a series of pre-registered experimental studies, we show that AI disclosure has no meaningful effect on evaluation either for creative or descriptive short stories, but that AI disclosure has a negative effect on evaluations for emotionally evocative poems written in the first person. We interpret this result to suggest that reactions to AI-generated content may be negative when the content is viewed as distinctly "human." We discuss the implications of this work and outline planned pathways of research to better understand whether and when AI disclosure may affect the evaluation of creative content.
翻译:生成式AI技术(如OpenAI的ChatGPT聊天机器人)的兴起,扩展了AI工具可完成任务的范畴,并推动了AI生成创意内容的实现。本研究探究在创意内容创作过程中披露AI使用情况如何影响人类对该内容的评价。通过一系列预注册实验研究,我们发现:对于创意或描述性短篇故事,AI披露对评价无显著影响;但对于以第一人称撰写的富有情感色彩的诗歌,AI披露会对其评价产生负面效应。我们解读这一结果表明,当内容被视为具有明确"人类特质"时,受众可能对AI生成内容产生负面反应。本文讨论了该研究的意义,并概述了为深入理解AI披露是否及何时影响创意内容评价而规划的研究路径。