The growing popularity of generative artificial intelligence (AI) chatbots such as ChatGPT is having transformative effects on social media. As the prevalence of AI-generated content grows, concerns have been raised regarding privacy and misinformation online. Among social media platforms, Discord enables AI integrations -- making their primarily "Generation Z" userbase particularly exposed to AI-generated content. We surveyed Generation Z aged individuals (n = 335) to evaluate their proficiency in discriminating between AI-generated and human-authored text on Discord. The investigation employed one-shot prompting of ChatGPT, disguised as a text message received on the Discord.com platform. We explore the influence of demographic factors on ability, as well as participants' familiarity with Discord and artificial intelligence technologies. We find that Generation Z individuals are unable to discern between AI and human-authored text (p = 0.011), and that those with lower self-reported familiarity with Discord demonstrated an improved ability in identifying human-authored compared to those with self-reported experience with AI (p << 0.0001). Our results suggest that there is a nuanced relationship between AI technology and popular modes of communication for Generation Z, contributing valuable insights into human-computer interactions, digital communication, and artificial intelligence literacy.
翻译:生成式人工智能(AI)聊天机器人(如ChatGPT)的日益普及正对社会媒体产生变革性影响。随着AI生成内容的普及程度不断提高,关于隐私和网络虚假信息的问题引发关注。在各类社交媒体平台中,Discord支持AI集成功能——这使得其主要用户群体"Z世代"特别容易接触到AI生成内容。我们对335名Z世代个体进行了调查,评估其在Discord平台上区分AI生成文本与人类撰写文本的能力。研究采用ChatGPT一次性提示(one-shot prompting)技术,将被测试文本伪装成Discord平台接收的信息。我们探讨了人口统计因素对识别能力的影响,以及参与者对Discord和人工智能技术的熟悉程度。研究发现Z世代个体无法有效辨别AI与人类撰写的文本(p=0.011),且与自报具备AI使用经验的群体相比,自报对Discord熟悉度较低的群体在识别人类撰写文本方面表现出更优能力(p<<0.0001)。研究结果表明,Z世代群体在AI技术与流行沟通模式之间存在复杂关联,为人机交互、数字通信和人工智能素养研究提供了重要见解。