The capabilities of generative AI (genAI) have dramatically increased in recent times, and there are opportunities for children to leverage new features for personal and school-related endeavors. However, while the future of genAI is taking form, there remain potentially harmful limitations, such as generation of outputs with misinformation and bias. We ran a workshop study focused on ChatGPT to explore middle school girls' (N = 26) attitudes and reasoning about how genAI works. We focused on girls who are often disproportionately impacted by algorithmic bias. We found that: (1) middle school girls were initially overtrusting of genAI, (2) deliberate exposure to the limitations and mistakes of generative AI shifted this overtrust to disillusionment about genAI capabilities, though they were still optimistic for future possibilities of genAI, and (3) their ideas about school policy were nuanced. This work informs how children think about genAI like ChatGPT and its integration in learning settings.
翻译:近年来,生成式人工智能(genAI)的能力显著提升,为儿童利用其新功能进行个人及学业相关活动创造了机遇。然而,在生成式AI技术逐渐成形的过程中,仍存在潜在的有害局限,例如生成带有错误信息和偏见的内容。我们开展了一项以ChatGPT为重点的研讨式研究,旨在探讨中学女生(N = 26)对生成式AI工作原理的态度与认知推理。我们特别关注那些通常受算法偏见影响尤为严重的女生群体。研究发现:(1)中学女生最初对生成式AI存在过度信任;(2)在有意接触生成式AI的局限性和错误案例后,这种过度信任转变为对其能力的幻灭感,尽管她们仍对生成式AI的未来可能性持乐观态度;(3)她们对学校相关政策的看法具有细致入微的思考。本研究为理解儿童如何看待ChatGPT等生成式AI及其在教育场景中的整合提供了重要参考。