This paper studies how parents want to moderate children's interactions with Generative AI chatbots, with the goal of informing the design of future GenAI parental control tools. We first used an LLM to generate synthetic child-GenAI chatbot interaction scenarios and worked with four parents to validate their realism. From this dataset, we carefully selected 12 diverse examples that evoked varying levels of concern and were rated the most realistic. Each example included a prompt and a GenAI chatbot response. We presented these to parents (N=24) and asked whether they found them concerning, why, and how they would prefer the responses to be modified and communicated. Our findings reveal three key insights: (1) parents express concern about interactions that current GenAI chatbot parental controls neglect; (2) parents want fine-grained transparency and moderation at the conversation level; and (3) parents need personalized controls that adapt to their desired strategies and children's ages.
翻译:本文研究了父母如何期望调节儿童与生成式AI聊天机器人的交互,旨在为未来生成式AI家长控制工具的设计提供参考。我们首先使用大型语言模型生成模拟的儿童-生成式AI聊天机器人交互场景,并与四位家长合作验证其真实性。基于此数据集,我们精心挑选了12个引发不同担忧程度且被评定为最真实的多样化示例。每个示例包含一个提示词和生成式AI聊天机器人的回复。我们将这些示例呈现给家长(N=24),询问他们是否认为这些交互令人担忧、原因何在,以及他们希望如何修改和传达这些回复。我们的研究结果揭示了三个关键发现:(1)父母对当前生成式AI聊天机器人家长控制机制所忽视的交互类型表示担忧;(2)父母期望在对话层面实现细粒度的透明度与调节功能;(3)父母需要能够适应其教育策略与子女年龄的个性化控制机制。