Children develop narrative skills by understanding and actively building connections between elements, image-text matching and consequences. However, it is challenging for children to clearly grasp these multi-level links only through explanations of text or facilitator's speech. To address this, we developed Colin, an interactive storytelling tool that supports children's multi-level narrative skills through both voice and visual modalities. In the generation stage, Colin supports facilitator to define and review generated text and image content freely. In the understanding stage, a question-feedback model helps children understand multi-level connections while co-creating stories with Colin. In the building phase, Colin actively encourages children to create connections between elements through drawing and speaking. A user study with 20 participants evaluated Colin by measuring children's engagement, understanding of cause-and-effect relationships, and the quality of their new story creations. Our results demonstrated that Colin significantly enhances the development of children's narrative skills across multiple levels.
翻译:儿童通过理解并积极构建元素间的联系、图文匹配及因果关系来发展叙事技能。然而,仅通过文字解释或引导者的讲述,儿童往往难以清晰把握这些多层次关联。为此,我们开发了Colin——一款通过语音与视觉双模态支持儿童多层次叙事技能的交互式故事创作工具。在生成阶段,Colin支持引导者自由定义并审阅生成的文本与图像内容。在理解阶段,通过问题反馈模型帮助儿童在与Colin协同创作故事的过程中理解多层次关联。在构建阶段,Colin通过绘画与口语表达积极鼓励儿童在故事元素间建立联系。一项包含20名参与者的用户研究通过评估儿童的参与度、因果关系的理解程度以及新创故事的质量,对Colin进行了验证。结果表明,Colin能显著促进儿童在多个层次上叙事能力的发展。