Generative AI (GenAI) is becoming a widely adopted learning support tool for both students and instructors, as it offers benefits such as personalized tutoring and scaffolded learning. However, recent research highlights potential drawbacks such as overreliance and metacognitive issues, especially in novice programmers. Most prior work focuses on introductory programming courses, and important questions remain about the underlying mechanisms behind the negative effects of GenAI and if findings can be generalized when students learn more advanced computer science concepts. To address this gap, we conducted a mixed-methods study comparing student interactions with GenAI to two traditional learning supports in a second-year algorithms course: algorithm visualization (AV) and human live tutoring (LT). Twelve students participated in three 90-minute study sessions focusing on sorting, tree, and graph algorithms. We recorded gaze and interaction data, and each session concluded with a test assessing their conceptual understanding of the topic. Our analysis classifies when during the problem-solving process participants sought help, and compares the interaction patterns across the three learning supports. Although GenAI produced a larger increase in self-efficacy compared to live tutoring, it was associated with noticeably lower results in learning outcomes. We found that participants did not use algorithm visualizations effectively, faced usage barriers when using GenAI to learn advanced topics, and that live tutoring yielded the highest learning outcomes.
翻译:生成式人工智能(GenAI)正成为学生和教师广泛采用的学习支持工具,可提供个性化辅导和支架式学习等优势。然而,近期研究揭示了其潜在弊端,如过度依赖和元认知问题,尤其在编程初学者中表现突出。现有研究多聚焦于入门编程课程,关于GenAI负面效应背后的内在机制,以及当学生学习更高级计算机科学概念时这些发现是否具有普适性,仍存在重要待解问题。为弥补这一研究空白,我们开展了一项混合方法研究,在二年级算法课程中将学生与GenAI的互动与两种传统学习支持方式(算法可视化AV、人工实时辅导LT)进行对比。12名参与者参加了三次90分钟的学习环节,分别涉及排序算法、树算法和图算法。我们记录了视线追踪与交互数据,每次环节结束时通过测试评估其对主题的概念理解水平。我们的分析对参与者在问题解决过程中寻求帮助的时机进行了分类,并比较了三种学习支持方式下的交互模式。尽管GenAI相较于人工辅导能更大程度提升自我效能感,但其对应的学习成果显著偏低。研究发现参与者未能有效利用算法可视化工具,在通过GenAI学习高级主题时面临使用障碍,而人工辅导则取得了最高的学习成效。