Massive Open Online Courses (MOOCs) make high-quality instruction accessible. However, the lack of face-to-face interaction makes it difficult for instructors to obtain feedback on learners' performance and provide more effective instructional guidance. Traditional analytical approaches, such as clickstream logs or quiz scores, capture only coarse-grained learning outcomes and offer limited insight into learners' moment-to-moment cognitive states. In this study, we propose COIVis, an eye tracking-based visual analytics system that supports concept-level exploration of learning processes in MOOC videos. COIVis first extracts course concepts from multimodal video content and aligns them with the temporal structure and screen space of the lecture, defining Concepts of Interest (COIs), which anchor abstract concepts to specific spatiotemporal regions. Learners' gaze trajectories are transformed into COI sequences, and five interpretable learner-state features -- Attention, Cognitive Load, Interest, Preference, and Synchronicity -- are computed at the COI level based on eye tracking metrics. Building on these representations, COIVis provides a narrative, multi-view visualization enabling instructors to move from cohort-level overviews to individual learning paths, quickly locate problematic concepts, and compare diverse learning strategies. We evaluate COIVis through two case studies and in-depth user-feedback interviews. The results demonstrate that COIVis effectively provides instructors with valuable insights into the consistency and anomalies of learners' learning patterns, thereby supporting timely and personalized interventions for learners and optimizing instructional design.
翻译:大规模开放在线课程(MOOCs)使高质量教学资源得以广泛普及。然而,由于缺乏面对面互动,教师难以获取学习者表现反馈并提供更具针对性的教学指导。传统分析方法(如点击流日志或测验分数)仅能捕捉粗粒度的学习结果,对学习者实时认知状态的洞察力有限。本研究提出COIVis——一个基于眼动追踪的可视化分析系统,支持对MOOC视频中学习过程进行概念级探索。COIVis首先从多模态视频内容中提取课程概念,并将其与讲座的时间结构和屏幕空间对齐,定义兴趣概念(COIs),从而将抽象概念锚定到特定时空区域。学习者的注视轨迹被转化为COI序列,并基于眼动指标在COI层面计算五个可解释的学习者状态特征:注意力、认知负荷、兴趣度、偏好度与同步性。基于这些表征,COIVis提供叙事性多视图可视化,使教师能够从群体概览过渡到个体学习路径,快速定位问题概念,并比较不同学习策略。我们通过两个案例研究和深度用户反馈访谈对COIVis进行评估。结果表明,COIVis能有效帮助教师洞察学习者学习模式的一致性与异常,从而支持对学习者的及时个性化干预,并优化教学设计。