The rapid expansion of Learning Analytics (LA) and Artificial Intelligence in Education (AIED) offers new scalable, data-intensive systems but also raises concerns about data privacy and agency. Excluding stakeholders -- like students and teachers -- from the design process can potentially lead to mistrust and inadequately aligned tools. Despite a shift towards human-centred design in recent LA and AIED research, there remain gaps in our understanding of the importance of human control, safety, reliability, and trustworthiness in the design and implementation of these systems. We conducted a systematic literature review to explore these concerns and gaps. We analysed 108 papers to provide insights about i) the current state of human-centred LA/AIED research; ii) the extent to which educational stakeholders have contributed to the design process of human-centred LA/AIED systems; iii) the current balance between human control and computer automation of such systems; and iv) the extent to which safety, reliability and trustworthiness have been considered in the literature. Results indicate some consideration of human control in LA/AIED system design, but limited end-user involvement in actual design. Based on these findings, we recommend: 1) carefully balancing stakeholders' involvement in designing and deploying LA/AIED systems throughout all design phases, 2) actively involving target end-users, especially students, to delineate the balance between human control and automation, and 3) exploring safety, reliability, and trustworthiness as principles in future human-centred LA/AIED systems.
翻译:随着学习分析(LA)与人工智能教育应用(AIED)的快速扩展,虽涌现出新型可扩展的数据密集型系统,但也引发了对数据隐私与自主性的担忧。将学生和教师等利益相关者排除在设计过程之外,可能导致系统信任缺失与工具适配不足。尽管近年来LA与AIED研究逐步转向以人为中心的设计范式,但对于此类系统设计与实施中人的控制、安全性、可靠性及可信赖性的重要性认知仍存在空白。本文通过系统性文献综述探究上述问题与不足,对108篇论文进行分析,以阐明:i) 当前以人为中心的LA/AIED研究现状;ii) 教育利益相关者对以人为中心的LA/AIED系统设计过程的参与程度;iii) 此类系统中人类控制与计算机自动化之间的现有平衡;iv) 现有文献对安全性、可靠性及可信赖性的考量程度。结果表明,LA/AIED系统设计虽已部分考虑人类控制,但实际设计中终端用户参与有限。基于此,我们建议:1) 在LA/AIED系统设计部署的全阶段审慎平衡利益相关者的参与度;2) 主动吸纳目标终端用户(尤其是学生)以界定人类控制与自动化的平衡边界;3) 将安全性、可靠性及可信赖性作为未来以人为中心的LA/AIED系统的核心设计原则。