Peer assessment has been widely studied as a replacement for traditional evaluation, not only by reducing the professors' workload but mainly by benefiting students' engagement and learning. Although several works successfully validate its accuracy and fairness, more research must be done on how students' pre-existing social relationships affect the grades they give their peers in an e-learning course. We developed a Moodle plugin to provide the platform with peer assessment capabilities in forums and used it on an MSc course. The plugin curated the reviewer set for a post based on the author's relationships and included rubrics to counter the possible interpersonal effects of peer assessment. Results confirm that peer assessment is reliable and accurate for works with at least three peer assessments, although students' grades are slightly higher. The impact of social relationships is noticeable when students who do not like another peer grade their work consistently lower than students who have a positive connection. However, this has little influence on the final aggregate peer grade. Our findings show that peer assessment can replace traditional evaluation in an e-learning environment where students are familiar with each other.
翻译:同伴互评作为传统评价方式的替代方案已被广泛研究,其不仅减轻了教师的工作负担,更主要的是提升了学生的参与度与学习成效。尽管已有诸多研究成功验证了其准确性与公平性,但关于学生既有的社交关系如何影响他们在在线课程中给予同伴的评分,仍需进一步探讨。我们开发了一款Moodle插件,为论坛提供了同伴互评功能,并将其应用于一门硕士课程中。该插件根据发帖者的社交关系为其筛选评审者,并引入评分量规以应对同伴互评可能产生的人际影响。结果表明,对于至少获得三次同伴评价的作业,同伴互评具有可靠性与准确性,尽管学生给出的分数略高。当学生对某同伴持负面态度时,其给出的评分持续低于与该同伴有积极联系的学生,此时社交关系的影响尤为明显。然而,这对最终的同伴综合评分影响甚微。我们的研究表明,在学生彼此熟悉的在线学习环境中,同伴互评可以替代传统评价方式。