Remote proctoring technology, a cheating-preventive measure, often raises privacy and fairness concerns that may affect test-takers' experiences and the validity of test results. Our study explores how selectively obfuscating information in video recordings can protect test-takers' privacy while ensuring effective and fair cheating detection. Interviews with experts (N=9) identified four key video regions indicative of potential cheating behaviors: the test-taker's face, body, background and the presence of individuals in the background. Experts recommended specific obfuscation methods for each region based on privacy significance and cheating behavior frequency, ranging from conventional blurring to advanced methods like replacement with deepfake, 3D avatars and silhouetting. We then conducted a vignette experiment with potential test-takers (N=259, non-experts) to evaluate their perceptions of cheating detection, visual privacy and fairness, using descriptions and examples of still images for each expert-recommended combination of video regions and obfuscation methods. Our results indicate that the effectiveness of obfuscation methods varies by region. Tailoring remote proctoring with region-specific advanced obfuscation methods can improve the perceptions of privacy and fairness compared to the conventional methods, though it may decrease perceived information sufficiency for detecting cheating. However, non-experts preferred conventional blurring for videos they were more willing to share, highlighting a gap between the perceived effectiveness of the advanced obfuscation methods and their practical acceptance. This study contributes to the field of user-centered privacy by suggesting promising directions to address current remote proctoring challenges and guiding future research.
翻译:远程监考技术作为一种防作弊措施,常引发隐私与公平性担忧,可能影响考生的体验及考试结果的有效性。本研究探讨如何通过选择性混淆视频记录中的信息,在确保有效且公平的作弊检测的同时保护考生隐私。通过对专家(N=9)的访谈,识别出四个指示潜在作弊行为的关键视频区域:考生面部、身体、背景及背景中出现的人员。专家根据各区域的隐私重要性与作弊行为发生频率,为每个区域推荐了特定的混淆方法,涵盖从传统模糊处理到使用深度伪造、3D虚拟化身及剪影化等先进方法。随后,我们通过情景实验对潜在考生(非专家,N=259)进行评估,利用各专家推荐的视频区域与混淆方法组合的描述及静态图像示例,考察其对作弊检测、视觉隐私和公平性的感知。结果表明,混淆方法的有效性因区域而异。与传统方法相比,采用针对特定区域的先进混淆方法定制远程监考,可提升对隐私和公平性的感知,但可能降低感知到的用于检测作弊的信息充分性。然而,非专家对于其更愿意分享的视频更倾向于传统模糊处理,这凸显了先进混淆方法的感知效果与实际接受度之间的差距。本研究通过提出应对当前远程监考挑战的有前景方向并指导未来研究,为以用户为中心的隐私领域作出了贡献。