Graphical perception studies are a key element of visualization research, forming the basis of design recommendations and contributing to our understanding of how people make sense of visualizations. However, graphical perception studies typically include only brief training sessions, and the impact of longer and more in-depth feedback remains unclear. In this paper, we explore the design and evaluation of feedback for graphical perception tasks, called VisQuiz. Using a quiz-like metaphor, we design feedback for a typical visualization comparison experiment, showing participants their answer alongside the correct answer in an animated sequence in each trial. We extend this quiz metaphor to include summary feedback after each stage of the experiment, providing additional moments for participants to reflect on their performance. To evaluate VisQuiz, we conduct a between-subjects experiment, including three stages of 40 trials each with a control condition that included only summary feedback. Results from n = 80 participants show that once participants started receiving trial feedback (Stage 2) they performed significantly better with bubble charts than those in the control condition. This effect carried over when feedback was removed (Stage 3). Results also suggest an overall trend of improved performance due to feedback. We discuss these findings in the context of other visualization literacy efforts, and possible future work at the intersection of visualization, feedback, and learning. Experiment data and analysis scripts are available at the following repository https://osf.io/jys5d/
翻译:图形感知研究是可视化研究的关键组成部分,构成了设计建议的基础,并有助于理解人们如何理解可视化。然而,图形感知研究通常仅包含简短的训练环节,而更长时间、更深入反馈的影响仍不清晰。本文探讨了图形感知任务中反馈的设计与评估,提出了VisQuiz方法。我们采用类似测验的隐喻,为典型的可视化比较实验设计反馈,在每次试验中通过动画序列向参与者展示其回答与正确答案的对比。我们将此测验隐喻扩展至实验每个阶段结束后提供总结性反馈,为参与者增加反思自身表现的时机。为评估VisQuiz,我们进行了一项受试者间实验,包含三个阶段(每阶段40次试验),设有仅提供总结性反馈的对照组。来自80名参与者的结果表明,一旦参与者开始接收试验反馈(第二阶段),他们在气泡图上的表现显著优于对照组。当反馈移除后(第三阶段),这一效应仍然延续。结果还表明反馈整体上提升了表现的趋势。我们结合其他可视化素养研究成果讨论了这些发现,并展望了可视化、反馈与学习交叉领域的未来工作方向。实验数据与分析脚本可访问以下仓库获取:https://osf.io/jys5d/