Repeated measurements of player experience are crucial in games user research, assessing how different designs evolve over time. However, this necessitates lightweight measurement instruments that are fit for the purpose. In this study, we conduct an examination of the test-retest reliability of the \emph{miniPXI} -- a short variant of the \emph{Player Experience Inventory} (\emph{PXI}), an established measure for measuring player experience. We analyzed test-retest reliability by leveraging four games involving 100 participants, comparing it with four established multi-item measures and single-item indicators such as the Net Promoter Score (\emph{NPS}) and overall enjoyment. The findings show mixed outcomes; the \emph{miniPXI} demonstrated varying levels of test-retest reliability. Some constructs showed good to moderate reliability, while others were less consistent. On the other hand, multi-item measures exhibited moderate to good test-retest reliability, demonstrating their effectiveness in measuring player experiences over time. Additionally, the employed single-item indicators (\emph{NPS} and overall enjoyment) demonstrated good reliability. The results of our study highlight the complexity of player experience evaluations over time, utilizing single and multiple items per construct measures. We conclude that single-item measures may not be appropriate for long-term investigations of more complex PX dimensions and provide practical considerations for the applicability of such measures in repeated measurements.
翻译:玩家体验的重复测量在游戏用户研究中至关重要,它能评估不同设计如何随时间演变。然而,这需要适合目的的轻量级测量工具。本研究考察了《玩家体验量表》(PXI)的简短版本——miniPXI——的测试-再测信度。我们通过包含100名参与者的四款游戏进行分析,并将其与四种成熟的多项目量表以及Net Promoter Score(NPS)和整体享受度等单项目指标进行比较。结果显示混合效应:miniPXI表现出不同程度的测试-再测信度,部分构念具有良好至中等信度,而其他构念的一致性较低。相比之下,多项目量表展现出中等至良好的测试-再测信度,证明了其在长期测量玩家体验方面的有效性。此外,采用的单项目指标(NPS和整体享受度)表现出良好的信度。本研究结果凸显了使用单项目与多项目测量进行玩家体验长期评估的复杂性。我们得出结论:单项目测量可能不适用于复杂玩家体验维度的长期研究,并为此类测量在重复测量中的适用性提供了实际考量。