Game-based assessments (GBAs) are increasingly adopted in recruitment contexts as tools to assess transversal skills through observable behavior. However, empirical evidence directly comparing game-based behavioral indicators with traditional self-report measures remains limited. This study adopts a method-comparison approach to explore the convergence between self-perceived and behaviorally enacted problem-solving competence, comparing a game-based assessment with the Problem Solving Inventory (PSI-B). Seventy-eight participants completed both the PSI-B and a five-minute game-based problem-solving task, which classified performance into four behavioral proficiency levels. Results revealed no significant convergence between self-reported and behavior-based problem-solving scores, indicating a lack of convergence between the two measurement modalities. Rather than indicating a lack of validity of the game-based assessment, these findings support the view that self-report and behavioral measures provide complementary information about problem-solving competence. The study highlights the risks of relying on a single assessment modality in personnel selection and underscores the value of integrating game-based tools within multi-method assessment frameworks.
翻译:游戏化测评日益被招聘领域采纳为通过可观察行为评估跨领域技能的工具。然而,直接比较游戏化行为指标与传统自我报告测量的实证证据仍然有限。本研究采用方法比较路径,通过对比游戏化测评与问题解决量表(PSI-B),探究自我感知与行为表现的问题解决能力之间的收敛性。78名参与者同时完成了PSI-B和一项五分钟的游戏化问题解决任务,该任务将表现划分为四个行为熟练度等级。结果显示自我报告与行为基础的问题解决分数之间不存在显著收敛性,表明两种测量模式缺乏一致性。这些发现并非指向游戏化测评效度不足,反而支持了自我报告与行为测量能为问题解决能力提供互补信息的观点。本研究揭示了在人员选拔中依赖单一评估模式的风险,并强调了将游戏化工具整合到多方法评估框架中的价值。