Standard methods, standard test conditions and the use of good sensory practices are key elements of sensory testing. However, while compliance assessment by trained and expert assessors is well developed, few information is available on testing consumer consistency. Therefore, we aim to answer the following research questions: What type of metrics can be used to characterise (in)consistent evaluation? How to rank assessors and attributes' evaluations based on (in)consistency? Who can be considered an (in)consistent assessor? What is the difference between consistent and inconsistent assessors' evaluations and use of scale? What is the impact of consistent and inconsistent assessors' evaluations on the overall liking estimate? The proposed detection of (in)consistency requires evaluations on two connected scales. We reveal how assessors and attributes can be ranked according to the level of inconsistency, as well as how inconsistent assessors can be identified. The suggested approach is illustrated by data from sensory tests of biscuits enriched with three pollens at different levels. Future consumer tests are recommended to account for possible inconsistent evaluations.

翻译：标准方法、标准测试条件以及良好感官实践的应用是感官测试的关键要素。然而，尽管针对受过培训的专家评估员的合规性评估已较为完善，但关于消费者一致性的测试信息却十分有限。因此，我们旨在回答以下研究问题：哪些指标可用于表征（不）一致性评估？如何根据（不）一致性对评估员和属性评估进行排序？谁可以被视为（不）一致的评估员？一致与不一致评估员的评估结果及量表使用存在哪些差异？一致与不一致评估员的评估对总体喜好度估计有何影响？所提出的（不）一致性检测方法要求使用两个关联量表进行评估。我们揭示了如何根据不一致程度对评估员和属性进行排序，以及如何识别不一致的评估员。通过添加不同水平三种花粉的饼干感官测试数据，对该方法的有效性进行了验证。建议未来消费者测试需考虑可能存在的不一致评估。