This study examines the decoy effect's underexplored influence on user search interactions and methods for measuring information retrieval (IR) systems' vulnerability to this effect. It explores how decoy results alter users' interactions on search engine result pages, focusing on metrics like click-through likelihood, browsing time, and perceived document usefulness. By analyzing user interaction logs from multiple datasets, the study demonstrates that decoy results significantly affect users' behavior and perceptions. Furthermore, it investigates how different levels of task difficulty and user knowledge modify the decoy effect's impact, finding that easier tasks and lower knowledge levels lead to higher engagement with target documents. In terms of IR system evaluation, the study introduces the DEJA-VU metric to assess systems' susceptibility to the decoy effect, testing it on specific retrieval tasks. The results show differences in systems' effectiveness and vulnerability, contributing to our understanding of cognitive biases in search behavior and suggesting pathways for creating more balanced and bias-aware IR evaluations.

翻译：摘要：本研究探讨了诱饵效应对用户搜索交互的未充分探究影响，以及测量信息检索系统对此效应脆弱性的方法。它研究了诱饵结果如何改变用户在搜索引擎结果页上的交互行为，重点关注点击可能性、浏览时间和感知文档有用性等指标。通过分析多个数据集的用户交互日志，研究表明诱饵结果显著影响用户的行为和认知。此外，研究还探究了不同任务难度和用户知识水平如何调节诱饵效应的影响，发现较容易的任务和较低的知识水平导致用户对目标文档的参与度更高。在信息检索系统评估方面，本研究引入了DEJA-VU指标来评估系统对诱饵效应的敏感性，并在特定检索任务上进行了测试。结果显示不同系统的有效性和脆弱性存在差异，这有助于理解搜索行为中的认知偏差，并为创建更均衡且具有偏差意识的信息检索评估提供了可行路径。