Tip-of-the-tongue (ToT) known-item retrieval involves re-finding an item for which the searcher does not reliably recall an identifier. ToT information requests (or queries) are verbose and tend to include several complex phenomena, making them especially difficult for existing information retrieval systems. The TREC 2025 ToT track focused on a single ad-hoc retrieval task. This year, we extended the track to general domain and incorporated different sets of test queries from diverse sources, namely from the MS-ToT dataset, manual topic development, and LLM-based synthetic query generation. This year, 9 groups (including the track coordinators) submitted 32 runs.
翻译:“话在嘴边”(Tip-of-the-Tongue, ToT)已知项检索,旨在帮助搜索者重新找到那些他们无法可靠回忆其标识符的项目。ToT 信息请求(或称查询)通常冗长,且往往包含多种复杂现象,这使得现有信息检索系统处理起来尤为困难。TREC 2025 ToT 赛道聚焦于一项特定的即席检索任务。今年,我们将该赛道扩展至通用领域,并整合了来自不同来源的多组测试查询,具体包括来自 MS-ToT 数据集、人工主题开发以及基于大语言模型(LLM)的合成查询生成。今年,共有 9 个团队(包括赛道组织者)提交了 32 次运行结果。