Unsupervised dense retrievers offer scalability by learning semantic similarity from unlabeled documents via contrastive learning, but they struggle to capture the temporal relevance, retrieving semantically related but temporally misaligned documents-an important aspect when a document collection spans multiple time periods (e.g., retrieving documents from 2018-2025 for "Who is the president in 2019?" introduces temporal ambiguity). Existing methods rely on supervised training with explicit timestamps, which are not always feasible. We propose TPOUR (Temporal Preference Optimization for Unsupervised Retriever), which uses our novel training method Temporal Retrieval Preference Optimization (TRPO). TRPO reinterprets preference learning in the temporal dimension, guiding the retriever to favor temporally aligned documents. TPOUR further generalizes to unseen time periods via interpolation in a learned time embedding, enabling continuous temporal alignment. Experiments on temporal information retrieval (T-IR), TPOUR outperforms both unsupervised and supervised baselines. Compared to Qwen-Embedding-8B, despite being about 72.7x smaller, TPOUR Contriever improves average nDCG@5 by +4.04 (+12.15%) on explicit and +4.98 (+15.21%) on implicit queries. We provide our code at https://github.com/agwaBom/TPOUR.
翻译:无监督稠密检索器通过对比学习从无标签文档中学习语义相似性,从而具备可扩展性,但难以捕捉时间相关性,会检索出语义相关但时间错位的文档——当文档集合跨越多个时间段时(例如,为“2019年的总统是谁?”这一问题从2018-2025年的文档中检索会引入时间歧义),这一问题尤为关键。现有方法依赖带有显式时间戳的有监督训练,但此类标注并非总是可行。我们提出TPOUR(面向无监督检索器的时间偏好优化),该方法采用我们创新的训练方式——时间检索偏好优化(TRPO)。TRPO在时间维度上重新诠释了偏好学习,引导检索器偏好时间对齐的文档。TPOUR进一步通过学习得到的时间嵌入向量的插值操作,将其泛化至未见过的时段,从而实现持续的时间对齐。在时间信息检索(T-IR)实验表明,TPOUR在无监督和有监督基线方法上均取得了更优性能。相较于Qwen-Embedding-8B,尽管参数量小约72.7倍,TPOUR-Contriever在显式查询上的平均nDCG@5提升了+4.04(+12.15%),在隐式查询上提升了+4.98(+15.21%)。我们已在https://github.com/agwaBom/TPOUR 公开代码。