Information Retrieval (IR) systems are crucial tools for users to access information, widely applied in scenarios like search engines, question answering, and recommendation systems. Traditional IR methods, based on similarity matching to return ranked lists of documents, have been reliable means of information acquisition, dominating the IR field for years. With the advancement of pre-trained language models, generative information retrieval (GenIR) has emerged as a novel paradigm, gaining increasing attention in recent years. Currently, research in GenIR can be categorized into two aspects: generative document retrieval (GR) and reliable response generation. GR leverages the generative model's parameters for memorizing documents, enabling retrieval by directly generating relevant document identifiers without explicit indexing. Reliable response generation, on the other hand, employs language models to directly generate the information users seek, breaking the limitations of traditional IR in terms of document granularity and relevance matching, offering more flexibility, efficiency, and creativity, thus better meeting practical needs. This paper aims to systematically review the latest research progress in GenIR. We will summarize the advancements in GR regarding model training, document identifier, incremental learning, downstream tasks adaptation, multi-modal GR and generative recommendation, as well as progress in reliable response generation in aspects of internal knowledge memorization, external knowledge augmentation, generating response with citations and personal information assistant. We also review the evaluation, challenges and future prospects in GenIR systems. This review aims to offer a comprehensive reference for researchers in the GenIR field, encouraging further development in this area.
翻译:信息检索(IR)系统是用户获取信息的关键工具,广泛应用于搜索引擎、问答系统和推荐系统等场景。传统IR方法基于相似度匹配返回文档排序列表,长期以来作为主流信息获取手段主导该领域。随着预训练语言模型的发展,生成式信息检索(GenIR)作为新兴范式近年来备受关注。当前GenIR研究可分为两方面:生成式文档检索(GR)与可信响应生成。GR利用生成模型参数记忆文档,通过直接生成相关文档标识符实现检索,无需显式索引构建;而可信响应生成则通过语言模型直接生成用户所需信息,突破了传统IR在文档粒度和相关性匹配上的局限,具有更高的灵活性、效率和创造性,更贴合实际需求。本文旨在系统梳理GenIR的最新研究进展。我们将总结GR在模型训练、文档标识符、增量学习、下游任务适配、多模态GR及生成式推荐方面的进展,以及在可信响应生成方面的内部知识记忆、外部知识增强、带引用响应生成和个人信息助手的最新成果。同时回顾GenIR系统的评估方法、面临的挑战及未来展望。本综述旨在为GenIR领域研究者提供全面参考,推动该方向进一步发展。