LLMs have fundamentally transformed dense retrieval, upgrading backbones from discriminative encoders to generative architectures. However, a critical disconnect remains: while LLMs possess strong reasoning capabilities, current retrievers predominantly utilize them as static encoders, leaving their potential for complex reasoning unexplored. To address this, existing approaches typically adopt rewrite-then-retrieve pipelines to generate explicit CoT rationales before retrieval. However, this incurs prohibitive latency. In this paper, we propose LaSER, a novel self-distillation framework that internalizes explicit reasoning into the latent space of dense retrievers. Operating on a shared LLM backbone, LaSER introduces a dual-view training mechanism: an Explicit view that explicitly encodes ground-truth reasoning paths, and a Latent view that performs implicit latent thinking. To bridge the gap between these views, we design a multi-grained alignment strategy. Beyond standard output alignment, we introduce a trajectory alignment mechanism that synchronizes the intermediate latent states of the latent path with the semantic progression of the explicit reasoning segments. This allows the retriever to think silently and effectively without autoregressive text generation. Extensive experiments on both in-domain and out-of-domain reasoning-intensive benchmarks demonstrate that LaSER significantly outperforms state-of-the-art baselines. Furthermore, analyses across diverse backbones and model scales validate the robustness of our approach, confirming that our unified learning framework is essential for eliciting effective latent thinking. Our method successfully combines the reasoning depth of explicit CoT pipelines with the inference efficiency of standard dense retrievers.
翻译:大型语言模型(LLM)从根本上改变了稠密检索领域,将骨干网络从判别式编码器升级为生成式架构。然而,一个关键脱节仍然存在:尽管LLM具备强大的推理能力,当前检索模型主要将其用作静态编码器,未能挖掘其复杂推理的潜力。为解决这一问题,现有方法通常采用“重写-再检索”流程,在检索前生成显式思维链(CoT)推理依据。但这会导致极高的延迟。本文提出LaSER,一种新颖的自蒸馏框架,将显式推理内化至稠密检索器的隐式空间中。基于共享的LLM骨干网络,LaSER引入双视角训练机制:显式视角对真实推理路径进行显式编码,隐式视角则执行隐式潜在思考。为弥合这两个视角间的差距,我们设计了多粒度对齐策略。除标准输出对齐外,我们引入了轨迹对齐机制,将隐式路径的中间潜在状态与显式推理片段的语义演进过程同步。这使得检索器能够无需自回归文本生成即可进行静默高效的思考。在领域内和领域外推理密集型基准测试上的大量实验表明,LaSER显著优于现有最先进的基线方法。此外,跨不同骨干网络和模型规模的综合分析验证了我们方法的鲁棒性,证实了这种统一学习框架对于激发有效潜在思考至关重要。我们的方法成功地将显式CoT流程的推理深度与标准稠密检索器的推理效率相结合。