Inverted indexes are a crucial data structure for efficient information retrieval in large text corpora. They enable fast full-text search by mapping each term to the documents in which it appears, on top of which efficient algorithms quickly retrieve the documents relevant to a user query. We present RISE, a novel inverted index library implemented in Rust, designed to deliver high performance and efficiency for information retrieval tasks. RISE leverages Rust's safety and performance to provide a robust solution for building and querying inverted indexes, while offering accessible extensibility through its expressive trait system. While developing RISE, we revisited the inverted-index literature, thereby reproducing numerous prior works using this new test bench. We evaluated RISE against existing libraries, demonstrating competitive query performance across various datasets and workloads, with speedups of up to 2x over the current state of the art. Our results indicate that RISE is a promising tool for researchers and practitioners in the field of information retrieval.
翻译:倒排索引是大型文本语料库中实现高效信息检索的关键数据结构。通过将每个词条映射到其出现的文档,倒排索引支持快速全文搜索,并在此基础上利用高效算法快速检索与用户查询相关的文档。本文提出RISE,一个用Rust实现的创新型倒排索引库,致力于为信息检索任务提供高性能和高效率。RISE借助Rust的安全性和性能优势,为构建和查询倒排索引提供了稳健的解决方案,并通过其富有表现力的特征系统实现了易扩展性。在开发RISE的过程中,我们重新审视了倒排索引相关文献,从而利用这一新测试平台复现了大量先前工作。我们将RISE与现有库进行了对比评估,结果表明其在多种数据集和工作负载下均具有竞争性的查询性能,相较于当前最先进方案加速比可达2倍。我们的研究显示,RISE是信息检索领域研究人员与从业者极具前景的工具。