The principal goal of the RAG TREC Instrument for Multilingual Evaluation (RAGTIME) track at TREC is to study report generation from multilingual source documents. The track has created a document collection containing Arabic, Chinese, English, and Russian news stories. RAGTIME includes three task types: Multilingual Report Generation, English Report Generation, and Multilingual Information Retrieval (MLIR). A total of 125 runs were submitted by 13 participating teams (and as baselines by the track coordinators) for three tasks. This overview describes these three tasks and presents the available results.
翻译:TREC多语言评估检索增强生成工具(RAGTIME)赛道的主要目标是研究基于多语言源文档的报表生成。该赛道构建了一个包含阿拉伯语、中文、英语和俄语新闻报道的文档集。RAGTIME包含三类任务:多语言报表生成、英语报表生成以及多语言信息检索(MLIR)。共有来自13个参赛团队(以及赛道协调员提供的基线系统)提交的125次运行结果用于这三项任务。本综述描述了这三项任务,并展示了现有实验结果。