We introduce Loki, an open-source tool designed to address the growing problem of misinformation. Loki adopts a human-centered approach, striking a balance between the quality of fact-checking and the cost of human involvement. It decomposes the fact-checking task into a five-step pipeline: breaking down long texts into individual claims, assessing their check-worthiness, generating queries, retrieving evidence, and verifying the claims. Instead of fully automating the claim verification process, Loki provides essential information at each step to assist human judgment, especially for general users such as journalists and content moderators. Moreover, it has been optimized for latency, robustness, and cost efficiency at a commercially usable level. Loki is released under an MIT license and is available on GitHub. We also provide a video presenting the system and its capabilities.
翻译:本文介绍Loki,一个旨在应对日益严重的虚假信息问题的开源工具。Loki采用以人为中心的设计理念,在事实核查质量与人工参与成本之间取得平衡。该工具将事实核查任务分解为五步流程:将长文本拆分为独立主张、评估其核查价值、生成查询语句、检索证据以及验证主张。Loki并非完全自动化主张验证过程,而是在每个步骤提供关键信息以辅助人工判断,尤其适用于记者和内容审核员等普通用户。此外,该系统在延迟性、鲁棒性和成本效益方面均已优化至商业可用水平。Loki基于MIT许可证发布,可在GitHub平台获取。我们还提供了展示系统功能与特性的演示视频。