This paper presents and evaluates a new retrieval augmented generation (RAG) and large language model (LLM)-based artificial intelligence (AI) technique: rubric enabled generative artificial intelligence (REGAI). REGAI uses rubrics, which can be created manually or automatically by the system, to enhance the performance of LLMs for evaluation purposes. REGAI improves on the performance of both classical LLMs and RAG-based LLM techniques. This paper describes REGAI, presents data regarding its performance and discusses several possible application areas for the technology.
翻译:本文提出并评估了一种新型的检索增强生成(RAG)与大型语言模型(LLM)相结合的人工智能(AI)技术:基于评分量表的生成式人工智能(REGAI)。REGAI利用评分量表来提升LLM在评估任务中的性能,这些评分量表可由人工创建或由系统自动生成。REGAI在经典LLM以及基于RAG的LLM技术的性能基础上实现了改进。本文描述了REGAI,展示了其性能数据,并讨论了该技术若干潜在的应用领域。