We propose a framework for evaluating structured generative search summaries that are placed atop organic web search results. A structured summary, generated by a large language model, typically consists of an overview, several sections with section titles, and a list of source documents that are cited within the summary. We then describe our plans for implementing and evaluating the framework.

翻译：我们提出一个用于评估结构化生成式搜索摘要的框架，这类摘要通常置于自然网页搜索结果之上。这种由大语言模型生成的结构化摘要一般包含概述、多个带标题的章节以及一份在摘要中被引用的源文档列表。随后，我们描述了实施与评估该框架的具体计划。