We present Semantic Interpreter, a natural language-friendly AI system for productivity software such as Microsoft Office that leverages large language models (LLMs) to execute user intent across application features. While LLMs are excellent at understanding user intent expressed as natural language, they are not sufficient for fulfilling application-specific user intent that requires more than text-to-text transformations. We therefore introduce the Office Domain Specific Language (ODSL), a concise, high-level language specialized for performing actions in and interacting with entities in Office applications. Semantic Interpreter leverages an Analysis-Retrieval prompt construction method with LLMs for program synthesis, translating natural language user utterances to ODSL programs that can be transpiled to application APIs and then executed. We focus our discussion primarily on a research exploration for Microsoft PowerPoint.
翻译:我们提出语义解释器(Semantic Interpreter),一种面向Microsoft Office等生产力软件的自然语言友好型AI系统,该系统利用大型语言模型(LLMs)在应用功能间执行用户意图。虽然LLMs在理解自然语言表达的用户意图方面表现出色,但对于需要超越文本间转换的特定应用用户意图,它们仍存在不足。为此,我们引入Office领域特定语言(ODSL),这是一种专门用于在Office应用中执行操作及与实体交互的简洁高级语言。语义解释器采用基于分析-检索的提示构建方法,结合LLMs实现程序合成,将自然语言用户表述转化为可编译为应用程序接口并执行的ODSL程序。我们主要围绕Microsoft PowerPoint的研究探索展开讨论。