In this work, we want to give an overview on which pragmatic abilities have been tested in LLMs so far and how these tests have been carried out. To do this, we first discuss the scope of the field of pragmatics and suggest a subdivision into discourse pragmatics and interactional pragmatics. We give a non-exhaustive overview of the phenomena of those two subdomains and the methods traditionally used to analyze them. We subsequently consider the resulting heterogeneous set of phenomena and methods as a starting point for our survey of work on discourse pragmatics and interactional pragmatics in the context of LLMs.
翻译:本文旨在综述当前针对大型语言模型(LLM)已测试的语用能力及其评估方法。为此,我们首先探讨语用学的研究范畴,提出将其划分为话语语用学与交互语用学两个子领域。我们系统梳理了这两个子领域的研究现象及传统分析方法,并以此非穷尽性综述为基础,对LLM在话语语用学和交互语用学方面的相关研究展开系统性考察。