The integration of Large Language Models (LLMs) into social science research presents transformative opportunities for advancing scientific inquiry, particularly in public administration (PA). However, the absence of standardized methodologies for using LLMs poses significant challenges for ensuring transparency, reproducibility, and replicability. This manuscript introduces the TaMPER framework-a structured methodology organized around five critical decision points: Task, Model, Prompt, Evaluation, and Reporting. The TaMPER framework provides scholars with a systematic approach to leveraging LLMs effectively while addressing key challenges such as model variability, prompt design, evaluation protocols, and transparent reporting practices.
翻译:将大型语言模型(LLMs)整合到社会科学研究中,为推进科学探究(特别是在公共行政领域)带来了变革性机遇。然而,由于缺乏使用LLMs的标准化方法,确保研究的透明度、可重复性和可复制性面临重大挑战。本文提出TaMPER框架——一种围绕五个关键决策点(任务、模型、提示、评估与报告)构建的结构化方法论。该框架为学者们提供了系统化运用LLMs的有效途径,同时解决了模型变异性、提示设计、评估方案及透明化报告实践等核心挑战。