This paper presents the ADAIO team's system entry in the Building Educational Applications (BEA) 2023 Shared Task on Generating AI Teacher Responses in Educational Dialogues. The task aims to assess the performance of state-of-the-art generative models as AI teachers in producing suitable responses within a student-teacher dialogue. Our system comprises evaluating various baseline models using OpenAI GPT-3 and designing diverse prompts to prompt the OpenAI models for teacher response generation. After the challenge, our system achieved second place by employing a few-shot prompt-based approach with the OpenAI text-davinci-003 model. The results highlight the few-shot learning capabilities of large-language models, particularly OpenAI's GPT-3, in the role of AI teachers.
翻译:本文介绍了ADAIO团队在2023年教育应用构建(BEA)共享任务“教育对话中生成AI教师回复”中的系统方案。该任务旨在评估最先进的生成模型作为AI教师在学生-教师对话中生成恰当回复的性能。我们的系统包括使用OpenAI GPT-3评估多种基线模型,并设计多样化的提示词以驱动OpenAI模型生成教师回复。在挑战结束后,我们的系统通过采用基于少样本提示的方法(使用OpenAI text-davinci-003模型)获得了第二名。实验结果突显了大语言模型(特别是OpenAI的GPT-3)在扮演AI教师角色时展现的少样本学习能力。