We asked ChatGPT to participate in an undergraduate computer science exam on ''Algorithms and Data Structures''. We evaluated the program on the entire exam as posed to the students. We hand-copied its answers onto an exam sheet, which was subsequently graded in a blind setup alongside those of 200 participating students. We find that ChatGPT narrowly passed the exam, obtaining 20.5 out of 40 points. This impressive performance indicates that ChatGPT can indeed succeed in challenging tasks like university exams. At the same time, the tasks in our exam are structurally similar to those on other exams, solved homework problems, and teaching materials that can be found online. Therefore, it would be premature to conclude from this experiment that ChatGPT has any understanding of computer science. The transcript of our conversation with ChatGPT is available at \url{https://github.com/tml-tuebingen/chatgpt-algorithm-exam}, and the entire graded exam is in the appendix of this paper.

翻译：我们要求 ChatGPT 参加一场面向本科生的“算法与数据结构”计算机科学考试。我们评估了该程序对整个考试题目的作答情况。我们将其答案手抄至答题纸上，随后在盲评环境下，将其与另外 200 名学生的答卷一起进行评分。研究发现，ChatGPT 以微弱优势通过了考试，获得 40 分中的 20.5 分。这一令人印象深刻的表现表明，ChatGPT 确实能够胜任诸如大学考试等具有挑战性的任务。同时，我们这次考试中的任务在结构上与网上能找到的其他考试题目、已解决的作业题以及教学材料类似。因此，若据此实验得出 ChatGPT 对计算机科学有任何理解的结论，为时尚早。我们与 ChatGPT 的对话记录可在\url{https://github.com/tml-tuebingen/chatgpt-algorithm-exam}获取，完整的评分试卷见本文附录。