ChatGPT is an AI language model developed by OpenAI that can understand and generate human-like text. It can be used for a variety of use cases such as language generation, question answering, text summarization, chatbot development, language translation, sentiment analysis, content creation, personalization, text completion, and storytelling. While ChatGPT has garnered significant positive attention, it has also generated a sense of apprehension and uncertainty in academic circles. There is concern that students may leverage ChatGPT to complete take-home assignments and exams and obtain favorable grades without genuinely acquiring knowledge. This paper adopts a quantitative approach to demonstrate ChatGPT's high degree of unreliability in answering a diverse range of questions pertaining to topics in undergraduate computer science. Our analysis shows that students may risk self-sabotage by blindly depending on ChatGPT to complete assignments and exams. We build upon this analysis to provide constructive recommendations to both students and instructors.
翻译:ChatGPT是OpenAI开发的一种人工智能语言模型,能够理解并生成类人文本。它可应用于多种场景,例如语言生成、问答系统、文本摘要、聊天机器人开发、语言翻译、情感分析、内容创作、个性化推荐、文本补全及故事编写等。尽管ChatGPT获得了广泛正面关注,但在学术界也引发了忧虑与不确定性。有观点担忧学生可能利用ChatGPT完成课后作业与考试,在未真正掌握知识的情况下获取高分。本文采用定量研究方法,揭示了ChatGPT在回答本科计算机科学领域多样化问题时存在高度不可靠性。我们的分析表明,学生若盲目依赖ChatGPT完成作业与考试,或将面临自我损害的风险。基于此分析,我们向学生与教师双方提出建设性建议。