The engineering community has recently witnessed the emergence of chatbot technology with the release of OpenAI ChatGPT-4 and Google Bard. While these chatbots have been reported to perform well and even pass various standardized tests, including medical and law exams, this forum paper explores whether these chatbots can also pass the Fundamentals of Engineering (FE) and Principles and Practice of Engineering (PE) exams. A diverse range of civil and environmental engineering questions and scenarios are used to evaluate the chatbots' performance, as commonly present in the FE and PE exams. The chatbots' responses were analyzed based on their relevance, accuracy, and clarity and then compared against the recommendations of the National Council of Examiners for Engineering and Surveying (NCEES). Our report shows that ChatGPT-4 and Bard, respectively scored 70.9% and 39.2% in the FE exam and 46.2% and 41% in the PE exam. It is evident that the current version of ChatGPT-4 could potentially pass the FE exam. While future editions are much more likely to pass both exams, this study also highlights the potential of using chatbots as teaching assistants and guiding engineers.
翻译:工程界近期见证了聊天机器人技术的兴起,随着OpenAI ChatGPT-4与Google Bard的发布。尽管这些聊天机器人已被报道在多项标准化测试中表现出色,甚至通过了医学和法学考试,本论坛文章探讨了这些聊天机器人是否也能通过工程基础(FE)及工程原理与实践(PE)考试。采用FE与PE考试中常见的多样化土木与环境工程问题及场景,对聊天机器人的表现进行评估。基于回答的相关性、准确性与清晰度对聊天机器人响应进行分析,并将其与美国国家工程与测量考试委员会(NCEES)的建议进行对比。我们的报告显示,ChatGPT-4与Bard在FE考试中分别得分70.9%和39.2%,在PE考试中分别为46.2%和41%。显而易见,当前版本的ChatGPT-4具有通过FE考试的潜力。尽管未来版本更可能同时通过两项考试,本研究也凸显了将聊天机器人用作教学辅助工具及工程师指导的潜力。