The authors of this study aim to assess the capabilities of the OpenAI ChatGPT tool to understand just how effective such a system might be for students to utilize in their studies as well as deepen understanding of faculty/staff and student perceptions about ChatGPT in general. The purpose of what is learned from the study is to continue the design of a model to facilitate the development of faculty for becoming adept at embracing change, the DANCE model (Designing Adaptations for the Next Changes in Education). This model is used in this study to help faculty with examining the impact that a disruptive new tool, such as ChatGPT, can pose for the learning environment. The authors analyzed the performance of ChatGPT used to complete course assignments at a variety of levels by novice engineering students working as research assistants. Those completed works have been assessed by the faculty who created those assignments to understand how these completed assignments might compare with the performance of a typical student. A set of surveys conducted by the authors of this work are discussed where students, faculty, and staff respondents in March of 2023 addressed their perceptions of ChatGPT (A follow-up survey is being administered now, February 2024). These survey instruments were analyzed, and the data visualized in this work to bring attention to relevant findings by the researchers. This work reports the findings of the researchers with the purpose of sharing the current state of this work at Texas A&M University with the intention to provide insights to scholars both at our own institution and around the world. This work is not intended to be a finished work but reports these findings with full transparency that this work is currently continuing as the researchers gather new data and develop and validate various measurement instruments.
翻译:本研究作者旨在评估OpenAI ChatGPT工具的能力,以理解此类系统对学生学习的实际效用,并深化对教职工及学生关于ChatGPT整体认知的理解。本研究所得成果旨在继续完善一个促进教师适应变革能力的模型设计,即DANCE模型(为教育中后续变化设计适应性调整)。该模型在本研究中用于帮助教师审视如ChatGPT这类颠覆性新工具对学习环境可能带来的影响。作者分析了由初级工程专业学生作为研究助手使用ChatGPT完成各级别课程作业的表现。这些完成的作业已由布置作业的教师进行评估,以了解其与典型学生表现的差异。本文讨论了一系列由作者于2023年3月开展的调查(一项后续调查正在2024年2月进行),其中学生、教职工及行政人员受访者阐述了对ChatGPT的认知。本研究对这些调查工具进行了分析,并将数据可视化,以引起研究者对相关发现的关注。本文报告了研究者的发现,旨在分享德克萨斯农工大学此项工作的当前进展,为我校及全球学者提供见解。本文并非最终研究成果,而是以完全透明的方式报告当前发现,同时研究者仍在持续收集新数据并开发与验证各类测量工具。