The dynamic nature of interactions between students and GenAI, as well as their relationship to writing quality, remains underexplored. While most research has examined how general-purpose GenAI can support writing, fewer studies have investigated how students interact with pedagogically designed systems across different phases of the writing process. To address this gap, we evaluated a GenAI-driven essay-writing assistant (EWA) designed to support higher education students in argumentative writing. Drawing on 1,282 interaction logs from 32 undergraduates during a two-hour writing session, Sequential Pattern Mining and K-Means clustering were used to identify behavioral patterns. Two clusters emerged: Cluster 1 emphasized outline planning and essay structure, while Cluster 2 focused on content development. A Mann-Whitney U test revealed a moderate effect size (r = 0.36) in the essay Organization dimension, with Cluster 1 showing higher scores. Qualitative analysis indicated that students with better performance actively wrote and shared essay sections with EWA for feedback, rather than interacted passively by asking questions. These findings suggest implications for teaching and system design. Teachers can encourage active engagement, while future EWAs may integrate automatic labeling and monitoring to prompt students to move from questioning to writing, enabling fuller benefits from GenAI-supported learning.


翻译:学生与生成式人工智能(GenAI)之间动态交互的本质及其与写作质量的关系,目前仍未得到充分研究。尽管多数研究探讨了通用型GenAI如何辅助写作,但较少有研究关注学生在写作过程的不同阶段如何与教学型系统进行交互。为填补这一空白,我们评估了一款专为支持高等教育学生进行议论文写作而设计的GenAI驱动型论文写作助手(EWA)。基于32名本科生在两小时写作环节中产生的1,282条交互日志,我们采用序列模式挖掘和K均值聚类方法识别行为模式。分析得到两个聚类:聚类1侧重于提纲规划与文章结构,聚类2则聚焦于内容拓展。曼-惠特尼U检验显示,在文章组织维度上存在中等效应量(r=0.36),聚类1的学生在该维度得分更高。定性分析表明,表现较好的学生倾向于主动撰写论文段落并与EWA分享以获取反馈,而非仅通过提问进行被动交互。这些发现对教学与系统设计具有启示意义:教师可鼓励学生主动参与写作过程,而未来的EWA系统可整合自动标注与监测功能,引导学生从提问转向写作,从而更充分地发挥GenAI辅助学习的效益。

0
下载
关闭预览

相关内容

IFIP TC13 Conference on Human-Computer Interaction是人机交互领域的研究者和实践者展示其工作的重要平台。多年来,这些会议吸引了来自几个国家和文化的研究人员。官网链接:http://interact2019.org/
VIP会员
最新内容
《系统簇式多域作战规划范畴论框架》
专知会员服务
4+阅读 · 4月20日
高效视频扩散模型:进展与挑战
专知会员服务
2+阅读 · 4月20日
乌克兰前线的五项创新
专知会员服务
7+阅读 · 4月20日
 军事通信系统与设备的技术演进综述
专知会员服务
5+阅读 · 4月20日
《北约标准:医疗评估手册》174页
专知会员服务
5+阅读 · 4月20日
《提升生成模型的安全性与保障》博士论文
专知会员服务
5+阅读 · 4月20日
美国当前高超音速导弹发展概述
专知会员服务
4+阅读 · 4月19日
无人机蜂群建模与仿真方法
专知会员服务
14+阅读 · 4月19日
Top
微信扫码咨询专知VIP会员