Large Language Models (LLMs) have the potential to fundamentally change the way people engage in computer programming. Agent-based modeling (ABM) has become ubiquitous in natural and social sciences and education, yet no prior studies have explored the potential of LLMs to assist it. We designed NetLogo Chat to support the learning and practice of NetLogo, a programming language for ABM. To understand how users perceive, use, and need LLM-based interfaces, we interviewed 30 participants from global academia, industry, and graduate schools. Experts reported more perceived benefits than novices and were more inclined to adopt LLMs in their workflow. We found significant differences between experts and novices in their perceptions, behaviors, and needs for human-AI collaboration. We surfaced a knowledge gap between experts and novices as a possible reason for the benefit gap. We identified guidance, personalization, and integration as major needs for LLM-based interfaces to support the programming of ABM.
翻译:大型语言模型(LLM)有潜力从根本上改变人们参与计算机编程的方式。智能体建模(ABM)在自然科学、社会科学及教育领域已变得无处不在,但尚无先前研究探索LLM辅助其应用的潜力。我们设计了NetLogo Chat来支持ABM编程语言NetLogo的学习与实践。为了解用户如何感知、使用及需要基于LLM的界面,我们访谈了来自全球学术界、工业界及研究生院的30名参与者。专家报告称其感知到比新手更多的益处,并且更倾向于将LLM融入工作流程。我们发现专家与新手在人机协作的感知、行为及需求方面存在显著差异。我们揭示了专家与新手之间的知识差距可能是造成收益差距的原因之一。我们识别出指导、个性化及集成作为基于LLM界面支持ABM编程的主要需求。