While revolutionary AI-powered code generation tools have been rising rapidly, we know little about how and how to help software developers form appropriate trust in those AI tools. Through a two-phase formative study, we investigate how online communities shape developers' trust in AI tools and how we can leverage community features to facilitate appropriate user trust. Through interviewing 17 developers, we find that developers collectively make sense of AI tools using the experiences shared by community members and leverage community signals to evaluate AI suggestions. We then surface design opportunities and conduct 11 design probe sessions to explore the design space of using community features to support user trust in AI code generation systems. We synthesize our findings and extend an existing model of user trust in AI technologies with sociotechnical factors. We map out the design considerations for integrating user community into the AI code generation experience.
翻译:尽管革命性的AI代码生成工具正在快速崛起,但对于开发者如何形成对这些AI工具的适当信任以及如何帮助他们培养这种信任,我们知之甚少。通过一项两阶段形成性研究,我们探讨了在线社区如何塑造开发者对AI工具的信任,以及如何利用社区功能促进用户建立适当的信任。通过对17名开发者的访谈,我们发现开发者会借助社区成员分享的经验共同理解AI工具,并利用社区信号评估AI建议。在此基础上,我们发掘设计机遇,开展了11次设计探索会话,以探索利用社区功能支持用户对AI代码生成系统信任的设计空间。我们综合研究发现,将社会技术因素融入现有AI用户信任模型进行扩展,并梳理了将用户社区整合到AI代码生成体验中的设计考量。