Generative AI tools have become more prevalent in engineering workflows, particularly through chatbots and code assistants. As the perceived accuracy of these tools improves, questions arise about whether and how those who work in high-precision domains might maintain vigilance for errors, and what other aspects of using such tools might trouble their work. This paper analyzes interviews with hardware and software engineers, and their collaborators, who work in integrated circuit design to identify the role accuracy plays in their use of generative AI tools and what other forms of trouble they face in using such tools. The paper inventories these forms of trouble, which are then mapped to elements of generative AI systems, to conclude that controlling the context of interactions between engineers and the generative AI tools is one of the largest challenges they face. The paper concludes with recommendations for mitigating this form of trouble by increasing the ability to control context interactively.
翻译:生成式AI工具在工程工作流程中日益普及,特别是通过聊天机器人和代码助手的形式。随着这些工具感知准确度的提升,在高精度领域工作的人员是否以及如何保持对错误的警惕性,以及使用此类工具可能对其工作产生的其他困扰,成为值得探讨的问题。本文通过对集成电路设计领域的硬件与软件工程师及其合作者进行访谈分析,旨在探究准确度在其使用生成式AI工具过程中扮演的角色,以及他们在使用此类工具时面临的其他困扰形式。本文系统梳理了这些困扰形式,并将其映射到生成式AI系统的各个要素,最终指出:控制工程师与生成式AI工具之间交互的上下文,是他们面临的最大挑战之一。文章最后提出通过增强交互式上下文控制能力来缓解此类困扰的建议。