This paper aims to develop a semi-formal design space for Human-AI interactions, by building a set of interaction primitives which specify the communication between users and AI systems during their interaction. We show how these primitives can be combined into a set of interaction patterns which can provide an abstract specification for exchanging messages between humans and AI/ML models to carry out purposeful interactions. The motivation behind this is twofold: firstly, to provide a compact generalisation of existing practices, that highlights the similarities and differences between systems in terms of their interaction behaviours; and secondly, to support the creation of new systems, in particular by opening the space of possibilities for interactions with models. We present a short literature review on frameworks, guidelines and taxonomies related to the design and implementation of HAI interactions, including human-in-the-loop, explainable AI, as well as hybrid intelligence and collaborative learning approaches. From the literature review, we define a vocabulary for describing information exchanges in terms of providing and requesting particular model-specific data types. Based on this vocabulary, a message passing model for interactions between humans and models is presented, which we demonstrate can account for existing systems and approaches. Finally, we build this into design patterns as mid-level constructs that capture common interactional structures. We discuss how this approach can be used towards a design space for Human-AI interactions that creates new possibilities for designs as well as keeping track of implementation issues and concerns.
翻译:本文旨在通过构建一组交互原语来规范用户与AI系统在交互过程中的通信,从而发展出一个人机交互的半形式化设计空间。我们展示了如何将这些原语组合成一组交互模式,这些模式可为人类与AI/ML模型之间的消息交换提供抽象规范,以实现有目的的交互。此举的动机有二:其一,为现有实践提供紧凑的概括,突出系统在交互行为方面的异同;其二,支持新系统的创建,特别是通过开辟与模型交互的可能性空间。我们简要回顾了与HAI交互设计与实现相关的框架、指南和分类法文献,包括人在回路、可解释AI,以及混合智能和协作学习方法。基于文献综述,我们定义了一个用于描述信息交换的词汇表,涵盖特定模型数据类型的提供与请求。基于该词汇表,我们提出了一种人类与模型之间交互的消息传递模型,并证明该模型能够解释现有系统和方法。最后,我们将其构建为设计模式——作为捕获常见交互结构的中间层次构造。我们讨论了如何将这种方法用于人机交互的设计空间,既创造新的设计可能性,又持续跟踪实现问题与关切。