The proliferation of applications using artificial intelligence (AI) systems has led to a growing number of users interacting with these systems through sophisticated interfaces. Human-computer interaction research has long shown that interfaces shape both user behavior and user perception of technical capabilities and risks. Yet, practitioners and researchers evaluating the social and ethical risks of AI systems tend to overlook the impact of anthropomorphic, deceptive, and immersive interfaces on human-AI interactions. Here, we argue that design features of interfaces with adaptive AI systems can have cascading impacts, driven by feedback loops, which extend beyond those previously considered. We first conduct a scoping review of AI interface designs and their negative impact to extract salient themes of potentially harmful design patterns in AI interfaces. Then, we propose Design-Enhanced Control of AI systems (DECAI), a conceptual model to structure and facilitate impact assessments of AI interface designs. DECAI draws on principles from control systems theory -- a theory for the analysis and design of dynamic physical systems -- to dissect the role of the interface in human-AI systems. Through two case studies on recommendation systems and conversational language model systems, we show how DECAI can be used to evaluate AI interface designs.
翻译:随着人工智能(AI)系统的广泛应用,通过复杂界面与这些系统交互的用户数量日益增长。人机交互研究早已证明,界面既塑造用户行为,也影响用户对技术能力与风险的认知。然而,评估AI系统社会伦理风险的实践者与研究者往往忽视拟人化、欺骗性和沉浸式界面对人机交互的影响。本文论证:自适应AI系统的界面设计特征可通过反馈循环产生级联效应,其影响范围超越既有研究范畴。我们首先对AI界面设计及其负面效应进行范围综述,提炼出AI界面中潜在有害设计模式的核心主题;继而提出AI系统设计增强控制(DECAI)概念模型,用于结构化促进AI界面设计的影响评估。DECAI借鉴控制系统理论(分析设计动态物理系统的理论体系)原理,解析界面在人机AI系统中的作用机制。通过推荐系统与对话语言模型系统两个案例研究,我们展示了DECAI在评估AI界面设计中的实际应用。