Advances in natural language processing and understanding have led to a rapid growth in the popularity of conversational user interfaces (CUIs). While CUIs introduce novel benefits, they also yield risks that may exploit people's trust. Although research looking at unethical design deployed through graphical user interfaces (GUIs) established a thorough understanding of so-called dark patterns, there is a need to continue this discourse within the CUI community to understand potentially problematic interactions. Addressing this gap, we interviewed 27 participants from three cohorts: researchers, practitioners, and frequent users of CUIs. Applying thematic analysis, we construct five themes reflecting each cohort's insights about ethical design challenges and introduce the CUI Expectation Cycle, bridging system capabilities and user expectations while considering each theme's ethical caveats. This research aims to inform future development of CUIs to consider ethical constraints while adopting a human-centred approach.
翻译:自然语言处理与理解技术的进步,使得会话用户界面(CUI)的普及率迅速增长。尽管CUI带来了诸多新优势,但也可能利用人们的信任引发风险。尽管针对图形用户界面(GUI)中不道德设计的研究已深入理解所谓"暗黑模式",但CUI领域仍需延续这一讨论以识别潜在问题交互。为填补这一空白,我们对来自三个群体(研究人员、从业者及CUI频繁用户)的27名参与者进行了访谈。通过主题分析法,我们构建了反映各群体对伦理设计挑战认知的五个主题,并引入CUI预期循环模型——在关联系统能力与用户期望的同时,考量每个主题的伦理隐患。本研究旨在推动未来CUI开发在采用以人为本方法时,充分纳入伦理约束考量。