Wizard of Oz (WoZ) as a prototyping method has been used to simulate intelligent user interfaces, particularly for speech-based systems. However, as our societies' expectations on artificial intelligence (AI) grows, the question remains whether a single Wizard is sufficient for it to simulate smarter systems and more complex interactions. Optimistic visions of 'what artificial intelligence (AI) can do' places demands on WoZ platforms to simulate smarter systems and more complex interactions. This raises the question of whether the typical approach of employing a single Wizard is sufficient. Moreover, while existing work has employed multiple Wizards in WoZ studies, a multi-Wizard approach has not been systematically studied in terms of feasibility, effectiveness, and challenges. We offer Wizundry, a real-time, web-based WoZ platform that allows multiple Wizards to collaboratively operate a speech-to-text based system remotely. We outline the design and technical specifications of our open-source platform, which we iterated over two design phases. We report on two studies in which participant-Wizards were tasked with negotiating how to cooperatively simulate an interface that can handle natural speech for dictation and text editing as well as other intelligent text processing tasks. We offer qualitative findings on the Multi-Wizard experience for Dyads and Triads of Wizards. Our findings reveal the promises and challenges of the multi-Wizard approach and open up new research questions.
翻译:绿野仙踪(WoZ)作为一种原型设计方法,已被广泛用于模拟智能用户界面,尤其是语音交互系统。然而,随着社会对人工智能(AI)期望的不断提升,一个问题日益凸显:单一巫师是否足以模拟更智能的系统与更复杂的交互?对“人工智能(AI)所能实现”的乐观预期,对WoZ平台提出了模拟更智能系统与更复杂交互的需求,由此引发对传统单巫师方法是否仍适用这一问题的探讨。此外,尽管已有研究在WoZ实验中采用多巫师方案,但多巫师方法在可行性、有效性与挑战性方面尚未得到系统性研究。我们提出Wizundry——一个基于Web的实时WoZ平台,支持多名巫师远程协作操控基于语音转文本的系统。我们介绍了这一开源平台历经两轮设计迭代后的架构与技术规范,并报告了两项研究:参与者巫师需协商如何协同模拟一个能处理自然语音(用于听写、文本编辑及其他智能文本处理任务)的界面。我们针对双人组与三人组巫师的多巫师协作体验提供定性分析结果,揭示了多巫师方法的潜力与挑战,并为后续研究开辟了新的问题方向。