Despite the widespread use of artificial intelligence (AI), designing user experiences (UX) for AI-powered systems remains challenging. UX designers face hurdles understanding AI technologies, such as pre-trained language models, as design materials. This limits their ability to ideate and make decisions about whether, where, and how to use AI. To address this problem, we bridge the literature on AI design and AI transparency to explore whether and how frameworks for transparent model reporting can support design ideation with pre-trained models. By interviewing 23 UX practitioners, we find that practitioners frequently work with pre-trained models, but lack support for UX-led ideation. Through a scenario-based design task, we identify common goals that designers seek model understanding for and pinpoint their model transparency information needs. Our study highlights the pivotal role that UX designers can play in Responsible AI and calls for supporting their understanding of AI limitations through model transparency and interrogation.
翻译:尽管人工智能(AI)已广泛应用,但为AI驱动系统设计用户体验(UX)仍具挑战性。用户体验设计师在理解诸如预训练语言模型等AI技术作为设计材料时面临障碍,这限制了他们对是否、何处以及如何使用AI进行构思和决策的能力。为解决此问题,我们连接了AI设计与AI透明度领域的文献,探究透明模型报告框架能否以及如何支持预训练模型的设计构思。通过访谈23位UX从业者,我们发现从业者频繁使用预训练模型,但缺乏面向UX引导构思的支持。通过基于场景的设计任务,我们识别出设计师寻求模型理解的共同目标,并明确了他们对模型透明度信息的需求。本研究凸显了UX设计师在负责任AI中的关键作用,呼吁通过模型透明度与质询机制支持他们对AI局限性的理解。