Recent years have seen growing adoption of AI-based decision-support systems (ADS) in homeless services, yet we know little about stakeholder desires and concerns surrounding their use. In this work, we aim to understand impacted stakeholders' perspectives on a deployed ADS that prioritizes scarce housing resources. We employed AI lifecycle comicboarding, an adapted version of the comicboarding method, to elicit stakeholder feedback and design ideas across various components of an AI system's design. We elicited feedback from county workers who operate the ADS daily, service providers whose work is directly impacted by the ADS, and unhoused individuals in the region. Our participants shared concerns and design suggestions around the AI system's overall objective, specific model design choices, dataset selection, and use in deployment. Our findings demonstrate that stakeholders, even without AI knowledge, can provide specific and critical feedback on an AI system's design and deployment, if empowered to do so.
翻译:近年来,基于人工智能的决策支持系统在流浪救助服务中的采用日益增长,然而我们对于相关利益方在使用这些系统时的期望与担忧仍知之甚少。本研究旨在了解受影响利益相关者对已部署的、用于优先分配稀缺住房资源的决策支持系统的看法。我们采用了人工智能生命周期漫画板方法(一种经改编的漫画板方法),以收集利益相关者对于人工智能系统设计各环节的反馈与设计构思。我们向每日操作该系统的县级工作人员、工作直接受该系统影响的服务提供者以及该区域的无家可归者征集了反馈。参与者围绕人工智能系统的总体目标、具体模型设计选择、数据集选取以及部署阶段的使用,分享了担忧与设计建议。我们的研究结果表明,利益相关者即便不具备人工智能知识,若被赋予适当引导,也能对人工智能系统的设计与部署提出具体且关键的反馈。