Local governments increasingly use artificial intelligence (AI) for automated decision-making. Contestability, making systems responsive to dispute, is a way to ensure they respect human rights to autonomy and dignity. We investigate the design of public urban AI systems for contestability through the example of camera cars: human-driven vehicles equipped with image sensors. Applying a provisional framework for contestable AI, we use speculative design to create a concept video of a contestable camera car. Using this concept video, we then conduct semi-structured interviews with 17 civil servants who work with AI employed by a large northwestern European city. The resulting data is analyzed using reflexive thematic analysis to identify the main challenges facing the implementation of contestability in public AI. We describe how civic participation faces issues of representation, public AI systems should integrate with existing democratic practices, and cities must expand capacities for responsible AI development and operation.
翻译:地方政府日益使用人工智能(AI)进行自动化决策。可争议性——使系统能够响应争议——是确保其尊重人类自主权和尊严的一种方式。我们通过摄像头车(配备图像传感器的有人驾驶车辆)这一示例,研究面向可争议性的公共城市AI系统设计。应用可争议AI的临时框架,我们采用推测性设计创作了一部关于可争议摄像头车的概念视频。基于此概念视频,我们对某西北欧大城市中从事AI相关工作的17名公务员进行了半结构化访谈。通过反思性主题分析对所得数据进行分析,以识别在公共AI中实现可争议性所面临的主要挑战。我们描述了公民参与面临的代表性问题、公共AI系统需与现有民主实践相结合,以及城市必须扩大负责任AI开发与运营的能力。