To improve the development of responsible AI systems, developers are increasingly utilizing tools such as checklists or guideline cards to ensure fairness, transparency, and sustainability. However, these tools face two main challenges. First, they are static and are not meant to keep pace with the latest responsible AI literature and international standards. Second, they tend to prioritize individual usage over fostering collaboration among AI practitioners. To overcome these limitations, we propose a method that enables easy updates of responsible AI guidelines by incorporating research papers and ISO standards, ensuring that the content remains relevant and up to date, while emphasizing actionable guidelines that can be implemented by a wide range of AI practitioners. We validated our method in a case study at a large tech company by designing and deploying a tool that recommends interactive and actionable guidelines, which were generated by a team of engineers, standardization experts, and a lawyer using our method. Through the study involving AI developers and engineers, we assessed the usability and effectiveness of the tool, showing that the guidelines were considered practical and actionable. The guidelines encouraged self-reflection and facilitated a better understanding of the ethical considerations of AI during the early stages of development, significantly contributing to the idea of "Responsible AI by Design" -- a design-first approach that considers responsible AI values throughout the development lifecycle and across business roles.
翻译:为改进负责任人工智能系统的开发,开发者日益使用清单或指南卡等工具来确保公平性、透明度和可持续性。然而,这些工具面临两大挑战:首先,它们是静态的,无法及时跟进最新的负责任人工智能文献与国际标准;其次,它们往往优先考虑个人使用,而非促进人工智能从业者之间的协作。为克服这些局限,我们提出一种方法,通过整合研究论文与ISO标准,实现负责任人工智能指南的便捷更新,确保内容保持相关性与时效性,同时强调可由广泛人工智能从业者实施的可操作指南。我们在一家大型科技公司的案例研究中验证了该方法,设计并部署了一款推荐交互式可操作指南的工具——这些指南由工程师、标准化专家和律师组成的团队采用我们的方法生成。通过涉及人工智能开发者与工程师的研究,我们评估了该工具的可用性与有效性,结果表明指南被认为切实可行且具有可操作性。该指南鼓励自我反思,促进开发早期阶段对人工智能伦理考量的更深入理解,显著贡献于"内建负责任人工智能"理念——一种将负责任人工智能价值观贯穿开发全生命周期及跨业务角色的设计优先方法。