Recent years have seen growing interest among both researchers and practitioners in user-engaged approaches to algorithm auditing, which directly engage users in detecting problematic behaviors in algorithmic systems. However, we know little about industry practitioners' current practices and challenges around user-engaged auditing, nor what opportunities exist for them to better leverage such approaches in practice. To investigate, we conducted a series of interviews and iterative co-design activities with practitioners who employ user-engaged auditing approaches in their work. Our findings reveal several challenges practitioners face in appropriately recruiting and incentivizing user auditors, scaffolding user audits, and deriving actionable insights from user-engaged audit reports. Furthermore, practitioners shared organizational obstacles to user-engaged auditing, surfacing a complex relationship between practitioners and user auditors. Based on these findings, we discuss opportunities for future HCI research to help realize the potential (and the mitigate risks) of user-engaged auditing in industry practice.

翻译：近年来，研究人员和从业者对用户参与式算法审计方法的兴趣日益增长，该方法通过直接让用户参与检测算法系统中的问题行为。然而，我们对行业从业者当前在用户参与式审计方面的实践和挑战知之甚少，也不了解它们在实践中更好利用此类方法的潜在机遇。为此，我们针对在工作中采用用户参与式审计方法的从业者展开了一系列访谈和迭代共创活动。研究结果揭示了从业者在适当招募和激励用户审计者、构建用户审计框架以及从用户参与式审计报告中提炼可操作见解等方面面临的多重挑战。此外，从业者还分享了组织层面阻碍用户参与式审计的障碍，揭示了从业者与用户审计者之间复杂的互动关系。基于这些发现，我们探讨了未来人机交互研究如何助力实现用户参与式审计在工业实践中的潜力（并降低其风险）。