Recent years have witnessed increasing calls for computing researchers to grapple with the societal impacts of their work. Tools such as impact assessments have gained prominence as a method to uncover potential impacts, and a number of publication venues now encourage authors to include an impact statement in their submissions. Despite this recent push, little is known about the way researchers go about grappling with the potential negative societal impact of their work -- especially in industry settings, where research outcomes are often quickly integrated into products. In addition, while there are nascent efforts to support researchers in this task, there remains a dearth of empirically-informed tools and processes. Through interviews with 25 industry computing researchers across different companies and research areas, we first identify four key factors that influence how they grapple with (or choose not to grapple with) the societal impact of their research. To develop an effective impact assessment template tailored to industry computing researchers' needs, we conduct an iterative co-design process with these 25 industry researchers, along with an additional 16 researchers and practitioners with prior experience and expertise in reviewing and developing impact assessments or broad responsible computing practices. Through the co-design process, we develop 10 design considerations to facilitate the effective design, development, and adaptation of an impact assessment template for use in industry research settings and beyond, as well as our own "Societal Impact Assessment" template with concrete scaffolds. We explore the effectiveness of this template through a user study with 15 industry research interns, revealing both its strengths and limitations. Finally, we discuss the implications for future researchers and organizations seeking to foster more responsible research practices.
翻译:近年来,越来越多的呼声要求计算研究人员认真对待其工作的社会影响。影响评估等工具作为揭示潜在影响的方法日益受到重视,许多出版机构现在鼓励作者在投稿中包含影响声明。尽管近期有这些推动措施,但研究人员如何处理其工作潜在的负面社会影响——尤其是在产业环境中,研究成果往往迅速整合到产品中——仍然鲜为人知。此外,尽管已有初步努力支持研究人员完成这项任务,但依然缺乏基于实证的工具和流程。通过对来自不同公司和研究领域的25名产业界计算研究人员的访谈,我们首先识别出影响他们处理(或选择不处理)其研究社会影响的四个关键因素。为开发一个符合产业界计算研究人员需求的有效影响评估模板,我们与这25名产业界研究人员,以及另外16名在审查和制定影响评估或广泛负责任计算实践方面具有经验和专业知识的研究人员和从业者,共同开展了一个迭代协同设计过程。通过协同设计过程,我们提出了10项设计考量,以促进在产业研究环境及其他场景中有效设计、开发和调整影响评估模板,并开发了我们自己的、包含具体支撑框架的"社会影响评估"模板。我们通过对15名产业界研究实习生的用户研究来探索该模板的有效性,揭示了其优势和局限性。最后,我们讨论了这对未来寻求培养更负责任研究实践的研究人员和组织的启示。