The TREC Fair Ranking Track aims to provide a platform for participants to develop and evaluate novel retrieval algorithms that can provide a fair exposure to a mixture of demographics or attributes, such as ethnicity, that are represented by relevant documents in response to a search query. For example, particular demographics or attributes can be represented by the documents topical content or authors. The 2022 Fair Ranking Track adopted a resource allocation task. The task focused on supporting Wikipedia editors who are looking to improve the encyclopedia's coverage of topics under the purview of a WikiProject. WikiProject coordinators and/or Wikipedia editors search for Wikipedia documents that are in need of editing to improve the quality of the article. The 2022 Fair Ranking track aimed to ensure that documents that are about, or somehow represent, certain protected characteristics receive a fair exposure to the Wikipedia editors, so that the documents have an fair opportunity of being improved and, therefore, be well-represented in Wikipedia. The under-representation of particular protected characteristics in Wikipedia can result in systematic biases that can have a negative human, social, and economic impact, particularly for disadvantaged or protected societal groups.
翻译:TREC公平排序赛道旨在为参与者提供一个平台,用于开发和评估新型检索算法,这些算法能够针对搜索查询所返回的相关文档所代表的不同人口统计特征或属性(例如种族),实现公平曝光。例如,特定人口统计特征或属性可由文档的主题内容或作者所体现。2022年公平排序赛道采用了资源分配任务,重点支持维基百科编辑者改进该百科全书中属于某一维基项目管辖范围内的主题覆盖。维基项目协调员和/或维基百科编辑者搜索需要编辑以提升文章质量的维基百科文档。2022年公平排序赛道旨在确保与某些受保护特征相关或以某种方式代表这些特征的文档能够获得对维基百科编辑者的公平曝光,从而使这些文档有平等机会得到改进,进而在维基百科中得到充分呈现。维基百科中特定受保护特征的代表性不足可能导致系统性偏见,进而对弱势或受保护社会群体产生负面的个人、社会及经济影响。