Peer reviewed publications are considered the gold standard in certifying and disseminating ideas that a research community considers valuable. However, we identify two major drawbacks of the current system: (1) the overwhelming demand for reviewers due to a large volume of submissions, and (2) the lack of incentives for reviewers to participate and expend the necessary effort to provide high-quality reviews. In this work, we adopt a mechanism-design approach to propose improvements to the peer review process, tying together the paper submission and review processes and simultaneously incentivizing high-quality submissions and reviews. In the submission stage, authors participate in a VCG auction for review slots by submitting their papers along with a bid that represents their expected value for having their paper reviewed. For the reviewing stage, we propose a novel peer prediction mechanism (H-DIPP) building on recent work in the information elicitation literature, which incentivizes participating reviewers to provide honest and effortful reviews. The revenue raised in the submission stage auction is used to pay reviewers based on the quality of their reviews in the reviewing stage.
翻译:同行评议出版物被认为是研究社区认定和传播有价值思想的黄金标准。然而,我们指出现有系统存在两大缺陷:(1) 大量论文投稿导致对评审人员的需求过载;(2) 缺乏激励措施促使评审人员参与并付出必要努力提供高质量评审。在本研究中,我们采用机制设计方法对同行评审流程提出改进方案,将论文投稿与评审流程相结合,同时激励高质量投稿和评审。在投稿阶段,作者参与VCG拍卖竞标评审名额,通过提交论文及反映其预期评审价值的投标报价。在评审阶段,我们基于信息激励领域的最新研究提出新型同行预测机制(H-DIPP),激励参与评审人员提供诚实且尽职的评审意见。投稿阶段拍卖产生的收入将根据评审阶段评审质量用于支付评审人员报酬。