Much debate has been around the misapplication of metrics in research assessment. As a result of this concern, the Declaration on Research Assessment (DORA) was launched, an initiative that caused opposing viewpoints. However, the discussion topics about DORA have not been formally identified, especially in participatory environments outside the scholarly communication process, such as social networks. This paper contributes to that end by analyzing 20,717 DORA-related tweets published from 2015 to 2022. The results show an increasing volume of tweets, mainly promotional and informative, but with limited participation of users, either commenting or engaging with the tweets, generating a scarcely polarized conversation driven primarily by a few DORA promoters. While a varied list of discussion topics is found (especially "Open science and research assessment," "Academics career assessment & innovation," and "Journal Impact Factor"), the DORA debate appears as part of broader conversations (research evaluation, open science). Further studies are needed to check whether these results are restricted to Twitter or reveal more general patterns. The findings might interest the different evaluators and evaluated agents regarding their interests and concerns around the reforms in the research evaluation.
翻译:围绕研究评估中指标的误用存在诸多争议。基于这一关切,《研究评估宣言》(DORA)应运而生,这一倡议引发了各方对立观点。然而,关于DORA的讨论主题尚未得到正式界定,尤其是在学术交流过程之外的参与式环境(如社交网络)中。本文通过分析2015年至2022年间发布的20,717条与DORA相关的推文,为此目标做出贡献。结果显示,推文数量持续增长,内容以宣传推广和信息传播为主,但用户参与度有限——无论是评论还是互动行为均较少,由此形成了一个主要由少数DORA倡导者驱动、极化程度较低的对话场域。虽然发现了多种讨论主题(尤其集中于“开放科学与研究评估”“学术职业评估与创新”及“期刊影响因子”),但DORA辩论往往嵌入更广泛的议题(如研究评价、开放科学)中。需要进一步研究验证这些发现是否仅局限于Twitter,或能否揭示更普遍的规律。本研究结果或能为不同评估者及被评估对象提供参考,使其了解各方围绕研究评价改革的利益诉求与关切焦点。