Much debate has been around the misapplication of metrics in research assessment. As a result of this concern, the Declaration on Research Assessment (DORA) was launched, an initiative that caused opposing viewpoints. However, the discussion topics about DORA have not been formally identified, especially in participatory environments outside the scholarly communication process, such as social networks. This paper contributes to that end by analyzing 20,717 DORA-related tweets published from 2015 to 2022. The results show an increasing volume of tweets, mainly promotional and informative, but with limited participation of users, either commenting or engaging with the tweets, generating a scarcely polarized conversation driven primarily by a few DORA promoters. While a varied list of discussion topics is found (especially "Open science and research assessment," "Academics career assessment & innovation," and "Journal Impact Factor"), the DORA debate appears as part of broader conversations (research evaluation, open science). Further studies are needed to check whether these results are restricted to Twitter or reveal more general patterns. The findings might interest the different evaluators and evaluated agents regarding their interests and concerns around the reforms in the research evaluation.
翻译:关于科研评价中指标的误用一直存在诸多争论。为此,《科研评价宣言》(DORA)应运而生,这一倡议引发了截然不同的观点。然而,关于DORA的讨论主题尚未被系统识别,尤其是在学术交流过程之外的参与式环境(如社交网络)中。本文通过分析2015年至2022年间发布的20,717条与DORA相关的推文,致力于填补这一空白。研究显示,推文数量呈上升趋势,内容以宣传性和信息性为主,但用户参与度有限(无论是评论还是互动),对话主要由少数DORA倡导者推动,极化程度较低。尽管发现了一系列讨论主题(尤其是“开放科学与科研评价”“学术生涯评价与创新”以及“期刊影响因子”),但DORA的讨论本质上是更广泛议题(如科研评估、开放科学)的一部分。未来需进一步研究以验证这些结果是否仅限于Twitter,还是反映了更普遍的模式。本研究结果对不同评价者与被评价者而言,可能有助于理解其围绕科研评价改革的兴趣与关切。