Directional replicability addresses the question of whether an effect studied across $n$ independent studies is present with the same direction in at least $r$ of them, for $r \geq 2$. When the expected direction of the effect is not specified in advance, the state of the art recommends assessing replicability separately by combining one-sided $p$-values for both directions (left and right), and then doubling the smaller of the two resulting combined $p$-values to account for multiple testing. In this work, we show that this multiplicative correction is not always necessary, and give conditions under which it can be safely omitted.
翻译:方向性可重复性探讨的问题是:在$n$项独立研究中,所考察的效应是否在至少$r$项研究($r \geq 2$)中呈现相同方向。当效应的预期方向未预先指定时,现有方法建议通过分别合并两个方向(左与右)的单侧$p$值来评估可重复性,然后将两个合并$p$值中较小者乘以二以校正多重检验。本研究表明,这种乘法校正并非总是必要,并给出了可安全省略该校正的条件。