Null Hypothesis Significance Testing (NHST) have been a popular statistical tool across various scientific disciplines since the 1920s. However, the exclusive reliance on a p-value threshold of 0.05 has recently come under criticism; in particular, it is argued to have contributed significantly to the reproducibility crisis. We revisit some of the main issues associated with NHST and propose an alternative approach that is easy to implement and can address these concerns. Our proposed approach builds on equivalence tests and three-way decision procedures, which offer several advantages over the traditional NHST. We demonstrate the efficacy of our approach on real-world examples and show that it has many desirable properties.
翻译:零假设显著性检验(Null Hypothesis Significance Testing, NHST)自20世纪20年代以来一直是各科学学科中广泛使用的统计工具。然而,近年来,仅依赖p值阈值0.05的做法受到强烈批评;尤其被认为显著加剧了可重复性危机。我们重新审视了与NHST相关的一些主要问题,并提出了一种易于实施且能解决这些问题的替代方案。我们的方法建立在等价检验和三向决策程序之上,相比传统NHST具有多项优势。通过实际案例验证了该方法的有效性,并证明其具有许多理想特性。