Null Hypothesis Significance Testing (NHST) have been a popular statistical tool across various scientific disciplines since the 1920s. However, the exclusive reliance on a p-value threshold of 0.05 has recently come under criticism; in particular, it is argued to have contributed significantly to the reproducibility crisis. We revisit some of the main issues associated with NHST and propose an alternative approach that is easy to implement and can address these concerns. Our proposed approach builds on equivalence tests and three-way decision procedures, which offer several advantages over the traditional NHST. We demonstrate the efficacy of our approach on real-world examples and show that it has many desirable properties.
翻译:自20世纪20年代以来,零假设显著性检验(NHST)一直是各科学领域中广泛使用的统计工具。然而,近期对仅依赖p值阈值0.05的做法提出了批评;特别地,有观点认为这在很大程度上导致了可重复性危机。我们重新审视了与NHST相关的一些主要问题,并提出了一种易于实施且能解决这些问题的替代方法。我们的方法基于等价检验和三重决策流程,相较于传统NHST具有多项优势。我们通过实际案例展示了该方法的有效性,并证明其具备许多令人满意的特性。