Valid empirical studies build confidence in scientific findings. Fortunately, it is now common for software engineering researchers to consider threats to validity when designing their studies and to discuss them as part of their publication. Yet, in complex experiments with human participants, there is often an overwhelming number of intuitively plausible threats to validity -- more than a researcher can feasibly cover. Therefore, prioritizing potential threats to validity becomes crucial. We suggest moving away from relying solely on intuition for prioritizing validity threats, and propose that evidence on the actual impact of suspected threats to validity should complement intuition.

翻译：实证研究通过有效设计建立科学发现的信心。幸运的是，如今软件工程研究人员在开展研究时通常会考虑效度威胁，并在其出版物中进行讨论。然而，在涉及人类参与者的复杂实验中，往往存在大量直觉上合理的效度威胁——其数量远超研究人员实际可控的范围。因此，优先处理潜在的效度威胁变得至关重要。我们建议摆脱仅凭直觉来优先排序效度威胁的做法，并主张用关于可疑效度威胁实际影响的证据来补充直觉判断。