Since LaLonde's (1986) seminal paper, there has been ongoing interest in estimating treatment effects using pre- and post-intervention data. Scholars have traditionally used experimental benchmarks to evaluate the accuracy of alternative econometric methods, including Matching, Difference-in-Differences (DID), and their hybrid forms (e.g., Heckman et al., 1998b; Dehejia and Wahba, 2002; Smith and Todd, 2005). We revisit these methodologies in the evaluation of job training and educational programs using four datasets (LaLonde, 1986; Heckman et al., 1998a; Smith and Todd, 2005; Chetty et al., 2014a; Athey et al., 2020), and show that the inequality relationship, Matching $\leq$ Hybrid $\leq$ DID, appears as a consistent norm, rather than a mere coincidence. We provide a formal theoretical justification for this puzzling phenomenon under plausible conditions such as negative selection, by generalizing the classical bracketing (Angrist and Pischke, 2009, Section 5). Consequently, when treatments are expected to be non-negative, DID tends to provide optimistic estimates, while Matching offers more conservative ones. Keywords: bias, difference in differences, educational program, job training program, matching.
翻译:自LaLonde (1986) 的开创性论文发表以来,利用干预前后的数据估计处理效应一直是持续的研究热点。学者们传统上采用实验基准来评估各种替代计量经济学方法的准确性,包括匹配法、双重差分法及其混合形式(例如Heckman等人,1998b;Dehejia和Wahba,2002;Smith和Todd,2005)。我们使用四个数据集(LaLonde, 1986;Heckman等人,1998a;Smith和Todd,2005;Chetty等人,2014a;Athey等人,2020)重新审视了这些在职业培训与教育项目评估中的应用方法,并证明不等式关系——匹配法 $\leq$ 混合法 $\leq$ 双重差分法——呈现为一种一致的规律,而非偶然现象。我们在诸如负向选择等合理条件下,通过推广经典的边界界定理论(Angrist和Pischke,2009,第5节),为这一令人困惑的现象提供了正式的理论依据。因此,当预期处理效应为非负时,双重差分法倾向于给出乐观的估计,而匹配法则提供更为保守的估计。关键词:偏差,双重差分法,教育项目,职业培训项目,匹配法。