Replication Data for: Comment on: "Does Stereotype Threat Affect Test Performance of Minorities and Women? A Meta-Analysis of Experimental Evidence"

Stereotype threat is a widely-cited psychological phenomenon with purported important real-world consequences. Reanalysis of data from the Nguyen and Ryan (2008) stereotype threat meta-analysis indicated the presence of small study effects in which the effect size for less precise studies was larger than the effect size for more precise studies. Four methods to adjust the meta-analysis effect size for potential publication bias produced divergent estimates, from essentially no change, to a 50 percent decrease, to a reduction of the estimated effect size to near zero. Caution is therefore warranted both for citing Nguyen and Ryan (2008) as evidence of a meaningful stereotype threat effect and for claiming that the stereotype threat effect size is negligible based on these adjustments, given that the detected small study effects might be due to unexplored moderators instead of publication bias.

刻板印象威胁（Stereotype threat）是一种被广泛引用的心理学现象，据称其具有重要的现实世界影响。对Nguyen与Ryan（2008）的刻板印象威胁元分析（meta-analysis）数据进行的再分析显示，存在小样本研究效应（small study effects）：即精度较低的研究的效应量（effect size）大于精度较高的研究的效应量。针对潜在发表偏倚（publication bias）调整元分析效应量的四种方法得出了迥异的估计结果：从几乎无变化，到效应量降低50%，再到将估计效应量缩减至接近零。因此，无论是援引Nguyen与Ryan（2008）的研究作为刻板印象威胁效应具有实际意义的证据，还是基于上述调整方法宣称刻板印象威胁效应量可忽略不计，都需要保持谨慎——因为本次检测到的小样本研究效应，可能源自未被探索的调节变量（moderators）而非发表偏倚。