Many Labs 5: Testing pre-data collection peer review as an intervention to increase replicability

Many Labs 5 will test pre-data collection peer review as an intervention improve replicability. We will investigate 10 replications from the Reproducibility Project: Psychology that were labeled as “not endorsed.” For each study, we will conduct two replications multiple times each: 1) a direct replication using the non-endorsed protocol from RP:P and 2) a replication using an improved protocol that was vetted through peer review. We will compare the replicability rate of peer reviewed protocols to that of non-endorsed protocols. See the Wiki, below, for the project proposal.

Many Labs 5项目将检验在数据收集前进行同行评审作为一种干预措施以提升可重复性的效果。我们将对来自可重复性项目：心理学的10个被标记为“未获认可”的复制品进行研究。对于每一项研究，我们将进行多次的两次复制品：1) 使用RP:P中的未获认可方案进行的直接复制品，2) 使用经过同行评审审核的改进方案进行的复制品。我们将对比同行评审协议的可重复性比率与非认可协议的可重复性比率。有关项目提案，请参阅以下Wiki。