2024-05-01 Peer Community in Registered Report (PCIRR) is the future of science and should be integrated into mentoring and education: Sharing 3 years of running ~20 UG/MSc theses with PCIRR | RHUL

Registered Reports (http://cos.io/rr) are a publication process now adopted by over 300 journals in psychological science and beyond, in which Stage 1 journal peer review occurs on a pre-registration plan prior to any data collection. Once the pre­registration passes peer review and is approved, the journal grants authors an in-principle acceptance guaranteeing the publication of the article provided that data collection and analysis follows and intended plan. This emphasizes design, methods, and rigor, addressing issues of reviewers' and publication bias with publication of findings regardless of data collection outcomes, with the Stage 2 peer review focused solely on ensuring adherence to the Stage 1 plan (or documenting deviations). 

‎"Peer Community in Registered Report"‎ (PCI-RR; https://rr.peercommunityin.org/) is a new initiative launched in 2021 that builds on Registered Reports and is aimed at improving further on Registered Reports. It provides community open identified peer-review on posted Registered Report Stage 1 preprints, led by open-science trained recommenders (editors), with in-principle acceptance from the community endorsed for publication by a variety of open-science supportive journals. This initiative also includes an option for a "scheduled review" path which allows timely community expert open-science supportive peer review within two weeks, short enough to fit into an academic year thesis schedule. PCIRR is nothing short of a revolution in science.

In the last three years I guided ~20 UG/MSc students in conducting their theses as Replications and extensions Registered Reports with ‎"Peer Community in Registered Report"‎ manuscripts, with some already officially published, and most already granted an in-principle acceptance. Together, we have shown that it is possible to bring UG/MSc quantitative confirmatory work to the meet the highest levels of open-science in our field with a real contribution to the academic community. There have been some challenges, but overall I summarize it as a remarkable success, for all stakeholders. For me personally, it has been a very positive and rewarding experience. AFAIK, this model and the students’ achievements are unprecedented, and I truly hope would inspire many more researchers and departments to adopt a similar scheme.

In this talk I will share a bit of our experience with Registered Reports, PCIRR, and embedding PCIRR in UG/MSc thesis process.
I will also briefly mention the larger-scale replications and extensions project of over 120 classic studies in judgment and decision-making and social psychology. Information on this project and how to join us can be found on: https://mgto.org/core-team/

注册报告（http://cos.io/rr）是一种现已为心理科学及众多其他领域超过300家期刊所采纳的出版流程，其中第一阶段期刊同行评审在数据收集之前，基于预先注册的计划进行。一旦预先注册通过同行评审并获得批准，期刊将向作者颁发一项原则性接受保证，即只要数据收集和分析遵循既定计划，文章将被保证发表。这一流程强调了设计、方法和严谨性，通过无论数据收集结果如何均发布发现的方式，解决了审稿人和出版偏见问题，而第二阶段同行评审则专注于确保遵守第一阶段计划（或记录偏差）。

“注册报告同行评审社区”（PCI-RR；https://rr.peercommunityin.org/）是一项于2021年启动的新倡议，旨在在注册报告的基础上进一步改进。它为已发布的注册报告第一阶段预印本提供社区公开识别的同行评审，由接受过开放科学培训的推荐者（编辑）领导，社区原则性接受并由众多支持开放科学的期刊予以出版认可。该倡议还包括一项“安排评审”路径选项，允许在两周内进行及时、社区专家级的开放科学支持性同行评审，时间短到足以适应学术年度论文日程。PCIRR堪称科学界的革命。

在过去的三年中，我指导了约20名本科/硕士学生，以“注册报告同行评审社区”的稿件形式进行论文的复制和扩展研究，其中一些已经正式发表，大多数已经获得原则性接受。总的来说，我们共同展示了将本科/硕士定量验证性工作提升至我们领域开放科学最高水平，并为学术社区做出实际贡献的可能性。虽然遇到了一些挑战，但总体而言，这是一次了不起的成功，对所有利益相关者而言。就我个人而言，这是一次非常积极且富有成效的经历。据我所知，这种模式和学生的成就前所未有，我真心希望它能激励更多的研究人员和部门采纳类似的方案。

在本次演讲中，我将分享我们在注册报告、PCIRR以及将其嵌入本科/硕士论文流程中的部分经验。

我还将简要提及一个更大规模的复现和扩展项目，该项目涉及120多项经典判断与决策以及社会心理学的研究。有关该项目以及如何加入我们的信息，可在以下网址找到：https://mgto.org/core-team/