2024-04-05 Registered Reports and Peer Community in Registered Report are the future of science: Sharing our experience from over 25 Replication and extensions Registered Report submissions | Purdue University

Registered Reports (http://cos.io/rr) are a publication process now adopted by over 300 journals in psychological science and beyond, in which Stage 1 journal peer review occurs on a pre-registration plan prior to any data collection. Once the pre¬registration passes peer review and is approved, the journal grants authors an in-principle acceptance guaranteeing the publication of the article provided that data collection and analysis follows and intended plan. This emphasizes design, methods, and rigor, addressing issues of reviewers' and publication bias with publication of findings regardless of data collection outcomes, with the Stage 2 peer review focused solely on ensuring adherence to the Stage 1 plan (or documenting deviations).

‎"Peer Community in Registered Report"‎ (PCI-RR; https://rr.peercommunityin.org/) is a new initiative launched in 2021 that builds on Registered Reports and is aimed at improving further on Registered Reports. It provides community open identified peer-review on posted Registered Report Stage 1 preprints, led by open-science trained recommenders (editors), with in-principle acceptance from the community endorsed for publication by a variety of open-science supportive journals. This initiative also includes an option for a "scheduled review" path which allows timely community expert open-science supportive peer review within two weeks, short enough to fit into an academic year thesis schedule. PCIRR is nothing short of a revolution in science.

With guided thesis students and an early-career researcher team building on work by undergraduate students in my courses, in the last three years we submitted over 25 ‎"Peer Community in Registered Report"‎ manuscripts, with some already published, and most already granted an in-principle acceptance. Overall, it has been a very positive and rewarding experience for the students and the team.
In this talk I will share a bit of our experience with Registered Reports, PCIRR, and embedding PCIRR in UG/MSc thesis process and taught courses, with an invitation for you to join us lead some of our completed projects. This is part of a large-scale replications and extensions project of over 120 classic studies in judgment and decision-making and social psychology. Information on this project and how to join us can be found on: https://mgto.org/core-team/

注册报告（http://cos.io/rr）是一种现已为超过300家心理科学及相关期刊所采纳的出版流程，其特征在于在数据收集之前，对预注册计划进行阶段一期刊同行评审。一旦预注册计划通过同行评审并获得批准，期刊将对作者授予一项原则性接受保证，确保只要数据收集和分析遵循既定计划，文章即可发表。这种做法强调了设计、方法和严谨性，通过发布研究结果来解决审稿人和出版偏倚问题，而阶段二同行评审则专注于确保遵循阶段一计划（或记录偏差）。

“注册报告同行评审社区”（PCI-RR；https://rr.peercommunityin.org/）是一项于2021年启动的新倡议，旨在进一步改进注册报告。它为已发布的注册报告阶段一预印本提供社区公开识别的同行评审，由接受开放科学培训的推荐人（编辑）领导，并获得来自众多支持开放科学的期刊的社区原则性接受，以支持出版。该倡议还包括一种“预定评审”路径，允许在两周内进行及时的专业开放科学支持同行评审，时间足够短，可以适应学术年论文答辩日程。PCIRR无异于科学界的革命。

在指导研究生和早期职业研究团队在我课程中本科生工作的基础上，在过去三年里，我们已提交超过25篇“注册报告同行评审社区”稿件，其中一些已发表，大多数已获得原则性接受。总体而言，这对学生和团队来说是一次非常积极且富有成效的经历。

在本演讲中，我将分享我们关于注册报告、PCIRR以及将PCIRR嵌入本科/研究生论文过程和教学课程的一些经验，并邀请您加入我们，领导一些我们已完成的项目。这是对120多篇经典判断与决策和社会心理学研究的规模化复制和扩展项目的一部分。有关此项目以及如何加入我们的信息，请访问：https://mgto.org/core-team/