Brazilian Reproducibility Initiative Survey of Beliefs Data

Data from the BRI Survey of Beliefs. Data is currently under embargo, and will become public at the end of 2022. For more information about the project, check the OSF page at https://osf.io/6av7k/. A brief description of the methods is provided below:   Participants were recruited via open invites in social media and institutional emails. Recruitment criteria were age above 18 years old and having previous or current research experience. Only participants that completed the survey were included (69 total, where 20 are members from the BRI), and these were subsequently invited to prediction markets.   Participants could choose between the 3 techniques that were selected for replications within the BRI: (1) MTT, an assay for mitochondrial activity/cell viability; (2) reverse transcriptase PCR (RT-PCR), an assay to measure relative RNA levels); and (3) Elevated Plus Maze (EPM), a behavioral task to assess anxiety in rodents. Each of these techniques contained 20 studies to be replicated. Participants made predictions for all 20 studies, except for members of the BRI, which did not forecast experiments their lab was involved in replicating.   At the beginning of the survey, participants filled in personal information about their research experience and education. They also self-rated their theoretical knowledge of the technique, their practical experience and their knowledge on statistics and research methodology in a scale of 1-5.   For each study, they were shown summary information containing a brief description of the experiment, the original figure or table, and information on effect size, sample size and statistics. Different survey versions were created where 10 of the studies had the link to the original paper and author/journal information, while the other 10 had none of this information. This means participants were blinded to additional information from the paper for half of their predictions, having access only to the abstract, figure and the summary.   For each study, participants were asked the following questions: *For the purpose of the answers below, please consider the effect size and significance estimates of a fixed-effects meta-analysis of the 3 replications   (1) \"In your opinion, what is the probability that the replication will obtain an effect significantly different from 0 (p <0.05) in the same direction as the original? (0-100%)\"   (2) \"How large would you expect the effect size to be in the replication, relative to the original effect size? (in % of the original unstandardized effect size; 0 indicates no effect, while negative numbers indicate effects in the opposite direction)\"   (3) \"How logistically and technically challenging to replicate this experiment seems to be (relative to other laboratory experiments using EPM/MTT/RT-PCR)?\"   (4) \"If you were given the link to the original paper, did you open the paper and used this information for your predictions?\"   Participants also had optional open fields to explicitly describe the factors they considered in their answers to questions 1 to 3 above for every experiment.

本数据集来源于BRI信念调查（BRI Survey of Beliefs）。目前数据处于暂缓公开状态，将于2022年底正式开放获取。如需了解该项目的更多信息，请访问开放科学框架（Open Science Framework, OSF）页面：https://osf.io/6av7k/。下文将对研究方法进行简要介绍：
研究对象通过社交媒体公开招募及机构邮件邀约的方式进行招募。招募标准为年龄满18周岁，且具备既往或当前研究经历。仅纳入完成全部问卷的参与者（共计69人，其中20名为BRI成员），后续将邀请其参与预测市场活动。
参与者可从BRI选定用于重复研究的3种技术中进行选择：(1) MTT，一种用于检测线粒体活性与细胞活力的实验方法；(2) 逆转录聚合酶链式反应（reverse transcriptase PCR, RT-PCR），用于检测相对RNA水平；(3) 高架十字迷宫（Elevated Plus Maze, EPM），一种用于评估啮齿类动物焦虑行为的行为学实验范式。每种技术对应20项待重复的研究。参与者需对全部20项研究做出预测，但若为BRI成员，则无需预测其所在实验室参与重复的实验。
问卷开始阶段，参与者需填写个人研究经历与教育背景相关信息。同时，他们需基于1至5分的评分量表，自评对对应技术的理论认知水平、实践经验，以及统计学与研究方法学知识掌握程度。
针对每项研究，参与者将查看包含实验简要描述、原始图表、效应量、样本量及统计量信息的汇总资料。本次研究共设置两种问卷版本：其中10项研究附带原始论文链接及作者/期刊信息，其余10项则未提供此类附加信息。这意味着半数预测任务中，参与者无法获取论文的额外信息，仅能查看摘要、图表及汇总数据。
针对每项研究，参与者需回答以下问题：
*注：以下问题的作答需基于3项重复研究的固定效应元分析（fixed-effects meta-analysis）所得的效应量与显著性估计结果。
(1) "在您看来，本项重复研究获得与原始研究方向一致且显著异于0的效应（p<0.05）的概率为多少？（0-100%）"
(2) "相较于原始研究的效应量，您预计本项重复研究的效应量为多大？（以原始未标准化效应量的百分比表示；0表示无效应，负数表示效应方向与原始研究相反）"
(3) "相较于其他使用EPM/MTT/RT-PCR的实验室实验，您认为本项实验的重复在后勤与技术层面具备多大难度？"
(4) "若您已获取原始论文链接，是否打开过该论文并将其信息用于作答预测？"
此外，参与者还可通过可选的开放文本框，详细说明其在回答上述1至3题时所考量的各项因素。