Supplementary Materials for A standardized checklist for reporting meta-analysis in open science era

Meta-analysis is a crucial tool for accumulating evidence in basic and applied research. In the open science era, meta-analysis becomes an important way for integrating open data from different sources. Meanwhile, because of researchers’ high degree of freedom introduced by multiple-steps and multiple-choices in each step of meta-analysis, openness and transparency are crucial for reproducing the results of meta-analysis. To reflect the transparency and openness of meta-analysis reports published in Chinese journals and improve the transparency and openness of future meta-analysis by Chinese researchers, we developed a Chinese version of a checklist for meta-analysis (Preferred Reporting Items for Open and Reproducible Meta-analysis, PRIOR-MA), which was based on the Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) and the principle of openness and transparency. We then surveyed the methods and results of 68 meta-analysis papers published in mainstream Chinese psychological journals in the last five years. Our results revealed that the openness and transparency of Chinese meta-analysis reports need to be improved, especially in the following aspects: the date/time and limitation of literature search, the details of screening and data collection, the flow chart of article screening, the details of effect size transformation, and the evaluation of individual research bias. The checklist, which lists almost all aspects that an open meta-analysis should include, can be used as a guide for future meta-analyses. This paper provides a comprehensive checklist (PRIOR-MA) for open meta-analysis and provides a reference for future meta-analytic research.

元分析作为汇聚基础与应用研究领域证据的重要工具，在开放科学时代，已成为整合不同来源开放数据的重要途径。鉴于元分析过程中各步骤的多阶段和多选性为研究者带来的高度自由度，保证其结果的可重现性，开放性和透明度显得尤为关键。为彰显我国期刊发表元分析报告的透明度与开放性，并提升未来我国研究者所进行元分析研究的透明度和开放性，我们编制了一套中文版的元分析清单（即开放与可重现元分析优先报告项目，简称 PRIOR-MA），该清单基于系统评价与元分析优先报告项目（PRISMA）及开放透明原则编制而成。随后，我们对近五年内发表在主流中文心理期刊上的68篇元分析论文的方法与结果进行了调查。研究结果表明，我国元分析报告在开放性和透明度方面仍有待提升，特别是在文献检索的日期/时间及限制、筛选与数据收集的细节、文章筛选流程图、效应量转换的细节以及单个研究偏倚的评价等方面。本清单涵盖了开放元分析应包括的几乎所有方面，可作为未来元分析研究的指导。本文提供了一套全面的元分析开放清单（PRIOR-MA），并为未来的元分析研究提供了参考。