Data_Sheet_2_The Methodological Quality Scale (MQS) for intervention programs: validity evidence.DOCX

IntroductionA wide variety of instruments are used when assessing the methodological quality (MQ) of intervention programs. Nevertheless, studies on their metric quality are often not available. In order to address this shortcoming, the methodological quality scale (MQS) is presented as a simple and useful tool with adequate reliability, validity evidence, and metric properties.
MethodsTwo coders independently applied the MQS to a set of primary studies. The number of MQ facets was determined in parallel analyses before performing factor analyses. For each facet of validity obtained, mean and standard deviation are presented jointly with reliability and average discrimination. Additionally, the validity facet scores are interpreted based on Shadish, Cook, and Campbell’s validity model.
Results and discussionAn empirical validation of the three facets of the MQ (external, internal, and construct validity) and the interpretation of the scores were obtained based on a theoretical framework. Unlike other existing scales, MQS is easy to apply and presents adequate metric properties. In addition, MQ profiles can be obtained in different areas of intervention using different methodologies and proves useful for both researchers doing meta-analysis and for evaluators and professionals designing a new intervention.

【引言】在评估干预方案的方法学质量（methodological quality, MQ）时，需使用多种评估工具。然而，针对这些工具的测量学质量的相关研究往往较为匮乏。为弥补这一研究短板，本研究提出方法学质量量表（methodological quality scale, MQS）——一款兼具良好信度、效度证据与测量学属性的简易实用工具。【研究方法】两名编码员独立将MQS应用于一组原始研究。在开展因素分析前，通过平行分析确定方法学质量维度的数量。针对所得的每个效度维度，同步报告其均值、标准差，以及信度与平均区分度。此外，效度维度得分的阐释基于沙迪什（Shadish）、库克（Cook）与坎贝尔（Campbell）的效度模型。【结果与讨论】本研究基于理论框架，完成了方法学质量三大维度（外部效度、内部效度与结构效度）的实证验证，并实现了对得分的系统阐释。与现有其他同类量表相比，MQS操作简便且具备优良的测量学属性。此外，通过采用不同研究方法，可在不同干预领域生成方法学质量概况，其既适用于开展元分析（meta-analysis）的研究人员，也可为评估人员与设计新型干预方案的专业人员提供助力。