The effect of adaptivity on the reliability coefficient in adaptive comparative judgement (Bramley & Vitello, 2019)

Data from a Comparative Judgement assessment exercise of 150 GCSE English scripts.There are data from three studies (labelling as in Bramley & Vitello (2019)): 1a. data produced where comparisons are scheduled adaptively; 1b. data produced from comparing (nearly) all of a subset of 20 items in a round-robin format; 2. data produced where comparisons are scheduled randomly as well as repeated comparisons of some particular pairs.The data for each study consists of four columns: Judge - an identifying number for the judge (note that the judges in 1a and 1b are the same, but different to those in 2); Item 1 - identifier for first script in the comparison; Item 2 - identifier for second script in the comparison; Win - the result Win=1 / Loss =0 from perspective of Item 1. Note that each pairwise comparison is shown as two rows. This is an artefact of the system used to originally collect the data. The second row for each comparison is redundant.Full details of the data and its collection can be found in "The effect of adaptivity on the reliability coefficient in adaptive comparative judgement" (Bramley & Vitello, 2019) https://doi.org/10.1080/0969594X.2017.1418734本数据集源自150份普通中等教育证书（GCSE）英语试卷的比较评判（Comparative Judgement）评估练习数据。本数据集包含三个子数据集（标注规则遵循Bramley与Vitello 2019年的研究）：1a. 采用自适应调度比较方案生成的数据；1b. 以循环格式对20个项目的子集开展（近乎）全量两两比较所生成的数据；2. 采用随机调度比较方案生成的数据，同时包含部分特定配对的重复比较数据。各子数据集的数据均包含四列：评卷人（Judge）——评卷人的唯一标识编号（需注意：1a与1b的评卷人为同一批，但与2的评卷人不同）；项目1（Item 1）——本次比较中第一份试卷的标识符；项目2（Item 2）——本次比较中第二份试卷的标识符；胜负标签（Win）——以项目1为视角的评判结果，Win=1代表项目1胜出，Win=0代表项目1落败。需注意：每一组两两比较均会以两行数据的形式呈现，这源于原始数据采集系统的设计特性，每组比较的第二行数据为冗余信息。该数据集的完整细节与采集流程可参考论文《适应性对自适应比较评判中信度系数的影响》（The effect of adaptivity on the reliability coefficient in adaptive comparative judgement, Bramley & Vitello, 2019），链接为：https://doi.org/10.1080/0969594X.2017.1418734