Oversight After Setbacks: Replication and Supplementary Materials

This record contains the replication and supplementary materials for the study: “Oversight After Setbacks: Heterogeneous Review Responses in Repository-Agent Pull Request Relationships.” The package includes analysis-ready derived data, measurement and coding documentation, actor-classification reliability materials, independently completed second-coder records, downstream-event validation materials, model specifications, analytical scripts, derived tables, figures, and file-integrity checksums. The actor-classification audit covered 250 review actions and achieved 100% agreement between the operational classifications and the independent second coder (Cohen’s kappa = 1.00). The downstream-event audit covered 162 screened candidate references and achieved Cohen’s kappa values of .951 for binary validation and .930 for three-category classification. The materials are intended to support transparency, computational reproducibility, and verification of the reported analyses. Public GitHub usernames and reviewer identifiers are represented through stable hashes in the derived analytical outputs. No private-repository data or individual demographic information are included.