Auditing the Auditor: A Set-Overlap Protocol for Validating Quality Proxies in AI-Generated Information Pipelines — Reproducibility Package
收藏资源简介:
v2 (2026-07-10): package-relative derivation paths (runs from clean checkout), clean-checkout smoke test, completed annotation-provenance statement with author-as-rater disclosure and leave-one-rater-out / unanimous-reference sensitivity analyses, real E4 third arm (deployed probability-bin rule), documented dead-code EPSILON clause, regenerated checksums. Contents: raw human-annotation data (5 raters x 600 random-slice + 5 x 200 flagged-case + 5 x 210 construct-validity), sampling manifests (seed 20260702), one-command derivation scripts, pre-registration documents (both pilots null, both reported), GPU-measured E4 ablation, injector-regime scripts/results. Restricted during peer review; CC BY 4.0 upon acceptance. Author metadata withheld for review.



