遇见数据集

MarCompBench v1 — restricted companion record (consultancy reference verdicts)

收藏
Zenodo2026-07-14 更新2026-08-01 收录
官方服务:

资源简介:

This restricted companion record holds the two files of the MarCompBench v1 release that derive from a third-party controlled professional gap-analysis report and are therefore not openly republished: rating-matrix-full.csv (all three reference verdict columns per item) and overrides-full.csv (per-item panel modal verdict, all three references' verdicts, and the Author endorsement flag), plus a README stating the terms. Access is limited to peer review and to verification of the statistics published in the accompanying paper and the open record (DOI 10.5281/zenodo.21357226, latest version), granted case by case under confidentiality. No license is granted over these files; do not redistribute them or publish their contents at item level. To verify: place rating-matrix-full.csv in the open record's directory and run python3 compute_agreement.py; the script then recomputes every statistic in the paper, including all consultancy pairs, Krippendorff's alpha over three raters, and the three-way consensus split. Accompanies: Torgersen (2026), Machine reproducibility and human disagreement in maritime compliance assessment: evidence from a triangulated benchmark on a DP operations manual.

提供机构:
Zenodo
创建时间:
2026-07-14
二维码
社区交流群
二维码
科研交流群
商业服务