遇见数据集

Replication package for "Just Pin It: Can Coding Agents Be Trusted to Choose Dependency Versions?"

收藏
Zenodo2026-07-30 更新2026-08-01 收录
官方服务:

资源简介:

Replication package for the study "Just Pin It: Can Coding Agents Be Trusted to Choose Dependency Versions?".The study reconstructs 50 dependency-introducing commits from 29 open-source Python repositories at their parent state, asks six Claude coding agents to add the same dependency under tool and network isolation, and scores each choice on a time-bounded, multidimensional correctness vector. Each pin is then challenged in a second conversational turn with a neutral prompt, a true defect, or a false alarm to separate genuine repair from sycophantic capitulation.This package contains the fifty-anchor source set in its frozen order, the per-run records for all 1,200 planned runs, the frozen analysis outputs behind every table and figure, the contamination-audit and double-coding material, the measurement and critique harness, the corpus miner, and the figure generation scripts.Every reported number regenerates from the deposited records with make verify-analysis. The analysis has exactly one third-party dependency (packaging==26.2); all statistics are implemented in pure Python. See README.md for the reproduction procedure and MANIFEST.md for the mapping from each paper artifact to the file that produced it, with SHA-256 checksums.The study protocol was preregistered on OSF (project 6kbrj) on 2026-07-13, before data collection (2026-07-13 to 2026-07-16).

提供机构:
Zenodo
创建时间:
2026-07-30
二维码
社区交流群
二维码
科研交流群
商业服务