遇见数据集

Replication Package: Can Coding Agents Produce Merge-Ready Feature Pull Requests? An Industrial Evaluation of 62 Real Tasks

收藏
Zenodo2026-04-30 更新2026-05-26 收录
官方服务:

资源简介:

Replication package for the ASE 2026 Industry Showcase paper. Contains 62 feature-implementation task definitions (prompts, ground-truth diffs, file classifications), a task registry with commit SHAs and PR URLs, the scoring rubric, evaluation scores for 496 agent runs across four commercial coding agents (Claude Code, Codex CLI, Cursor, OpenCode), and evaluation/analysis scripts.

提供机构:
Zenodo
创建时间:
2026-04-30
二维码
社区交流群
二维码
科研交流群
商业服务