Artifact of the paper "Why Are AI Agent–Involved Pull Requests (Fix-Related) Remain Unmerged? An Empirical Study"

This replication package provides all datasets, scripts, and analysis results required to reproduce the findings reported in “Why Are AI Agent–Involved Pull Requests (Fix-Related) Remain Unmerged? An Empirical Study.” The package is designed to support transparency, reproducibility, and independent verification of both the quantitative and qualitative analyses conducted in this study. The dataset folder includes the AIDEV-POP dataset, which contains 33,596 AI-authored pull requests mined from GitHub, as well as all derived subsets used in the paper. From this dataset, we extracted 8,106 fix-related pull requests authored by five AI coding agents (OpenAI Codex, GitHub Copilot, Devin, Cursor, and Claude Code). The scripts folder contains all programs used to preprocess the data, conduct the quantitative and qualitative analyses, and generate the results reported in the paper. These scripts implement the full analysis pipeline, including identification of fix-related pull requests, outcome classification (merged, closed without merging, open), agent-wise aggregation, merge-time computation, and analysis of code review activity, as well as a visualization chart for failure topic distribution. The results folder contains the outputs generated from the analyses conducted in this study. For RQ1, it includes the distribution of pull request merge times, provided as density and boxplot figures. For RQ2, it contains the spreadsheet documenting the failure analysis of fix-related pull requests that were closed without merging. These artifacts correspond directly to the results reported in the paper and support verification of the empirical findings.