AIDev Breaking Change Analysis

We conduct a comparative analysis of AI Agent-generated PRs with human-authored PRs from Python repositories in the AIDev dataset (https://huggingface.co/datasets/hao-li/AIDev). We develop a tool that analyzes code changes in commits corresponding to the agentic PRs and leverages an abstract syntax tree (AST) based analysis to detect potential breaking changes.本研究针对AIDev数据集（https://huggingface.co/datasets/hao-li/AIDev）中Python代码仓库的AI智能体（AI Agent）生成的拉取请求（Pull Request，PR）与人工撰写的拉取请求展开对比分析。本研究开发了一款工具，用于分析智能体生成拉取请求所对应的代码提交中的代码变更，并依托基于抽象语法树（abstract syntax tree, AST）的分析方法检测潜在的破坏性变更。