eth-sri/SWT-bench_bm25_27k_zsp
收藏Hugging Face2025-02-25 更新2025-07-05 收录
下载链接：
https://hf-mirror.com/datasets/eth-sri/SWT-bench_bm25_27k_zsp
下载链接
链接失效反馈官方服务：
资源简介：
SWT-bench是一个测试系统自动复现GitHub问题能力的数据集，包含了从11个流行的Python GitHub项目中收集的1978个测试Issue-Pull Request对。数据集通过单元测试验证来评估，使用提出模型的测试前后测试套件的行为。此外，数据集采用Pyserini的BM25检索格式化每个实例，可以直接与语言模型一起使用生成补丁文件。
SWT-bench is a dataset that tests systems’ ability to reproduce GitHub issues automatically, containing 1978 test Issue-Pull Request pairs collected from 11 popular Python GitHub projects. The dataset is evaluated by unit test verification using the pre- and post-PR behavior of the test suite with and without the proposed models tests. Additionally, the dataset is formatted using Pyserinis BM25 retrieval for each instance, and it can be used directly with language models to generate patch files.
提供机构：
eth-sri
