SWE-bench-Live/SWE-bench-Live

SWE-bench-Live是一个针对问题解决的实时基准，旨在评估AI系统完成实际软件工程任务的能力。得益于自动化的数据集管理流程，该数据集计划每月更新一次，为社区提供最新的任务实例，并支持严格且无污染的评价。

SWE-bench-Live is a live benchmark for issue resolving, designed to evaluate an AI systems ability to complete real-world software engineering tasks. Thanks to our automated dataset curation pipeline, we plan to update SWE-bench-Live on a monthly basis to provide the community with up-to-date task instances and support rigorous and contamination-free evaluation.