Bugs4Q: A Benchmark of Existing Bugs to Enable Controlled Testing and Debugging Studies for Quantum Programs

Realistic benchmarks of reproducible bugs and fixes are vital to good experimental evaluation of debugging and testing approaches. Bugs4Q is a benchmark of forty-two real, manually validated Qiskit bugs from three popular platforms (GitHub, StackOverflow, and Stack Exchange) in programming, supplemented with test cases to reproduce buggy behaviors. Bugs4Q Database allows users to access the bugs we collected directly. Bugs4Q Framework provides interfaces for accessing the buggy and fixed versions of the Qiskit programs and executing the corresponding source code and unit tests, facilitating reproducible empirical studies and comparisons of Qiskit program debugging and testing tools.可复现的漏洞与修复方案的真实基准集，对于调试与测试方法的高质量实验评估而言至关重要。Bugs4Q是一款基准数据集，收录了来自GitHub、StackOverflow、Stack Exchange三大主流编程平台的42个经人工验证的真实Qiskit漏洞，并配套了可复现该漏洞行为的测试用例。Bugs4Q数据库支持用户直接访问所收集的全部漏洞。Bugs4Q框架提供了相关接口，可用于获取Qiskit程序的漏洞版本与修复后版本，并执行对应的源代码与单元测试，从而为Qiskit程序调试与测试工具的可复现实证研究及对比分析提供支持。