Qiskit/qiskit_humaneval_hard
收藏Hugging Face2025-09-02 更新2025-09-13 收录
下载链接：
https://hf-mirror.com/datasets/Qiskit/qiskit_humaneval_hard
下载链接
链接失效反馈官方服务：
资源简介：
qiskit_humaneval_hard是一个用于评估大型语言模型（LLM）编写Qiskit代码能力的数据库。它包含了与Qiskit/qiskit_humaneval相同的问题，但并非以完成练习的形式呈现。与Qiskit/qiskit_humaneval相比，这个基准更具有挑战性，因为LLM需要决定使用哪些Python模块来解决这些问题。
qiskit_humaneval_hard is a dataset for evaluating LLMs ability to write Qiskit code. It contains the same problems as in Qiskit/qiskit_humaneval but is not formatted as a completion exercise. Compared with Qiskit/qiskit_humaneval, this benchmark is more challenging as the LLM needs to decide which Python modules to use for solving the problems.
提供机构：
Qiskit
