johnk-23412/openai_humaneval
收藏Hugging Face2025-12-19 更新2025-12-20 收录
下载链接：
https://hf-mirror.com/datasets/johnk-23412/openai_humaneval
下载链接
链接失效反馈官方服务：
资源简介：
OpenAI HumanEval数据集包含164个手工编写的编程问题，每个问题包括函数签名、文档字符串、函数体和多个单元测试。这些问题旨在评估代码生成模型，并且确保不会出现在模型的训练集中。数据集使用Python编写，包含英文自然文本的注释和文档字符串。数据集结构包括任务ID、提示、规范解决方案、测试和入口点等字段，仅包含一个测试分割，共164个样本。
The HumanEval dataset released by OpenAI includes 164 programming problems with a function signature, docstring, body, and several unit tests. They were handwritten to ensure not to be included in the training set of code generation models. The programming problems are written in Python and contain English natural text in comments and docstrings. The dataset structure includes fields such as task_id, prompt, canonical_solution, test, and entry_point, and it only contains a test split with 164 samples.
提供机构：
johnk-23412
