Let's Ask AI About Their Programs
收藏NIAID Data Ecosystem2026-05-01 收录
下载链接:
https://zenodo.org/record/8434781
下载链接
链接失效反馈官方服务:
资源简介:
The dataset includes:
60 small Python programs generated by OpenAI GPT-3.5 (10 functionally correct program variations for each of the selected 6 publicly available introductory programming assignments)
399 program comprehension questions that target the generated programs
798 answers to those questions by OpenAI GPT-3.5 and GPT-4
Researcher annotation on the correctness of each answer and developed codes for the error types
In addition, scripts for processing and analyzing the data are included.
创建时间:
2024-04-17



