Programming Problems Submitted for Evaluation of LLMs GPT-3.5 and Gemini Pro 1.0
收藏NIAID Data Ecosystem2026-05-01 收录
下载链接：
https://zenodo.org/record/11077833
下载链接
链接失效反馈官方服务：
资源简介：
Problems extracted from platforms LeetCode and BeeCrowd for evaluation of LLMs GPT3.5 and Gemini Pro 1.0.
The data from the plataforms has the following columns and values:
LeetCode Data
BeeCrowd Data
Column
Doc
Column
Doc
problem_level
easy | medium | hard
problem_level
<1...10>
problem_link
problem_link
prompt
prompt
response_code
response_code
response_evaluation
True | False
response_evaluation
True | False
execution_time_ms
execution_time_ms
memory_usage_mb
error_generated
Wrong Answer | Time Limit Exceeded | Memory Limit Exceeded....
error_generated
Wrong Answer | Time Limit Exceeded | Memory Limit Exceeded....
attempts_number
1 | 2 | 3
attempts_number
1 | 2 | 3
author
contains_image
True | False
source
related_topic_1
origin_country
related_topic_2
contains_image
True | False
related_topic_3
related_topic_1
related_topic_4
related_topic_5
创建时间：
2024-04-27
