Programming Problems Submitted for Evaluation of LLMs GPT-3.5 and Gemini Pro 1.0
收藏资源简介:
Problems extracted from platforms LeetCode and BeeCrowd for evaluation of LLMs GPT3.5 and Gemini Pro 1.0. The data from the plataforms has the following columns and values: LeetCode Data BeeCrowd Data Column Doc Column Doc problem_level easy | medium | hard problem_level <1...10> problem_link problem_link prompt prompt response_code response_code response_evaluation True | False response_evaluation True | False execution_time_ms execution_time_ms memory_usage_mb error_generated Wrong Answer | Time Limit Exceeded | Memory Limit Exceeded.... error_generated Wrong Answer | Time Limit Exceeded | Memory Limit Exceeded.... attempts_number 1 | 2 | 3 attempts_number 1 | 2 | 3 author contains_image True | False source related_topic_1 origin_country related_topic_2 contains_image True | False related_topic_3 related_topic_1 related_topic_4 related_topic_5



