Experiment data for the SwiftEval benchmark
收藏官方服务：
资源简介：
This dataset includes 28 hand-crafted problems for the SwiftEval benchmark and the results of 44 experiments run with various LLMs. It has the following structure: problems.json - contains 28 problems experiments - folder contains 44 experiments data {experiment_name} completions.jsonl - contains raw LLM text generation evaluations.jsonl - contains extracted code and evaluation results metadata.jsonl - contains LLM model checkpoint and generation parameters
提供机构：
Zenodo创建时间：
2024-12-13
