Green-Sky/mmlu-redux-for-llama.cpp
收藏Hugging Face2026-04-10 更新2026-04-12 收录
下载链接：
https://hf-mirror.com/datasets/Green-Sky/mmlu-redux-for-llama.cpp
下载链接
链接失效反馈官方服务：
资源简介：
---
license: cc-by-4.0
task_categories:
- question-answering
language:
- en
pretty_name: MMLU-Redux
size_categories:
- 1K<n<10K
---
MMLU-redux converted for the llama.cpp perplexity multiple choice tool.
Only valid entries where kept, there is no error based prompting included.
---
# Dataset Card for MMLU-Redux
<!-- Provide a quick summary of the dataset. -->
> [!TIP]
> Please consider using [MMLU-Redux-2.0](https://huggingface.co/datasets/edinburgh-dawg/mmlu-redux-2.0) which contains all 57 MMLU subjects.
MMLU-Redux is a subset of 3,000 manually re-annotated questions across 30 MMLU subjects.
## Citation
<!-- If there is a paper or blog post introducing the dataset, the APA and Bibtex information for that should go in this section. -->
**BibTeX:**
```
@misc{gema2024mmlu,
title={Are We Done with MMLU?},
author={Aryo Pradipta Gema and Joshua Ong Jun Leang and Giwon Hong and Alessio Devoto and Alberto Carlo Maria Mancino and Rohit Saxena and Xuanli He and Yu Zhao and Xiaotang Du and Mohammad Reza Ghasemi Madani and Claire Barale and Robert McHardy and Joshua Harris and Jean Kaddour and Emile van Krieken and Pasquale Minervini},
year={2024},
eprint={2406.04127},
archivePrefix={arXiv},
primaryClass={cs.CL}
}
```
<!-- ## Glossary [optional] -->
<!-- If relevant, include terms and calculations in this section that can help readers understand the dataset or dataset card. -->
<!-- [More Information Needed]
## More Information [optional]
[More Information Needed]
## Dataset Card Authors [optional]
[More Information Needed]
-->
## Dataset Card Contact
- aryo.gema@ed.ac.uk
- p.minervini@ed.ac.uk
提供机构：
Green-Sky
