Global-MMLU-Lite-sample
收藏资源简介:
# Global-MMLU-Lite — Sample Subset A small, fixed-size subset of [CohereLabs/Global-MMLU-Lite](https://huggingface.co/datasets/CohereLabs/Global-MMLU-Lite) intended for fast smoke-testing of multilingual MMLU evaluation pipelines. ## What this is - **40 examples per language**, 15 languages, **600 examples total**. - **Strictly non-overlapping windows** across languages: language *i* takes rows `[i*40, i*40+40)` from the per-language pool of `test` followed by `dev` (test=400, dev=200, pool=600). Concretely, languages 0–9 fall entirely within the original `test` split and languages 10–14 within `dev`. - **Schema preserved** from the upstream dataset — same columns, same dtypes — so any code that runs on `CohereLabs/Global-MMLU-Lite` should run here unchanged.



