MMSU

# MMSU: A Massive Multi-task Spoken Language Understanding and Reasoning Benchmark ## Overview of MMSU: MMSU, a comprehensive benchmark designed specifically for understanding and reasoning in spoken language. MMSU comprises 5,000 meticulously curated audio-question-answer triplets across 47 distinct tasks. To ground our benchmark in linguistic theory, we systematically incorporate a wide range of linguistic phenomena, including phonetics, prosody, syntax, syntactics, semantics, and paralinguistics. ## Evaluation: [**Refer to Github Code**](https://github.com/dingdongwang/MMSU_Bench/tree/main) ## Citation ``` @article{wang2025mmsu, title={MMSU: A Massive Multi-task Spoken Language Understanding and Reasoning Benchmark}, author={Dingdong Wang and Jincenzi Wu and Junan Li and Dongchao Yang and Xueyuan Chen and Tianhua Zhang and Helen Meng}, journal={arXiv preprint arXiv:2506.04779}, year={2025}, } ```