ScaleAI/audiomc
收藏Hugging Face2026-02-18 更新2025-12-20 收录
下载链接：
https://hf-mirror.com/datasets/ScaleAI/audiomc
下载链接
链接失效反馈官方服务：
资源简介：
Audio MultiChallenge是一个开源基准，用于评估端到端语音对话系统在自然多轮交互模式下的表现。该数据集基于文本的MultiChallenge框架，增加了语音编辑的新维度，测试对语音修复和回溯的鲁棒性，并将每个维度扩展到音频模态。数据集包含来自47位发言者的452个对话和1,712个评估标准。
Audio MultiChallenge is an open-source benchmark to evaluate E2E spoken dialogue systems under natural multi-turn interaction patterns. Building on the text-based MultiChallenge framework, which evaluates Inference Memory, Instruction Retention, and Self Coherence, we introduce a new axis Voice Editing that tests robustness to mid-utterance speech repairs and backtracking. We further augment each axis to the audio modality. We provide 452 conversations from 47 speakers with 1,712 rubrics for automatic evaluation.
提供机构：
ScaleAI
