amu-cai/C3T

C3T（跨模态能力保持测试）是一个用于评估语音感知语言模型性能的基准测试。该基准测试利用语音克隆文本到语音模型合成的文本任务来验证当模型通过语音输入访问时，语言理解能力是否得到保持。C3T量化了模型对不同类别说话者的公平性以及其在文本和语音模态中的鲁棒性。

C3T (Cross-modal Capabilities Conservation Test) is a benchmark for assessing the performance of speech-aware language models. The benchmark utilizes textual tasks synthesized with a voice cloning text-to-speech model to verify if language understanding capabilities are preserved when the model is accessed via speech input. C3T quantifies the fairness of the model for different categories of speakers and its robustness across text and speech modalities.