Trelis/eval-whisper-base-eka-hard-20260408-1921
收藏资源简介：
--- tags: - whisper - evaluation - speech - speech-to-text --- # Evaluation Results: whisper-base Evaluation results from Whisper model evaluation. ## Summary | Model | WER | CER | |-------|-----|-----| | [openai/whisper-base](https://huggingface.co/openai/whisper-base) | 126.82% | 78.94% | ## Source Data - **Evaluation Dataset:** [Trelis/eka-hard](https://huggingface.co/datasets/Trelis/eka-hard) - **Model Evaluated:** [openai/whisper-base](https://huggingface.co/openai/whisper-base) ## Columns | Column | Description | |--------|-------------| | `audio` | Audio sample (if available from source dataset) | | `reference` | Ground truth transcription | | `prediction` | Model prediction | | `wer` | Word Error Rate for this sample | | `cer` | Character Error Rate for this sample | | `entities` | Entity annotations from source dataset | | `entity_cer` | Per-sample entity CER (-1.0 if no entities) | ## Entity CER **Overall Entity CER:** 47.21% | Category | CER | |----------|-----| | anatomy | 23.53% | | biomarker | 77.78% | | condition | 41.18% | | drug | 47.98% | | procedure | 72.73% | --- *Generated by [Trelis Studio](https://studio.trelis.com)*
--- 标签： - Whisper模型（Whisper） - 模型评估 - 语音 - 语音转文字 --- # 评估结果：Whisper-base 本数据集收录了Whisper模型的评估结果。 ## 摘要 | 模型 | 词错误率（Word Error Rate，WER） | 字符错误率（Character Error Rate，CER） | |-------|-----|-----| | [openai/whisper-base](https://huggingface.co/openai/whisper-base) | 126.82% | 78.94% | ## 源数据集 - **评估数据集：** [Trelis/eka-hard](https://huggingface.co/datasets/Trelis/eka-hard) - **被评估模型：** [openai/whisper-base](https://huggingface.co/openai/whisper-base) ## 数据列说明 | 列名 | 说明 | |--------|-------------| | `audio` | 音频样本（若源数据集包含该字段） | | `reference` | 真实标注转录文本 | | `prediction` | 模型预测转录文本 | | `wer` | 该样本的词错误率（WER） | | `cer` | 该样本的字符错误率（CER） | | `entities` | 源数据集提供的实体标注信息 | | `entity_cer` | 该样本的实体字符错误率（CER）（若无实体则为-1.0） | ## 实体字符错误率 **整体实体字符错误率：** 47.21% | 类别 | 字符错误率（CER） | |----------|-----| | 解剖学实体 | 23.53% | | 生物标志物实体 | 77.78% | | 病症实体 | 41.18% | | 药物实体 | 47.98% | | 医疗操作实体 | 72.73% | --- *由 [Trelis Studio](https://studio.trelis.com) 生成*
