Trelis/eval-whisper-small-medical-terms-2025-20260408-1929

--- tags: - whisper - evaluation - speech - speech-to-text --- # Evaluation Results: whisper-small Evaluation results from Whisper model evaluation. ## Summary | Model | WER | CER | |-------|-----|-----| | [openai/whisper-small](https://huggingface.co/openai/whisper-small) | 12.95% | 4.24% | ## Source Data - **Evaluation Dataset:** [Trelis/medical-terms-2025](https://huggingface.co/datasets/Trelis/medical-terms-2025) - **Model Evaluated:** [openai/whisper-small](https://huggingface.co/openai/whisper-small) ## Columns | Column | Description | |--------|-------------| | `audio` | Audio sample (if available from source dataset) | | `reference` | Ground truth transcription | | `prediction` | Model prediction | | `wer` | Word Error Rate for this sample | | `cer` | Character Error Rate for this sample | | `entities` | Entity annotations from source dataset | | `entity_cer` | Per-sample entity CER (-1.0 if no entities) | ## Entity CER **Overall Entity CER:** 26.40% | Category | CER | |----------|-----| | biomarker | 4.17% | | condition | 11.48% | | drug | 29.92% | | procedure | 3.23% | --- *Generated by [Trelis Studio](https://studio.trelis.com)*