Trelis/eval-whisper-small-english-medical-terms-2025-20260408-1931

---
tags:
- whisper
- evaluation
- speech
- speech-to-text
---
# Evaluation Results: whisper-small-english

Evaluation results from Whisper model evaluation.

## Summary

| Model | WER | CER |
|-------|-----|-----|
| [leduckhai/MultiMed-ST/asr/whisper-small-english](https://huggingface.co/leduckhai/MultiMed-ST/asr/whisper-small-english) | 13.44% | 4.94% |

## Source Data

- **Evaluation Dataset:** [Trelis/medical-terms-2025](https://huggingface.co/datasets/Trelis/medical-terms-2025)
- **Model Evaluated:** [leduckhai/MultiMed-ST/asr/whisper-small-english](https://huggingface.co/leduckhai/MultiMed-ST/asr/whisper-small-english)

## Columns

| Column | Description |
|--------|-------------|
| `audio` | Audio sample (if available from source dataset) |
| `reference` | Ground truth transcription |
| `prediction` | Model prediction |
| `wer` | Word Error Rate for this sample |
| `cer` | Character Error Rate for this sample |

| `entities` | Entity annotations from source dataset |
| `entity_cer` | Per-sample entity CER (-1.0 if no entities) |

## Entity CER

**Overall Entity CER:** 25.86%

| Category | CER |
|----------|-----|
| biomarker | 4.17% |
| condition | 11.48% |
| drug | 29.27% |
| procedure | 3.23% |

---
*Generated by [Trelis Studio](https://studio.trelis.com)*