Trelis/eval-nova-3-eka-hard-20260408-1924

--- tags: - whisper - evaluation - speech - speech-to-text --- # Evaluation Results: nova-3 Evaluation results from Whisper model evaluation. ## Summary | Model | WER | CER | |-------|-----|-----| | [deepgram/nova-3](https://huggingface.co/deepgram/nova-3) | 44.86% | 29.11% | ## Source Data - **Evaluation Dataset:** [Trelis/eka-hard](https://huggingface.co/datasets/Trelis/eka-hard) - **Model Evaluated:** [deepgram/nova-3](https://huggingface.co/deepgram/nova-3) ## Columns | Column | Description | |--------|-------------| | `audio` | Audio sample (if available from source dataset) | | `reference` | Ground truth transcription | | `prediction` | Model prediction | | `wer` | Word Error Rate for this sample | | `cer` | Character Error Rate for this sample | | `entities` | Entity annotations from source dataset | | `entity_cer` | Per-sample entity CER (-1.0 if no entities) | ## Entity CER **Overall Entity CER:** 38.66% | Category | CER | |----------|-----| | anatomy | 5.88% | | biomarker | 88.89% | | condition | 25.21% | | drug | 42.05% | | procedure | 59.09% | --- *Generated by [Trelis Studio](https://studio.trelis.com)*