Trelis/eval-gemini-2.5-pro-eka-hard-20260408-1922
收藏Hugging Face2026-04-08 更新2026-04-12 收录
下载链接：
https://hf-mirror.com/datasets/Trelis/eval-gemini-2.5-pro-eka-hard-20260408-1922
下载链接
链接失效反馈官方服务：
资源简介：
---
tags:
- whisper
- evaluation
- speech
- speech-to-text
---
# Evaluation Results: gemini-2.5-pro
Evaluation results from Whisper model evaluation.
## Summary
| Model | WER | CER |
|-------|-----|-----|
| [google/gemini-2.5-pro](https://huggingface.co/google/gemini-2.5-pro) | 15.04% | 7.80% |
## Source Data
- **Evaluation Dataset:** [Trelis/eka-hard](https://huggingface.co/datasets/Trelis/eka-hard)
- **Model Evaluated:** [google/gemini-2.5-pro](https://huggingface.co/google/gemini-2.5-pro)
## Columns
| Column | Description |
|--------|-------------|
| `audio` | Audio sample (if available from source dataset) |
| `reference` | Ground truth transcription |
| `prediction` | Model prediction |
| `wer` | Word Error Rate for this sample |
| `cer` | Character Error Rate for this sample |
| `entities` | Entity annotations from source dataset |
| `entity_cer` | Per-sample entity CER (-1.0 if no entities) |
## Entity CER
**Overall Entity CER:** 21.00%
| Category | CER |
|----------|-----|
| anatomy | 0.00% |
| biomarker | 44.44% |
| condition | 6.72% |
| drug | 25.61% |
| procedure | 27.27% |
---
*Generated by [Trelis Studio](https://studio.trelis.com)*
提供机构：
Trelis
