Trelis/eval-Voxtral-Mini-3B-2507-eka-hard-20260408-1920

---
tags:
- whisper
- evaluation
- speech
- speech-to-text
---
# Evaluation Results: Voxtral-Mini-3B-2507

Evaluation results from Whisper model evaluation.

## Summary

| Model | WER | CER |
|-------|-----|-----|
| [mistralai/Voxtral-Mini-3B-2507](https://huggingface.co/mistralai/Voxtral-Mini-3B-2507) | 43.86% | 29.54% |

## Source Data

- **Evaluation Dataset:** [Trelis/eka-hard](https://huggingface.co/datasets/Trelis/eka-hard)
- **Model Evaluated:** [mistralai/Voxtral-Mini-3B-2507](https://huggingface.co/mistralai/Voxtral-Mini-3B-2507)

## Columns

| Column | Description |
|--------|-------------|
| `audio` | Audio sample (if available from source dataset) |
| `reference` | Ground truth transcription |
| `prediction` | Model prediction |
| `wer` | Word Error Rate for this sample |
| `cer` | Character Error Rate for this sample |

| `entities` | Entity annotations from source dataset |
| `entity_cer` | Per-sample entity CER (-1.0 if no entities) |

## Entity CER

**Overall Entity CER:** 42.57%

| Category | CER |
|----------|-----|
| anatomy | 23.53% |
| biomarker | 55.56% |
| condition | 31.09% |
| drug | 45.82% |
| procedure | 59.09% |

---
*Generated by [Trelis Studio](https://studio.trelis.com)*

标签：
- Whisper（语音转写模型）
- 模型评估
- 语音
- 语音转写

# 评估结果：Voxtral-Mini-3B-2507

本评估结果源自Whisper语音转写模型的评估流程。

## 摘要

| 模型 | 词错误率(Word Error Rate, WER) | 字符错误率(Character Error Rate, CER) |
|-------|-----|-----|
| [mistralai/Voxtral-Mini-3B-2507](https://huggingface.co/mistralai/Voxtral-Mini-3B-2507) | 43.86% | 29.54% |

## 源数据集信息

- **评估数据集：** [Trelis/eka-hard](https://huggingface.co/datasets/Trelis/eka-hard)
- **评估模型：** [mistralai/Voxtral-Mini-3B-2507](https://huggingface.co/mistralai/Voxtral-Mini-3B-2507)

## 数据列说明

| 列名 | 描述 |
|--------|-------------|
| `audio` | 音频样本（若源数据集提供） |
| `reference` | 基准转录文本（真实标注） |
| `prediction` | 模型预测转录文本 |
| `wer` | 单样本词错误率 |
| `cer` | 单样本字符错误率 |
| `entities` | 源数据集自带的实体标注 |
| `entity_cer` | 单样本实体字符错误率（无实体时取值为-1.0） |

## 实体字符错误率

**整体实体字符错误率：** 42.57%

| 实体类别 | 字符错误率 |
|----------|-----|
| 解剖学 | 23.53% |
| 生物标志物 | 55.56% |
| 病症 | 31.09% |
| 药物 | 45.82% |
| 诊疗操作 | 59.09% |

---
*由[Trelis Studio](https://studio.trelis.com)生成*