Limour/perplexity
收藏Hugging Face2024-04-18 更新2024-06-11 收录
下载链接：
https://hf-mirror.com/datasets/Limour/perplexity
下载链接
链接失效反馈官方服务：
资源简介：
---
license: cc-by-nc-sa-4.0
language:
- zh
tags:
- not-for-all-audiences
---
https://www.kaggle.com/code/reginliu/perplexity
| Model | Size | PPL | n_vocab | PPL_adjust |
|-------|---------|---------|---------|---------|
| [qwen1_5-14b-chat-IQ3_XS.gguf](https://huggingface.co/Limour/Qwen1.5-14B-Chat-GGUF/blob/main/qwen1_5-14b-chat-IQ3_XS.gguf) | 6.48 | 11.8084 +/- 0.121615 | 152064 | 11.8084 |
| [causallm_14b.IQ3_XS.gguf](https://huggingface.co/Limour/CausalLM-14B-GGUF/blob/main/causallm_14b.IQ3_XS.gguf) | 6.48 | 13.3798 +/- 0.13641 | 152064 | 13.3798 |
| [causallm_14b.IQ4_XS.gguf](https://huggingface.co/Limour/CausalLM-14B-GGUF/blob/main/causallm_14b.IQ4_XS.gguf) | 7.85 | 13.4127 +/- 0.13762 | 152064 | 13.4127 |
| [causallm_14b.Q4_0.gguf](https://huggingface.co/TheBloke/CausalLM-14B-GGUF/blob/main/causallm_14b.Q4_0.gguf) | 8.18 | 13.6714 +/- 0.13964 | 152064 | 13.6714 |
| [causallm_14b.IQ2_XXS.gguf](https://huggingface.co/Limour/CausalLM-14B-GGUF/blob/main/causallm_14b.IQ2_XXS.gguf) | 4.98 | 15.0160 +/- 0.15004 | 152064 | 15.0160 |
| [Yi-9B-200K_iQ3xxs.gguf](https://huggingface.co/MarsupialAI/Yi-9B-200K_iMatrix_GGUF/blob/main/Yi-9B-200K_iQ3xxs.gguf) | 3.47 | 6.8157 +/- 0.05453 | 64000 | 16.1941 |
| [Fi-9B-200K-Q8_0.gguf](https://huggingface.co/DisOOM/Fi-9B-GGUF/blob/main/Fi-9B-Q8_0.gguf) | 9.38 | 6.8402 +/- 0.05741 | 64000 | 16.2523 |
| [causallm_7b.Q5_K_M.gguf](https://huggingface.co/TheBloke/CausalLM-7B-GGUF/blob/main/causallm_7b.Q5_K_M.gguf) | 5.53 | 16.5278 +/- 0.18005 | 152064 | 16.5278 |
| [Qwen1.5-22B-Chat-Merge-Q4_0.gguf](https://huggingface.co/DisOOM/Qwen1.5-22B-Chat-Merge-GGUF/blob/main/Qwen1.5-22B-Chat-Merge-Q4_0.gguf) | 12.6 | 21.9669 +/- 0.28980 | 152064 | 21.9669 |
| [Kunoichi-DPO-v2-7B-Q4_K_M-imatrix.gguf](https://hf-mirror.com/Lewdiculous/Kunoichi-DPO-v2-7B-GGUF-Imatrix/blob/main/Kunoichi-DPO-v2-7B-Q4_K_M-imatrix.gguf) | 4.37 | 6.7096 +/- 0.04519 | 32000 | 31.8840 |
| [WizardLM-2-7B-IQ4_XS-imat.gguf](https://huggingface.co/ABX-AI/WizardLM-2-7B-GGUF-IQ-Imatrix/blob/main/WizardLM-2-7B-IQ4_XS-imat.gguf) | 3.91 | 9.8891 +/- 0.08106 | 32000 | 46.9930 |
For a model that returns tokens completely at random, we have
$$ P(token|context) = \frac{1}{n_{vocab}}, \quad PPL = \sqrt[N]{\left(\frac{1}{P}\right)^N} = n_{vocab} $$
therefore
$$ PPL_{adjust} = \frac{PPL}{n_{vocab}} \times 152064 $$
提供机构：
Limour
原始信息汇总
数据集概述
数据集信息
- 许可证: cc-by-nc-sa-4.0
- 语言: 中文
- 标签: 不适用于所有观众
模型数据
| 模型名称 | 大小 | PPL | n_vocab | PPL_adjust |
|---|---|---|---|---|
| qwen1_5-14b-chat-IQ3_XS.gguf | 6.48 | 11.8084 +/- 0.121615 | 152064 | 11.8084 |
| causallm_14b.IQ3_XS.gguf | 6.48 | 13.3798 +/- 0.13641 | 152064 | 13.3798 |
| causallm_14b.IQ4_XS.gguf | 7.85 | 13.4127 +/- 0.13762 | 152064 | 13.4127 |
| causallm_14b.Q4_0.gguf | 8.18 | 13.6714 +/- 0.13964 | 152064 | 13.6714 |
| causallm_14b.IQ2_XXS.gguf | 4.98 | 15.0160 +/- 0.15004 | 152064 | 15.0160 |
| Yi-9B-200K_iQ3xxs.gguf | 3.47 | 6.8157 +/- 0.05453 | 64000 | 16.1941 |
| Fi-9B-200K-Q8_0.gguf | 9.38 | 6.8402 +/- 0.05741 | 64000 | 16.2523 |
| causallm_7b.Q5_K_M.gguf | 5.53 | 16.5278 +/- 0.18005 | 152064 | 16.5278 |
| Qwen1.5-22B-Chat-Merge-Q4_0.gguf | 12.6 | 21.9669 +/- 0.28980 | 152064 | 21.9669 |
| Kunoichi-DPO-v2-7B-Q4_K_M-imatrix.gguf | 4.37 | 6.7096 +/- 0.04519 | 32000 | 31.8840 |
| WizardLM-2-7B-IQ4_XS-imat.gguf | 3.91 | 9.8891 +/- 0.08106 | 32000 | 46.9930 |
公式说明
$$ P(token|context) = frac{1}{n_{vocab}}, quad PPL = sqrt[N]{left(frac{1}{P} ight)^N} = n_{vocab} $$ $$ PPL_{adjust} = frac{PPL}{n_{vocab}} imes 152064 $$
