cseval/cs-eval

---
license: cc-by-nc-sa-4.0
task_categories:
- text-classification
- multiple-choice
- question-answering
- summarization
- feature-extraction
- fill-mask
- text-retrieval
- document-question-answering
language:
- zh
- en
pretty_name: CS-Eval
size_categories:
- 1K<n<10K
---
CS-Eval is a comprehensive evaluation toolkit for fundamental cybersecurity models or large language models' cybersecurity ability, encompassing 11 major cybersecurity categories, 42 subdomains, featuring 4,369 assessment items across multiple-choice, true/false, and knowledge extraction questions. It delivers a balanced mix of knowledge-oriented and practice-focused evaluation tasks. The platform empowers users to conduct self-assessments and offers leaderboards across various subdomains, fostering competitive benchmarking and performance insights.Please visit our [Website](https://cs-eval.com/) and [GitHub](https://github.com/CS-EVAL/CS-Eval) for more details.

[How to submit?](https://github.com/CS-EVAL/CS-Eval?tab=readme-ov-file#how-to-submit)

### Load the data
```python
from datasets import load_dataset
dataset=load_dataset(r"cseval/cs-eval")

print(dataset['{test}'][0])

```
More details on data please visit our [github page](https://github.com/CS-EVAL/CS-Eval?tab=readme-ov-file#data).

原始信息汇总

数据集概述

基本信息

• 许可证: cc-by-nc-sa-4.0
• 任务类别:
  • 文本分类
  • 多项选择
  • 问答
  • 摘要生成
  • 特征提取
  • 填空
  • 文本检索
  • 文档问答
• 语言:
  • 中文
  • 英文
• 名称: CS-Eval
• 大小类别: 1K<n<10K

详细描述

CS-Eval 是一个全面的评估工具包，用于评估基础网络安全模型或大型语言模型的网络安全能力。该数据集包含11个主要的网络安全类别，42个子领域，涵盖4,369个评估项目，包括多项选择、判断题和知识提取题。该平台支持用户进行自我评估，并提供各个子领域的排行榜，促进竞争性基准测试和性能洞察。

数据加载示例

python from datasets import load_dataset dataset = load_dataset(r"cseval/cs-eval")

print(dataset[{test}][0])