cseval/cs-eval
收藏资源简介：
--- license: cc-by-nc-sa-4.0 task_categories: - text-classification - multiple-choice - question-answering - summarization - feature-extraction - fill-mask - text-retrieval - document-question-answering language: - zh - en pretty_name: CS-Eval size_categories: - 1K<n<10K --- CS-Eval is a comprehensive evaluation toolkit for fundamental cybersecurity models or large language models' cybersecurity ability, encompassing 11 major cybersecurity categories, 42 subdomains, featuring 4,369 assessment items across multiple-choice, true/false, and knowledge extraction questions. It delivers a balanced mix of knowledge-oriented and practice-focused evaluation tasks. The platform empowers users to conduct self-assessments and offers leaderboards across various subdomains, fostering competitive benchmarking and performance insights.Please visit our [Website](https://cs-eval.com/) and [GitHub](https://github.com/CS-EVAL/CS-Eval) for more details. [How to submit?](https://github.com/CS-EVAL/CS-Eval?tab=readme-ov-file#how-to-submit) ### Load the data ```python from datasets import load_dataset dataset=load_dataset(r"cseval/cs-eval") print(dataset['{test}'][0]) ``` More details on data please visit our [github page](https://github.com/CS-EVAL/CS-Eval?tab=readme-ov-file#data).
数据集概述
基本信息
- 许可证: cc-by-nc-sa-4.0
- 任务类别:
- 文本分类
- 多项选择
- 问答
- 摘要生成
- 特征提取
- 填空
- 文本检索
- 文档问答
- 语言:
- 中文
- 英文
- 名称: CS-Eval
- 大小类别: 1K<n<10K
详细描述
CS-Eval 是一个全面的评估工具包，用于评估基础网络安全模型或大型语言模型的网络安全能力。该数据集包含11个主要的网络安全类别，42个子领域，涵盖4,369个评估项目，包括多项选择、判断题和知识提取题。该平台支持用户进行自我评估，并提供各个子领域的排行榜，促进竞争性基准测试和性能洞察。
数据加载示例
python from datasets import load_dataset dataset = load_dataset(r"cseval/cs-eval")
print(dataset[{test}][0])
