NetEval

NetEval is a NetOps evaluation suite for foundation models, consisting of 5269 multi-choice questions. Please check [our paper](https://arxiv.org/abs/2309.05557) for more details about NetEval.

We hope NetEval could help developers track the progress and analyze the NetOps ability of their models.

## Citation

Please cite our paper if you use our dataset.

```
@misc{miao2023empirical,
title={An Empirical Study of NetOps Capability of Pre-Trained Large Language Models},
author={Yukai Miao and Yu Bai and Li Chen and Dan Li and Haifeng Sun and Xizheng Wang and Ziqiu Luo and Dapeng Sun and Xiuting Xu and Qi Zhang and Chao Xiang and Xinchi Li},
year={2023},
eprint={2309.05557},
archivePrefix={arXiv},
primaryClass={cs.CL}
}
```

NetEval是一款面向基础模型（foundation models）的网络运维（NetOps）评估套件，涵盖5269道多项选择题。如需了解NetEval的更多细节，请查阅[我们的论文](https://arxiv.org/abs/2309.05557)。

我们期望NetEval能够助力开发者追踪模型的研发进展，并分析其模型的网络运维能力。

## 引用说明
若您使用本数据集，请引用我们的论文。

@misc{miao2023empirical,
title={An Empirical Study of NetOps Capability of Pre-Trained Large Language Models},
author={Yukai Miao and Yu Bai and Li Chen and Dan Li and Haifeng Sun and Xizheng Wang and Ziqiu Luo and Dapeng Sun and Xiuting Xu and Qi Zhang and Chao Xiang and Xinchi Li},
year={2023},
eprint={2309.05557},
archivePrefix={arXiv},
primaryClass={cs.CL}
}