kenhktsui/code-natural-language-classification-dataset

该数据集包含多个特征，如文本、仓库名称、路径、语言、许可证和大小等。数据集分为训练集和测试集，分别包含大量的字节和示例。数据集是从codeparrot/github-code中采样，并选择了更宽松的许可证类型，同时也从minipile中采样。该数据集旨在用于训练代码自然语言分类器。The dataset includes multiple features such as text, repository name, path, language, license, and size. It is divided into training and test sets, each containing a large number of bytes and examples. The dataset is sampled from codeparrot/github-code under more permissive licenses and also from minipile. It is intended to be used for training a code natural language classifier.