AISE-TUDelft/MIA-near-public

该数据集包含了从GitHub仓库中提取的文件信息，包括文件的id、名称、路径、内容、大小、语言、扩展名、行数、平均行长度、最大行长度、字母数字比例等。同时，还包括了仓库的相关信息，如仓库名称、star数、fork数、open issue数、许可证类型和提取日期。另外，数据集还标识了文件在Redpajama、GitHubcode和StackExchange数据集中的重复情况。数据集分为训练集和测试集，每个集合中包含相同数量的示例。

The dataset consists of file information extracted from GitHub repositories, including file id, name, path, content, size, language, extension, line count, average line length, maximum line length, alphanumeric ratio, and repository-related information such as repository name, star count, fork count, open issue count, license type, and extraction date. Additionally, the dataset identifies duplication status of files within the Redpajama, GitHubcode, and StackExchange datasets. The dataset is split into training and test sets, each containing the same number of examples.