jon-tow/starcoderdata-python-edu

该数据集是经过过滤和评分的StarCoder训练数据集，使用了`python-edu-scorer`进行评分。

This dataset is a filtered version of [StarCoder Training Dataset](https://huggingface.co/datasets/bigcode/starcoderdata) that has been scored with the [`python-edu-scorer`](HuggingFaceTB/python-edu-scorer). It includes features such as repository path, repository name, star count, and is divided into a training set.

原始信息汇总

starcoderdata-python-edu

数据集描述

该数据集是StarCoder Training Dataset的过滤版本，经过python-edu-scorer评分。

数据集特征

• max_stars_repo_path: 字符串类型
• max_stars_repo_name: 字符串类型
• max_stars_count: 整数类型
• id: 字符串类型
• content: 字符串类型
• score: 浮点数类型
• int_score: 整数类型

数据集分割

• train:
  • 字节数: 62056287205
  • 样本数: 12866649

数据集大小

• 下载大小: 23184437873
• 数据集大小: 62056287205

配置

• config_name: default
  • data_files:
    • split: train
    • path: data/train-*