manu/code_20b_separate

---
configs:
- config_name: default
data_files:
- split: StarcoderdataPythonTest
path: data/StarcoderdataPythonTest-*
- split: StarcoderdataMarkdownTest
path: data/StarcoderdataMarkdownTest-*
- split: StarcoderdataJupyterScriptsDedupFilteredTest
path: data/StarcoderdataJupyterScriptsDedupFilteredTest-*
- split: StarcoderdataJupyterStructuredCleanDedupTest
path: data/StarcoderdataJupyterStructuredCleanDedupTest-*
- split: StarcoderdataJsonTest
path: data/StarcoderdataJsonTest-*
- split: CodeContestsTest
path: data/CodeContestsTest-*
- split: PypiCleanTest
path: data/PypiCleanTest-*
dataset_info:
features:
- name: id
dtype: string
- name: text
dtype: string
- name: dataset_id
dtype: string
splits:
- name: StarcoderdataPythonTest
num_bytes: 45900630
num_examples: 10000
- name: StarcoderdataMarkdownTest
num_bytes: 40927519
num_examples: 10000
- name: StarcoderdataJupyterScriptsDedupFilteredTest
num_bytes: 15297731
num_examples: 1829
- name: StarcoderdataJupyterStructuredCleanDedupTest
num_bytes: 12631734
num_examples: 1337
- name: StarcoderdataJsonTest
num_bytes: 8853154
num_examples: 7127
- name: CodeContestsTest
num_bytes: 28120884
num_examples: 8396
- name: PypiCleanTest
num_bytes: 124421305
num_examples: 10000
download_size: 0
dataset_size: 276152957
---
# Dataset Card for "code_20b_separate"

[More Information needed](https://github.com/huggingface/datasets/blob/main/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

原始信息汇总

数据集概述

配置信息

• 默认配置：
  • 数据文件：
    • StarcoderdataPythonTest：路径为 data/StarcoderdataPythonTest-*
    • StarcoderdataMarkdownTest：路径为 data/StarcoderdataMarkdownTest-*
    • StarcoderdataJupyterScriptsDedupFilteredTest：路径为 data/StarcoderdataJupyterScriptsDedupFilteredTest-*
    • StarcoderdataJupyterStructuredCleanDedupTest：路径为 data/StarcoderdataJupyterStructuredCleanDedupTest-*
    • StarcoderdataJsonTest：路径为 data/StarcoderdataJsonTest-*
    • CodeContestsTest：路径为 data/CodeContestsTest-*
    • PypiCleanTest：路径为 data/PypiCleanTest-*

数据集信息

• 特征：

  • id：类型为 string
  • text：类型为 string
  • dataset_id：类型为 string

• 分割：

  • StarcoderdataPythonTest：字节数为 45900630，样本数为 10000
  • StarcoderdataMarkdownTest：字节数为 40927519，样本数为 10000
  • StarcoderdataJupyterScriptsDedupFilteredTest：字节数为 15297731，样本数为 1829
  • StarcoderdataJupyterStructuredCleanDedupTest：字节数为 12631734，样本数为 1337
  • StarcoderdataJsonTest：字节数为 8853154，样本数为 7127
  • CodeContestsTest：字节数为 28120884，样本数为 8396
  • PypiCleanTest：字节数为 124421305，样本数为 10000

• 数据集大小：

  • 下载大小：0 字节
  • 数据集大小：276152957 字节