systemk/codenet
收藏Hugging Face2024-02-16 更新2024-03-04 收录
下载链接:
https://hf-mirror.com/datasets/systemk/codenet
下载链接
链接失效反馈官方服务:
资源简介:
---
license: cdla-permissive-2.0
task_categories:
- text-generation
- text-classification
dataset_info:
- config_name: accepted
features:
- name: code
dtype: string
- name: submission_id
dtype: string
- name: problem_id
dtype: string
- name: user_id
dtype: string
- name: date
dtype: string
- name: language
dtype:
class_label:
names:
'0': C++
'1': C
'2': Java
'3': Python
'4': Go
'5': Ruby
'6': C#
'7': OCaml
'8': Rust
'9': JavaScript
'10': PHP
'11': Scala
'12': Other
- name: original_language
dtype: string
- name: filename_ext
dtype: string
- name: status
dtype:
class_label:
names:
'0': Accepted
'1': Compile Error
'2': Runtime Error
'3': Time Limit Exceeded
'4': Memory Limit Exceeded
'5': Wrong Answer
'6': Other
- name: cpu_time
dtype: int32
- name: memory
dtype: int32
- name: code_size
dtype: int32
- name: accuracy
dtype: string
splits:
- name: train
num_bytes: 7182604796.348241
num_examples: 5004663
- name: validation
num_bytes: 1886090799.288453
num_examples: 1500962
- name: test
num_bytes: 1350931397.6121755
num_examples: 954963
download_size: 4841625499
dataset_size: 10419626993.248869
- config_name: default
features:
- name: code
dtype: string
- name: submission_id
dtype: string
- name: problem_id
dtype: string
- name: user_id
dtype: string
- name: date
dtype: string
- name: language
dtype:
class_label:
names:
'0': C++
'1': C
'2': Java
'3': Python
'4': Go
'5': Ruby
'6': C#
'7': OCaml
'8': Rust
'9': JavaScript
'10': PHP
'11': Scala
'12': Other
- name: original_language
dtype: string
- name: filename_ext
dtype: string
- name: status
dtype:
class_label:
names:
'0': Accepted
'1': Compile Error
'2': Runtime Error
'3': Time Limit Exceeded
'4': Memory Limit Exceeded
'5': Wrong Answer
'6': Other
- name: cpu_time
dtype: int32
- name: memory
dtype: int32
- name: code_size
dtype: int32
- name: accuracy
dtype: string
splits:
- name: train
num_bytes: 13719235606
num_examples: 9559227
- name: validation
num_bytes: 3300894506
num_examples: 2626871
- name: test
num_bytes: 2448421072
num_examples: 1730770
download_size: 7476817454
dataset_size: 19468551184
- config_name: mini
features:
- name: code
dtype: string
- name: submission_id
dtype: string
- name: problem_id
dtype: string
- name: user_id
dtype: string
- name: date
dtype: string
- name: language
dtype:
class_label:
names:
'0': C++
'1': C
'2': Java
'3': Python
'4': Go
'5': Ruby
'6': C#
'7': OCaml
'8': Rust
'9': JavaScript
'10': PHP
'11': Scala
'12': Other
- name: original_language
dtype: string
- name: filename_ext
dtype: string
- name: status
dtype:
class_label:
names:
'0': Accepted
'1': Compile Error
'2': Runtime Error
'3': Time Limit Exceeded
'4': Memory Limit Exceeded
'5': Wrong Answer
'6': Other
- name: cpu_time
dtype: int32
- name: memory
dtype: int32
- name: code_size
dtype: int32
- name: accuracy
dtype: string
splits:
- name: train
num_bytes: 2821205
num_examples: 5399
- name: validation
num_bytes: 1108361
num_examples: 1200
- name: test
num_bytes: 1426005
num_examples: 2225
download_size: 1913743
dataset_size: 5355571
configs:
- config_name: accepted
data_files:
- split: train
path: accepted/train-*
- split: validation
path: accepted/validation-*
- split: test
path: accepted/test-*
- config_name: default
data_files:
- split: train
path: data/train-*
- split: validation
path: data/validation-*
- split: test
path: data/test-*
- config_name: mini
data_files:
- split: train
path: mini/train-*
- split: validation
path: mini/validation-*
- split: test
path: mini/test-*
tags:
- code
---
# Dataset Card for Dataset Name
<!-- Provide a quick summary of the dataset. -->
This dataset card aims to be a base template for new datasets. It has been generated using [this raw template](https://github.com/huggingface/huggingface_hub/blob/main/src/huggingface_hub/templates/datasetcard_template.md?plain=1).
## Dataset Details
### Dataset Description
<!-- Provide a longer summary of what this dataset is. -->
- **Curated by:** [More Information Needed]
- **Funded by [optional]:** [More Information Needed]
- **Shared by [optional]:** [More Information Needed]
- **Language(s) (NLP):** [More Information Needed]
- **License:** [More Information Needed]
### Dataset Sources [optional]
<!-- Provide the basic links for the dataset. -->
- **Repository:** [More Information Needed]
- **Paper [optional]:** [More Information Needed]
- **Demo [optional]:** [More Information Needed]
## Uses
<!-- Address questions around how the dataset is intended to be used. -->
### Direct Use
<!-- This section describes suitable use cases for the dataset. -->
[More Information Needed]
### Out-of-Scope Use
<!-- This section addresses misuse, malicious use, and uses that the dataset will not work well for. -->
[More Information Needed]
## Dataset Structure
<!-- This section provides a description of the dataset fields, and additional information about the dataset structure such as criteria used to create the splits, relationships between data points, etc. -->
[More Information Needed]
## Dataset Creation
### Curation Rationale
<!-- Motivation for the creation of this dataset. -->
[More Information Needed]
### Source Data
<!-- This section describes the source data (e.g. news text and headlines, social media posts, translated sentences, ...). -->
#### Data Collection and Processing
<!-- This section describes the data collection and processing process such as data selection criteria, filtering and normalization methods, tools and libraries used, etc. -->
[More Information Needed]
#### Who are the source data producers?
<!-- This section describes the people or systems who originally created the data. It should also include self-reported demographic or identity information for the source data creators if this information is available. -->
[More Information Needed]
### Annotations [optional]
<!-- If the dataset contains annotations which are not part of the initial data collection, use this section to describe them. -->
#### Annotation process
<!-- This section describes the annotation process such as annotation tools used in the process, the amount of data annotated, annotation guidelines provided to the annotators, interannotator statistics, annotation validation, etc. -->
[More Information Needed]
#### Who are the annotators?
<!-- This section describes the people or systems who created the annotations. -->
[More Information Needed]
#### Personal and Sensitive Information
<!-- State whether the dataset contains data that might be considered personal, sensitive, or private (e.g., data that reveals addresses, uniquely identifiable names or aliases, racial or ethnic origins, sexual orientations, religious beliefs, political opinions, financial or health data, etc.). If efforts were made to anonymize the data, describe the anonymization process. -->
[More Information Needed]
## Bias, Risks, and Limitations
<!-- This section is meant to convey both technical and sociotechnical limitations. -->
[More Information Needed]
### Recommendations
<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
Users should be made aware of the risks, biases and limitations of the dataset. More information needed for further recommendations.
## Citation [optional]
<!-- If there is a paper or blog post introducing the dataset, the APA and Bibtex information for that should go in this section. -->
**BibTeX:**
[More Information Needed]
**APA:**
[More Information Needed]
## Glossary [optional]
<!-- If relevant, include terms and calculations in this section that can help readers understand the dataset or dataset card. -->
[More Information Needed]
## More Information [optional]
[More Information Needed]
## Dataset Card Authors [optional]
[More Information Needed]
## Dataset Card Contact
[More Information Needed]
提供机构:
systemk
原始信息汇总
数据集概述
数据集详情
数据集描述
该数据集包含多个配置,每个配置具有不同的特征和数据分割。以下是各配置的详细信息:
配置 accepted
-
特征:
code: 字符串submission_id: 字符串problem_id: 字符串user_id: 字符串date: 字符串language: 类别标签,包括 C++、C、Java、Python、Go、Ruby、C#、OCaml、Rust、JavaScript、PHP、Scala、Otheroriginal_language: 字符串filename_ext: 字符串status: 类别标签,包括 Accepted、Compile Error、Runtime Error、Time Limit Exceeded、Memory Limit Exceeded、Wrong Answer、Othercpu_time: 32位整数memory: 32位整数code_size: 32位整数accuracy: 字符串
-
数据分割:
train: 7182604796.348241 字节,5004663 个样本validation: 1886090799.288453 字节,1500962 个样本test: 1350931397.6121755 字节,954963 个样本
-
下载大小: 4841625499 字节
-
数据集大小: 10419626993.248869 字节
配置 default
-
特征:
code: 字符串submission_id: 字符串problem_id: 字符串user_id: 字符串date: 字符串language: 类别标签,包括 C++、C、Java、Python、Go、Ruby、C#、OCaml、Rust、JavaScript、PHP、Scala、Otheroriginal_language: 字符串filename_ext: 字符串status: 类别标签,包括 Accepted、Compile Error、Runtime Error、Time Limit Exceeded、Memory Limit Exceeded、Wrong Answer、Othercpu_time: 32位整数memory: 32位整数code_size: 32位整数accuracy: 字符串
-
数据分割:
train: 13719235606 字节,9559227 个样本validation: 3300894506 字节,2626871 个样本test: 2448421072 字节,1730770 个样本
-
下载大小: 7476817454 字节
-
数据集大小: 19468551184 字节
配置 mini
-
特征:
code: 字符串submission_id: 字符串problem_id: 字符串user_id: 字符串date: 字符串language: 类别标签,包括 C++、C、Java、Python、Go、Ruby、C#、OCaml、Rust、JavaScript、PHP、Scala、Otheroriginal_language: 字符串filename_ext: 字符串status: 类别标签,包括 Accepted、Compile Error、Runtime Error、Time Limit Exceeded、Memory Limit Exceeded、Wrong Answer、Othercpu_time: 32位整数memory: 32位整数code_size: 32位整数accuracy: 字符串
-
数据分割:
train: 2821205 字节,5399 个样本validation: 1108361 字节,1200 个样本test: 1426005 字节,2225 个样本
-
下载大小: 1913743 字节
-
数据集大小: 5355571 字节
数据集配置
-
配置
accepted:- 数据文件路径:
train: accepted/train-*validation: accepted/validation-*test: accepted/test-*
- 数据文件路径:
-
配置
default:- 数据文件路径:
train: data/train-*validation: data/validation-*test: data/test-*
- 数据文件路径:
-
配置
mini:- 数据文件路径:
train: mini/train-*validation: mini/validation-*test: mini/test-*
- 数据文件路径:



