mvasiliniuc/iva-kotlin-codeint-clean-valid-tokenized

---
dataset_info:
features:
- name: ratio
dtype: float64
- name: config_or_test
dtype: bool
- name: has_no_keywords
dtype: bool
- name: has_few_assignments
dtype: bool
- name: input_ids
sequence: int32
- name: ratio_char_token
dtype: float64
splits:
- name: train
num_bytes: 188689431
num_examples: 41843
download_size: 74311910
dataset_size: 188689431
---
# Dataset Card for "iva-kotlin-codeint-clean-valid-tokenized"

[More Information needed](https://github.com/huggingface/datasets/blob/main/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

原始信息汇总

数据集概述

数据集名称

iva-kotlin-codeint-clean-valid-tokenized

数据特征

• ratio: 数据类型为 float64
• config_or_test: 数据类型为 bool
• has_no_keywords: 数据类型为 bool
• has_few_assignments: 数据类型为 bool
• input_ids: 序列类型为 int32
• ratio_char_token: 数据类型为 float64

数据分割

• train:
  • 数据量: 188689431 字节
  • 示例数量: 41843

数据集大小

• 下载大小: 74311910 字节
• 数据集总大小: 188689431 字节