chanind/c4-10k-tokenized-gpt2

--- dataset_info: features: - name: input_ids sequence: int32 splits: - name: train num_bytes: 18898500.0 num_examples: 36625 download_size: 11641267 dataset_size: 18898500.0 configs: - config_name: default data_files: - split: train path: data/train-* ---The dataset includes a feature named input_ids with data type int32. It is divided into a training set containing 36625 samples, with a total size of 18898500 bytes. The download size of the dataset is 11641267 bytes. The dataset configuration is named default, and the training data file path is data/train-*.

原始信息汇总

数据集概述

数据集特征

• 名称: input_ids
• 类型: 序列类型，整数32位

数据集分割

• 分割名称: train
• 示例数量: 36625
• 数据大小: 18898500.0 字节

数据集大小

• 下载大小: 11641267 字节
• 数据集总大小: 18898500.0 字节

配置信息

• 配置名称: default
• 数据文件路径: data/train-*
• 分割类型: train