carlosejimenez/wikibook-tokenized-block-size-512

--- dataset_info: features: - name: input_ids sequence: int32 splits: - name: train num_bytes: 15964254252 num_examples: 7779851 download_size: 7865415536 dataset_size: 15964254252 --- # Dataset Card for "wikibook-tokenized-block-size-512" [More Information needed](https://github.com/huggingface/datasets/blob/main/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

原始信息汇总

数据集概述

数据集名称

wikibook-tokenized-block-size-512

数据集特征

• 名称: input_ids
• 序列类型: int32

数据集分割

• 分割名称: train
• 数据量:
  • 字节数: 15964254252
  • 示例数: 7779851

数据集大小

• 下载大小: 7865415536
• 数据集大小: 15964254252