yardeny/processed_gpt2_context_len_16

--- dataset_info: features: - name: input_ids sequence: int32 - name: attention_mask sequence: int8 splits: - name: train num_bytes: 5220106232.0 num_examples: 59319389 download_size: 2422249264 dataset_size: 5220106232.0 --- # Dataset Card for "processed_gpt2_context_len_16" [More Information needed](https://github.com/huggingface/datasets/blob/main/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

原始信息汇总

数据集概述

特征信息

• input_ids: 序列类型为 int32
• attention_mask: 序列类型为 int8

数据分割

• train:
  • 字节数: 5220106232.0
  • 样本数: 59319389

数据集大小

• 下载大小: 2422249264
• 数据集大小: 5220106232.0