Tristan/olm-wikipedia-20221220-1-percent-tokenized-766

--- dataset_info: features: - name: input_ids sequence: int32 - name: attention_mask sequence: int8 - name: special_tokens_mask sequence: int8 splits: - name: train num_bytes: 300178944 num_examples: 65143 download_size: 93964466 dataset_size: 300178944 --- # Dataset Card for "olm-wikipedia-20221220-1-percent-tokenized-766" [More Information needed](https://github.com/huggingface/datasets/blob/main/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

原始信息汇总

数据集概述

数据集名称

• 名称: olm-wikipedia-20221220-1-percent-tokenized-766

数据集特征

• 特征1: input_ids

  • 数据类型: int32
  • 序列类型: sequence

• 特征2: attention_mask

  • 数据类型: int8
  • 序列类型: sequence

• 特征3: special_tokens_mask

  • 数据类型: int8
  • 序列类型: sequence

数据集分割

• 分割名称: train
  • 数据大小: 300178944 bytes
  • 示例数量: 65143

数据集大小

• 下载大小: 93964466 bytes
• 总数据大小: 300178944 bytes