mor40/wiki-tokenized

--- configs: - config_name: default data_files: - split: train path: data/train-* dataset_info: features: - name: input_ids sequence: int32 - name: attention_mask sequence: int8 - name: word_ids sequence: int64 - name: labels sequence: int64 splits: - name: train num_bytes: 3030584064 num_examples: 558736 download_size: 866690406 dataset_size: 3030584064 --- # Dataset Card for "wiki-tokenized" [More Information needed](https://github.com/huggingface/datasets/blob/main/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

原始信息汇总

数据集概述

配置信息

• 配置名称: default
• 数据文件:
  • 分割: train
  • 路径: data/train-*

数据集特征

• input_ids: 序列类型为int32
• attention_mask: 序列类型为int8
• word_ids: 序列类型为int64
• labels: 序列类型为int64

数据集分割

• 名称: train
• 字节数: 3030584064
• 示例数量: 558736

数据集大小

• 下载大小: 866690406
• 数据集大小: 3030584064