AlanRobotics/saiga_tokenized

--- dataset_info: features: - name: labels sequence: int64 - name: input_ids sequence: int32 - name: attention_mask sequence: int8 splits: - name: train num_bytes: 52968582.0 num_examples: 32688 - name: test num_bytes: 5885398.0 num_examples: 3632 download_size: 20205153 dataset_size: 58853980.0 --- # Dataset Card for "saiga_tokenized" [More Information needed](https://github.com/huggingface/datasets/blob/main/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

原始信息汇总

数据集概述

数据集名称

• 名称: saiga_tokenized

数据集特征

• 特征:
  • labels: 序列类型为 int64
  • input_ids: 序列类型为 int32
  • attention_mask: 序列类型为 int8

数据集分割

• 训练集:
  • 示例数量: 32688
  • 存储大小: 52968582.0 字节
• 测试集:
  • 示例数量: 3632
  • 存储大小: 5885398.0 字节

数据集大小

• 下载大小: 20205153 字节
• 总数据集大小: 58853980.0 字节