shchoi1019/512token

该数据集包含用于训练模型的结构化数据，主要特征包括input_ids、token_type_ids、attention_mask和labels，这些特征分别以int32、int8、int8和int64的数据类型表示。数据集被分割为训练集，包含34,258,796个示例，总大小为246,115,190,464字节。数据集的下载大小为53,227,867,433字节。默认配置下的数据文件路径为data/train-*。

This dataset contains structured data for training models, with main features including input_ids, token_type_ids, attention_mask, and labels, represented as int32, int8, int8, and int64 data types respectively. The dataset is split into a training set containing 34,258,796 examples, with a total size of 246,115,190,464 bytes. The download size of the dataset is 53,227,867,433 bytes. The data file path under the default configuration is data/train-*.