YnezT/gpt2-directions-non_fully_random_walk-10M-non-fully

该数据集包含三个主要特征：input_ids、attention_mask和labels，分别以int32、int8和int64的序列形式存在。数据集分为训练集和测试集，训练集包含10,000,000个样本，占用17,150,000,000字节；测试集包含200,000个样本，占用343,000,000字节。数据集的下载大小为1,948,538,534字节，总大小为17,493,000,000字节。数据文件路径分别为data/train-*和data/test-*。

The dataset contains three main features: input_ids, attention_mask, and labels, which exist as sequences of int32, int8, and int64 respectively. The dataset is divided into a training set and a test set. The training set contains 10,000,000 samples, occupying 17,150,000,000 bytes; the test set contains 200,000 samples, occupying 343,000,000 bytes. The download size of the dataset is 1,948,538,534 bytes, and the total size is 17,493,000,000 bytes. The data file paths are data/train-* and data/test-*.