Neel-Gupta/tinystories-processed_16

该数据集包含文本数据，其特征为一个嵌套的序列结构，具体为序列的序列，数据类型为int64。数据集分为训练集和验证集两部分，训练集包含135,971个样本，占用26,761,268,336字节；验证集包含1,404个样本，占用276,329,664字节。整个数据集的下载大小为1,528,575,355字节，总大小为27,037,598,000字节。数据文件的路径在配置部分指定，训练集和验证集分别位于data/train-*和data/validation-*路径下。

The dataset contains text data, with features structured as nested sequences, specifically sequences of sequences, with a data type of int64. The dataset is divided into a training set and a validation set. The training set consists of 135,971 samples, occupying 26,761,268,336 bytes, while the validation set consists of 1,404 samples, occupying 276,329,664 bytes. The total download size of the dataset is 1,528,575,355 bytes, and the overall dataset size is 27,037,598,000 bytes. The paths to the data files are specified in the configuration section, with the training set and validation set located under data/train-* and data/validation-* paths, respectively.