activated-ai/tiny-stories-8k-tokens

该数据集包含两个主要部分：训练集和验证集。训练集包含2119719个例子，验证集包含21990个例子。数据集的特征包括一个名为tokens的int64类型序列。数据集的下载大小为802923887字节，总大小为3780074596字节。数据文件的路径分别为data/train-*和data/validation-*。

The dataset consists of two main parts: a training set and a validation set. The training set contains 2,119,719 examples, and the validation set contains 21,990 examples. The features of the dataset include a sequence of int64 type named tokens. The download size of the dataset is 802,923,887 bytes, and the total size is 3,780,074,596 bytes. The paths for the data files are data/train-* and data/validation-*.