Juliushanhanhan/pile-1b-llama3-tokenized-cxt-1024
收藏Hugging Face2024-07-07 更新2024-07-22 收录
下载链接：
https://hf-mirror.com/datasets/Juliushanhanhan/pile-1b-llama3-tokenized-cxt-1024
下载链接
链接失效反馈官方服务：
资源简介：
该数据集包含一个名为train的分割，共有1,000,000个例子，每个例子由int64类型的tokens序列组成。数据集总大小为8,048,933,352字节，下载大小为1,960,940,460字节。数据集的默认配置中包含一个指向train分割数据文件的路径。
The dataset contains a split named train with 1,000,000 examples, each consisting of a sequence of tokens of type int64. The total size of the dataset is 8,048,933,352 bytes, and the download size is 1,960,940,460 bytes. The default configuration of the dataset includes a path to the data files for the train split.
提供机构：
Juliushanhanhan
