Marcus2112/minipile_density-proportioned_pico
收藏Hugging Face2025-01-23 更新2025-02-15 收录
下载链接：
https://hf-mirror.com/datasets/Marcus2112/minipile_density-proportioned_pico
下载链接
链接失效反馈官方服务：
资源简介：
这是一个基于The Pile Deduplicated的数据集，包含两个特征：text（文本数据）和pile_idx（索引数据）。数据集分为训练集、验证集和测试集，其中训练集包含250,000个示例，验证集包含500个示例，测试集包含10,000个示例。整个数据集的大小为1,615,009,895字节，下载大小为891,297,473字节。
This dataset is based on The Pile Deduplicated and includes two features: text (text data) and pile_idx (index data). The dataset is split into training, validation, and test sets, with the training set containing 250,000 examples, the validation set containing 500 examples, and the test set containing 10,000 examples. The total size of the dataset is 1,615,009,895 bytes, and the download size is 891,297,473 bytes.
提供机构：
Marcus2112
