Marcus2112/minipile_density-proportioned_tiny
收藏Hugging Face2025-01-23 更新2025-02-15 收录
下载链接：
https://hf-mirror.com/datasets/Marcus2112/minipile_density-proportioned_tiny
下载链接
链接失效反馈官方服务：
资源简介：
这是一个基于The Pile Deduplicated的数据集，包含文本(text)和索引(pile_idx)两种特征。数据集被划分为训练集(train)、验证集(validation)和测试集(test)，分别包含842,967、500和10,000个示例。整个数据集大小为5,279,901,670字节，下载大小为2,903,588,242字节。数据集使用英语。
This dataset is based on The Pile Deduplicated, containing features such as text and pile_idx. The dataset is split into training (train), validation (validation), and test (test) sets, with 842,967, 500, and 10,000 examples respectively. The total size of the dataset is 5,279,901,670 bytes, with a download size of 2,903,588,242 bytes. The dataset is in English.
提供机构：
Marcus2112
