vedanshu93/SlimPajama
收藏Hugging Face2026-02-26 更新2026-03-29 收录
下载链接：
https://hf-mirror.com/datasets/vedanshu93/SlimPajama
下载链接
链接失效反馈官方服务：
资源简介：
---
task_categories:
- text-generation
language:
- en
pretty_name: SlimPajama-Chunked
---
# SlimPajama-Chunked
## Dataset Description
This is a chunked re-upload of Cerebras' [SlimPajama-627B](https://huggingface.co/datasets/cerebras/SlimPajama-627B). The original upload has split
the dataset into 10 chunks, with each containing upwards of 5,000 files. This makes it cumbersome to download and process. We've downloaded the entire
dataset for our own purposes, and decided to upload the chunked version for easier usage.
Each file is ~45GB due to HuggingFace's limitation of 50GB per LFS file.
提供机构：
vedanshu93
