skymizer/pretraining-v2-41.8B-llama3-token
收藏Hugging Face2024-10-30 更新2024-12-14 收录
下载链接：
https://hf-mirror.com/datasets/skymizer/pretraining-v2-41.8B-llama3-token
下载链接
链接失效反馈官方服务：
资源简介：
该数据集由三部分组成：dolma 22B、fineweb-edu 21B和starcoder 2B，主要包含常见的编程语言如C、CPP、JAVA、PYTHON和JSON。数据集提供了训练和验证分割的详细信息，包括每个分割的GPT2和Llama3的token计数。
This dataset is composed of three main parts: dolma 22B, fineweb-edu 21B, and starcoder 2B, primarily containing common programming languages such as C, CPP, JAVA, PYTHON, and JSON. The dataset provides detailed information on the training and validation splits, including the token counts for GPT2 and Llama3 for each split.
提供机构：
skymizer
