hakurei/megatron-dev-dataset
收藏Hugging Face2023-07-18 更新2024-03-04 收录
下载链接：
https://hf-mirror.com/datasets/hakurei/megatron-dev-dataset
下载链接
链接失效反馈官方服务：
资源简介：
This dataset has been created for testing purposes only. The dataset has been created from the [RedPajama 1T Sample dataset](https://huggingface.co/datasets/togethercomputer/RedPajama-Data-1T-Sample) by tokenizing the C4 sample data.
Licenses:
- [C4 License](https://huggingface.co/datasets/allenai/c4#license)
提供机构：
hakurei
原始信息汇总
