xTimeCrystal/TinyCorpus-v2
收藏Hugging Face2025-09-24 更新2025-10-25 收录
下载链接：
https://hf-mirror.com/datasets/xTimeCrystal/TinyCorpus-v2
下载链接
链接失效反馈官方服务：
资源简介：
MiniModel预训练语料库是一个专门为训练MiniModel系列小型语言模型设计的经过筛选和标记的预训练语料混合。它包括高质量的的教育和通用文本来源，经过过滤和平衡，以在低计算训练制度下最大化学习效率。该语料库包含大约100亿个标记。
MiniModel Pretraining Corpus is a curated, tokenized pretraining mixture designed specifically for training MiniModel-series small language models. It includes high-quality educational and general-purpose text sources, filtered and balanced to maximize learning efficiency in low-compute training regimes. The corpus contains approximately 10 billion tokens.
提供机构：
xTimeCrystal
