xTimeCrystal/TinyCorpus-v2
收藏官方服务：
资源简介：
MiniModel预训练语料库是一个专门为训练MiniModel系列小型语言模型设计的经过筛选和标记的预训练语料混合。它包括高质量的的教育和通用文本来源，经过过滤和平衡，以在低计算训练制度下最大化学习效率。该语料库包含大约100亿个标记。
MiniModel Pretraining Corpus is a curated, tokenized pretraining mixture designed specifically for training MiniModel-series small language models. It includes high-quality educational and general-purpose text sources, filtered and balanced to maximize learning efficiency in low-compute training regimes. The corpus contains approximately 10 billion tokens.
提供机构：
xTimeCrystal
