nvidia/ClimbLab
收藏官方服务：
资源简介：
ClimbLab是一个经过过滤的1.2万亿token的语料库，包含20个cluster。基于Nemotron-CC和SmolLM-Corpus，我们使用提出的CLIMB-clustering算法对合并后的数据集进行语义重新组织和过滤，形成了一个高质量的大型语料库。
ClimbLab is a filtered 1.2-trillion-token corpus with 20 clusters. Based on Nemotron-CC and SmolLM-Corpus, we employed our proposed CLIMB-clustering to semantically reorganize and filter this combined dataset into 20 distinct clusters, leading to a high-quality 1.2-trillion-token corpus.
提供机构：
nvidia
