nvidia/ClimbLab
收藏Hugging Face2025-04-21 更新2025-08-30 收录
下载链接:
https://hf-mirror.com/datasets/nvidia/ClimbLab
下载链接
链接失效反馈官方服务:
资源简介:
ClimbLab是一个经过过滤的1.2万亿token的语料库,包含20个cluster。基于Nemotron-CC和SmolLM-Corpus,我们使用提出的CLIMB-clustering算法对合并后的数据集进行语义重新组织和过滤,形成了一个高质量的大型语料库。
ClimbLab is a filtered 1.2-trillion-token corpus with 20 clusters. Based on Nemotron-CC and SmolLM-Corpus, we employed our proposed CLIMB-clustering to semantically reorganize and filter this combined dataset into 20 distinct clusters, leading to a high-quality 1.2-trillion-token corpus.
提供机构:
nvidia



