opendatalab/SlimPajama-Meta-rater-Reasoning-30B
收藏Hugging Face2025-06-15 更新2025-07-05 收录
下载链接：
https://hf-mirror.com/datasets/opendatalab/SlimPajama-Meta-rater-Reasoning-30B
下载链接
链接失效反馈官方服务：
资源简介：
该数据集包含从SlimPajama-627B语料库中使用PRRC框架的推理维度选出的前30B个token。每个文档都经过基于ModernBERT的评估器打分，该评估器经过特别训练，用于评估理解文本所需的逻辑推理复杂度和深度。数据集的领域与SlimPajama相同，包括CommonCrawl、C4、GitHub、书籍、ArXiv、维基百科和StackExchange。
This dataset contains the top 30B tokens from the SlimPajama-627B corpus, selected using the Reasoning dimension of the PRRC framework. Each document in this subset is scored by a ModernBERT-based rater fine-tuned to assess the complexity and depth of logical reasoning required to understand the text, with domains including CommonCrawl, C4, GitHub, Books, ArXiv, Wikipedia, and StackExchange.
提供机构：
opendatalab
