opendatalab/SlimPajama-Meta-rater-Readability-30B
收藏Hugging Face2025-06-14 更新2025-07-05 收录
下载链接：
https://hf-mirror.com/datasets/opendatalab/SlimPajama-Meta-rater-Readability-30B
下载链接
链接失效反馈官方服务：
资源简介：
该数据集包含从SlimPajama-627B语料库中选出的前30B个标记，这些标记是使用PRRC框架的可读性维度进行筛选的。每个文档都由一个基于ModernBERT的评估器进行评分和过滤，该评估器经过微调，用于评估文本的清晰度、连贯性和易读性。
This dataset contains the top 30B tokens from the SlimPajama-627B corpus, selected using the Readability dimension of the PRRC (Professionalism, Readability, Reasoning, Cleanliness) framework. Each document in this subset is scored and filtered by a ModernBERT-based rater fine-tuned to assess the clarity, coherence, and ease of understanding of the text.
提供机构：
opendatalab
