facebook/recycling_the_web
收藏Hugging Face2025-08-28 更新2025-10-25 收录
下载链接：
https://hf-mirror.com/datasets/facebook/recycling_the_web
下载链接
链接失效反馈官方服务：
资源简介：
Recycling-The-Web合成数据集包含44.4B个高质量、模型过滤的合成文本，这些文本是通过我们的REWIRE方法获得的。数据集的创建是为了重写那些被质量过滤器丢弃的低质量文档，使其适用于预训练。该数据集主要用于大型语言模型的预训练，旨在补充现有的网络抓取文本。
Recycling-The-Web Synthetic Data contains 44.4B tokens of high-quality, model-filtered synthetic texts obtained via our REcycling the Web with guIded REwrite (REWIRE) approach. The dataset is created to rewrite low-quality documents discarded by quality filters to make them useful for pre-training. It is primarily intended for pre-training large language models and aims to complement existing web-scraped texts.
提供机构：
facebook
