Geralt-Targaryen/wikipedia
收藏Hugging Face2025-01-12 更新2025-02-15 收录
下载链接：
https://hf-mirror.com/datasets/Geralt-Targaryen/wikipedia
下载链接
链接失效反馈官方服务：
资源简介：
这是一个经过清洗和去重的英文维基百科数据集，针对多个基准数据集进行了n-gram重叠度的去污染处理，移除了大约360个文档。数据集包含4,367,356个样本，下载的parquet文件大小为9.3GB。
This dataset is a cleaned and deduplicated English Wikipedia corpus, decontaminated for n-gram overlap with respect to multiple benchmarks, and approximately 360 documents have been removed. It contains 4,367,356 samples with the downloaded parquet files amounting to 9.3GB in size.
提供机构：
Geralt-Targaryen
