Geralt-Targaryen/C4
收藏Hugging Face2025-01-16 更新2025-08-30 收录
下载链接：
https://hf-mirror.com/datasets/Geralt-Targaryen/C4
下载链接
链接失效反馈官方服务：
资源简介：
这是一个经过清理、去重和净化的C4数据集版本，移除了非英语内容、广告、重复以及其他低质量内容。数据集与OpenWebText2和CC-News进行了交叉去重，并且针对多个基准测试集进行了净化处理，以确保n-gram不重叠。数据集包含3亿多个样本。
A cleaned, deduplicated, and decontaminated version of C4, where non-English content, advertisements, repetitions, and other low-quality content are removed. The dataset is cross-deduplicated with OpenWebText2 and CC-News, and decontaminated to avoid n-gram overlap with multiple benchmark datasets. It contains over 300 million samples.
提供机构：
Geralt-Targaryen
