TiWu-Lab/Wiki-zh

这是一个经过清洗的中文维基百科数据集，其中所有文本已从繁体中文转换为简体中文。数据集通过去除重复内容、低质量文本以及评分低于3分的文本进行了质量提升。最终包含2,021,184个样本，数据集以Parquet格式存储，总大小为3G。

This is a cleaned Chinese Wikipedia dataset where all text has been converted from Traditional Chinese to Simplified Chinese. The dataset has been enhanced by removing duplicates, low-quality text, and any documents scored 1 or 2 by a language quality classifier. It contains 2,021,184 samples and is stored in Parquet format with a total size of 3G.