Tralalabs/wikipedia-2026-05-01

该数据集是一个清理过的英文维基百科文本数据集，源自2026年5月1日的维基媒体英文维基百科转储。它旨在用于语言模型预训练、继续预训练、分词器实验、检索实验以及一般自然语言处理研究。数据集可能包含过时信息、偏见语言、不完整覆盖、事实错误、标记提取伪影、转储时存在的恶意编辑内容，以及敏感或有争议的主题，反映了转储日期捕获的维基百科状态，不应被视为完全准确。

This dataset is a cleaned English Wikipedia text dataset derived from the Wikimedia English Wikipedia dump dated 2026-05-01. It is intended for language model pretraining, continued pretraining, tokenizer experiments, retrieval experiments, and general NLP research. The dataset may contain outdated information, biased language, incomplete coverage, factual errors, markup extraction artifacts, vandalism that existed at dump time, and sensitive or controversial topics, reflecting Wikipedia as captured on the dump date and should not be treated as perfectly accurate.