stanford-oval/wikipedia
收藏Hugging Face2025-04-29 更新2024-12-14 收录
下载链接：
https://hf-mirror.com/datasets/stanford-oval/wikipedia
下载链接
链接失效反馈官方服务：
资源简介：
该数据集包含来自10种语言的预处理和分块的维基百科HTML转储文件。
This dataset contains preprocessed and chunked Wikipedia HTML dumps from 10 languages, including English, German, Italian, Portuguese, Persian, French, Japanese, Spanish, Russian, and Chinese. It is primarily used for text retrieval and text generation tasks, with a size ranging from 100M to 1B. Multiple configuration versions are provided, each containing collection.jsonl files for different languages.
提供机构：
stanford-oval
