OpenLLM-France/wikipedia

该数据集是来自Wikipedia的纯文本版本，包含多种语言（英语、法语、德语、西班牙语、意大利语），去除了HTML标签和Wiki模板，仅保留Markdown语法用于标题、列表和表格。数据集由LINAGORA和OpenLLM France从Wikimedia dumps创建，使用特定的GitHub代码库进行处理。数据集的每个配置（不同语言）包含相同的字段：id、url、title和text。

This dataset is a plain text version of pages from `wikipedia.org` spaces for several languages (English, German, French, Spanish, Italian). The text is without HTML tags nor wiki templates. It just includes markdown syntax for headers, lists and tables. It was created by LINAGORA and OpenLLM France from the Wikimedia dumps, using code in a specific GitHub repository. The data fields are the same among all configurations: id, url, title, and text.