TieLu/wikipedia-zh-cn
收藏资源简介：
本数据集是中文维基百科（Wikipedia 中文版）的离线数据集，基于zhwiki dump按日期快照保存。它包含多个时间点的中文维基百科全文快照，数据以JSON格式存储，每条记录包含唯一ID、标题、标签和正文内容。该数据集适用于自然语言处理、信息检索、知识图谱构建等任务，具体可用于语言模型预训练/微调、文本分类与聚类、知识抽取与问答系统、信息检索与索引构建等。
This dataset is an offline collection of Chinese Wikipedia (Wikipedia Chinese version), based on zhwiki dumps saved as date-specific snapshots. It contains full-text snapshots of Chinese Wikipedia at multiple time points, stored in JSON format, with each record including a unique ID, title, tags, and body content. The dataset is suitable for tasks such as natural language processing, information retrieval, and knowledge graph construction, specifically for language model pre-training/fine-tuning, text classification and clustering, knowledge extraction and question-answering systems, information retrieval and index building.
