chizk/wikipedia-2024modify-pretrain-zh-tw

本数据集收集自维基百科（Wikipedia）2024年新增与更新内容，主要针对繁体中文语料进行抓取、处理与格式化，适用于大型语言模型（LLM）预训练和自然语言处理（NLP）应用。数据来源为维基百科繁体中文版本，时间范围覆盖2024年至2025年1月24日的新增与更新条目，语言为繁体中文。数据以JSON格式存储，包含text字段，存储维基百科文本内容。数据集规模中等，包含丰富的现代话题、最新事件和科学进展等。

This dataset is collected from Wikipedias 2024 new and updated content, primarily focusing on Traditional Chinese corpus extraction, processing, and formatting, suitable for large language model (LLM) pre-training and natural language processing (NLP) applications. The data source is the Traditional Chinese version of Wikipedia, covering the time range from 2024 to January 24, 2025, for new and updated entries. The language is Traditional Chinese. The data is stored in JSON format, containing a text field for Wikipedia text content. The dataset is of medium size and includes rich modern topics, latest events, and scientific advancements.