Navanjana/Gutenberg_books

Gutenberg书籍数据集包含从Project Gutenberg数字图书馆的公共领域作品中提取的74,329本英文书籍中的大约9765万段文本。数据集总大小为34GB，适合自然语言处理研究与应用。文本经过清理，去除了Project Gutenberg的标准页眉和页脚，保留了书籍的核心内容。该数据集旨在支持各种任务，如训练大型语言模型、文本分类、主题建模和文学分析，提供了一个多样化和广泛的历史英文文学作品集。

The Gutenberg Books Dataset contains approximately 9.76 million paragraphs extracted from 74,329 English-language books sourced from Project Gutenbergs digital library of public domain works. The dataset totals 34GB in size, making it a substantial resource for natural language processing (NLP) research and applications. The texts have been cleaned to remove Project Gutenbergs standard headers and footers, leaving only the core content of each book. This dataset is designed to support a variety of tasks such as training large language models, text classification, topic modeling, and literary analysis, by providing a diverse and extensive corpus of historical English literature.