Raziel1234/WebBooks
收藏Hugging Face2025-09-27 更新2025-10-25 收录
下载链接:
https://hf-mirror.com/datasets/Raziel1234/WebBooks
下载链接
链接失效反馈官方服务:
资源简介:
Books Corpus数据集是一个从Project Gutenberg上可免费获取的书籍中提取的文本行的大集合。这个数据集主要由文学作品组成,包括科幻小说和古典文学。它旨在用于训练自定义的语言模型,专注于书籍风格的文本生成。数据集经过清理,去除了HTML标签、广告和元数据,并将段落拆分为句子。每个文本行是有意义的长度(超过30个字符)。
The Books Corpus Dataset is a large collection of text lines extracted from free books available on Project Gutenberg. The dataset consists mainly of literary texts, including science fiction and classical literature. It is designed for training custom language models focused on book-style text generation. The dataset has been cleaned, removing HTML tags, ads, and metadata, and splitting paragraphs into sentences. Each line of text is of meaningful length (greater than 30 characters).
提供机构:
Raziel1234



