swiss-ai/project_gutenberg_preprocessed
收藏Hugging Face2026-01-26 更新2026-02-07 收录
下载链接：
https://hf-mirror.com/datasets/swiss-ai/project_gutenberg_preprocessed
下载链接
链接失效反馈官方服务：
资源简介：
Gutenberg数据集是基于Project Gutenberg语料库的版本，用于预训练Apertus模型（v1在9T之前使用，v2在9T到12T之间使用）。数据集包含多种语言（英语、法语、中文），主要用于文本生成任务。关于数据来源、准备和统计信息的详细信息可在技术报告中找到，数据采样、过滤和准备的脚本可在GitHub仓库中获取。
The Gutenberg dataset is a version of the Project Gutenberg corpus, used for pretraining Apertus (v1 was used before 9T, v2 between 9T and 12T). The dataset includes multiple languages (English, French, Chinese) and is primarily used for text-generation tasks. More details about data provenance, preparation, and statistics can be found in the tech report, and sampling, filtering, and data-preparation scripts are available in the GitHub repository.
提供机构：
swiss-ai
