HuggingFaceFW/finepdfs

FinePDFs是一个用于文本生成任务的NLP数据集，包含多种语言的数据，适用于各种文本生成场景。数据集规模庞大，超过1TB，提供了丰富的语言和脚本配置，每个配置都包含训练和测试数据。FinePDFs is an NLP dataset for text generation tasks, containing data in various languages, suitable for diverse text generation scenarios. The dataset is large, with a size category of n>1T, providing rich language and script configurations, each with its own set of training and test data.