wissamantoun/fineweb-edu-format-topic
收藏Hugging Face2025-05-06 更新2025-08-30 收录
下载链接：
https://hf-mirror.com/datasets/wissamantoun/fineweb-edu-format-topic
下载链接
链接失效反馈官方服务：
资源简介：
FineWeb-Edu数据集包含1.3万亿个标记，这些标记按照主题和格式进行了注释。主题包括成人内容、艺术与设计、软件开发等24个类别，格式包括学术写作、内容列表、创意写作等23个类别。该数据集使用了wissamantoun/WebOrganizer-TopicClassifier-ModernBERT和wissamantoun/WebOrganizer-FormatClassifier-ModernBERT分类器进行标注。
The FineWeb-Edu dataset consists of 1.3 trillion tokens that are annotated for Topic and Format. There are 24 Topic categories such as Adult, Art & Design, Software Dev., and 23 Format categories such as Academic Writing, Content Listing, Creative Writing. The annotations were made using wissamantoun/WebOrganizer-TopicClassifier-ModernBERT and wissamantoun/WebOrganizer-FormatClassifier-ModernBERT classifiers.
提供机构：
wissamantoun
