Aarushhh/fineweb-edu-refined

数据集CC-MAIN-2024-10包含多个特征字段，如文本内容、ID、URL、文件路径、语言、语言评分、词数、评分和整数评分等。数据集分为训练集，包含2116792个样本，总大小为11806589637字节。下载大小为6548266494字节。The dataset CC-MAIN-2024-10 includes multiple feature fields such as text content, ID, URL, file path, language, language score, token count, score, and integer score. The dataset is divided into a training set containing 2116792 samples, with a total size of 11806589637 bytes. The download size is 6548266494 bytes.