semran1/finewebedu23_sample-800k

该数据集包含文本和其他相关元数据，适用于训练自然语言处理模型。数据集由训练集组成，共有800,000个示例，文件大小为4,409,417,537字节。特征包括文本内容、唯一标识符、URL链接、文件路径、语言类型、语言置信度、词汇数量、评分和整数评分。

The dataset consists of text and other related metadata, suitable for training natural language processing models. It is composed of a training set with a total of 800,000 examples, with a file size of 4,409,417,537 bytes. Features include text content, unique identifiers, URL links, file paths, language type, language confidence, token count, score, and integer score.