semran1/DCLM-13M-tokenized
收藏Hugging Face2025-01-16 更新2025-02-15 收录
下载链接:
https://hf-mirror.com/datasets/semran1/DCLM-13M-tokenized
下载链接
链接失效反馈官方服务:
资源简介:
这是一个包含文本数据的训练集,数据集包含了文本内容(text)、输入ID(input_ids)、注意力掩码(attention_mask)和长度(length)四个字段。整个数据集共有12996761个样本,总大小约为150GB。数据集适用于自然语言处理任务,如文本分类、情感分析等。
This is a training dataset containing text data, which includes four fields: text content (text), input IDs (input_ids), attention masks (attention_mask), and length (length). The dataset consists of 12,996,761 samples with a total size of approximately 150GB. It is suitable for natural language processing tasks such as text classification, sentiment analysis, etc.
提供机构:
semran1



