semran1/DCLM-17M-tokenized
收藏Hugging Face2025-01-15 更新2025-02-15 收录
下载链接：
https://hf-mirror.com/datasets/semran1/DCLM-17M-tokenized
下载链接
链接失效反馈官方服务：
资源简介：
该数据集包含文本数据及其相关特征，适用于机器学习模型的训练。数据集分为训练集(train)，总共包含大约1700万个示例，数据集总大小为约208TB，下载大小约为101GB。数据集特性包括文本内容、输入ID序列、注意力掩码和序列长度。
This dataset contains text data and its related features, suitable for training machine learning models. The dataset is split into a training set (train), containing approximately 17 million examples, with a total dataset size of about 208TB and a download size of about 101GB. The dataset features include text content, input ID sequences, attention masks, and sequence lengths.
提供机构：
semran1
