Ba2han/filtered_tokenized_mix_031125
收藏Hugging Face2025-11-03 更新2025-11-15 收录
下载链接:
https://hf-mirror.com/datasets/Ba2han/filtered_tokenized_mix_031125
下载链接
链接失效反馈官方服务:
资源简介:
该数据集包含三个特征字段:长度(length),输入ID(input_ids),注意力掩码(attention_mask)。数据集被划分为一个训练集,包含超过2100万个样本,总大小约为4.88GB。数据集适用于需要处理序列数据,特别是那些使用注意力机制的模型。
The dataset includes three feature fields: length (length), input IDs (input_ids), and attention masks (attention_mask). The dataset is split into a single training set with over 21 million examples, totaling approximately 4.88GB in size. The dataset is suitable for sequence processing tasks, especially those that utilize attention mechanisms.
提供机构:
Ba2han



