bluelightai-dev/clt_eval_data_qwen3_tokenized_256
收藏Hugging Face2025-07-21 更新2025-11-01 收录
下载链接：
https://hf-mirror.com/datasets/bluelightai-dev/clt_eval_data_qwen3_tokenized_256
下载链接
链接失效反馈官方服务：
资源简介：
该数据集包含文本处理相关的特征字段，主要用于训练自然语言处理模型。特征包括输入ID序列、令牌序列、原始文本字符串、令牌边界和累积令牌数。数据集分为训练集，包含大约245万个文本示例，总大小为1.44GB。
The dataset includes text processing-related feature fields, primarily used for training natural language processing models. Features include input ID sequences, token sequences, raw text strings, token boundaries, and cumulative token counts. The dataset is split into a training set, containing approximately 2.45 million text examples, with a total size of 1.44GB.
提供机构：
bluelightai-dev
