Beetle-Data/en-for-pl-2B-pretok
收藏官方服务：
资源简介：
Beetle-Data/en-for-pl-2B-pretok是一个预分词数据集，包含513个标记的打包序列（input_ids），确保无跨文档混合。数据以分片增量方式上传，所有部分上传完成后会提交标记文件data/_finalized.json。
Beetle-Data/en-for-pl-2B-pretok is a pretokenized dataset consisting of 513-token packed sequences (input_ids) with no cross-document bleeding. The data is sharded incrementally, and the marker file data/_finalized.json is committed once all parts are uploaded.
提供机构：
Beetle-Data
