Beetle-Data/en-for-ar-28B
收藏官方服务:
资源简介:
该数据集名为Beetle-Data/en-for-ar-28B,包含预分块的数据块(输入ID为513个标记的打包序列),确保无跨文档混合。数据以增量方式分块上传,标记文件data/_finalized.json在全部上传完成后提交。
This dataset, named Beetle-Data/en-for-ar-28B, consists of pretokenized chunks with input_ids as 513-token packed sequences and no cross-document bleeding. It is sharded incrementally, and the marker data/_finalized.json is committed once all parts are uploaded.
提供机构:
Beetle-Data


