CHINAYWX/g06_tokenizered
收藏Hugging Face2024-09-25 更新2024-12-14 收录
下载链接：
https://hf-mirror.com/datasets/CHINAYWX/g06_tokenizered
下载链接
链接失效反馈官方服务：
资源简介：
该数据集包含三个字段：input_ids（整型序列），attention_mask（字节序列），labels（长整型序列）。数据集分为训练集和测试集，其中训练集包含1000000个示例，大小为453853671字节；测试集包含10000个示例，大小为4483939字节。数据集总大小为458337610字节，下载大小为134176632字节。提供了默认配置，指定了训练集和测试集的数据文件路径。
The dataset includes three fields: input_ids (integer sequence), attention_mask (byte sequence), and labels (long integer sequence). The dataset is split into a training set and a test set, with the training set containing 1000000 examples and a size of 453853671 bytes; the test set contains 10000 examples and is 4483939 bytes in size. The total size of the dataset is 458337610 bytes, and the download size is 134176632 bytes. A default configuration is provided, specifying the data file paths for the training and test sets.
提供机构：
CHINAYWX
