wshuai190/fineweb-sample-10BT-128

该数据集包含两个主要特征：text和next_text，均为字符串类型。数据集分为训练集和测试集，训练集包含68037294个样本，测试集包含3403个样本。数据集的总下载大小为48210647443字节，总数据集大小为68943698839字节。数据集配置包括默认配置，其中训练数据文件位于data/train-*路径，测试数据文件位于data/test-*路径。

The dataset includes two main features: text and next_text, both of which are string type. The dataset is divided into training and test sets, with 68037294 samples in the training set and 3403 samples in the test set. The total download size of the dataset is 48210647443 bytes, and the total dataset size is 68943698839 bytes. The dataset configuration includes the default configuration, where training data files are located at data/train-* path and test data files are located at data/test-* path.

原始信息汇总

数据集概述

数据特征

• text: 数据类型为字符串。
• next_text: 数据类型为字符串。

数据分割

• train:
  • 字节数: 68940249200
  • 样本数: 68037294
• test:
  • 字节数: 3449639
  • 样本数: 3403

数据大小

• 下载大小: 48210647443 字节
• 数据集总大小: 68943698839 字节

配置

• config_name: default
  • data_files:
    • train: data/train-*
    • test: data/test-*