v1ctor10/section1_annual_reports_tokenized_llama3_8b

该数据集包含208,325个训练样本和40个验证样本，主要用于模型训练和验证。数据集的特征包括名为input_ids的序列，数据类型为int64。训练集的总大小为10,968,504,828字节，验证集的总大小为1,557,888字节。整个数据集的下载大小为2,335,934,565字节，总大小为10,970,062,716字节。数据文件按照训练和验证分割存储，路径分别为data/train-*和data/validation-*。

The dataset contains 208,325 training samples and 40 validation samples, primarily used for model training and validation. The features of the dataset include a sequence named input_ids with a data type of int64. The total size of the training set is 10,968,504,828 bytes, and the validation set is 1,557,888 bytes. The entire dataset has a download size of 2,335,934,565 bytes and a total size of 10,970,062,716 bytes. The data files are stored according to the train and validation splits, with paths data/train-* and data/validation-* respectively.

原始信息汇总

数据集概述

数据集特征

• 特征名称: input_ids
• 数据类型: int64

数据集分割

• 训练集:
  • 名称: train
  • 字节数: 10968504828
  • 样本数: 208325
• 验证集:
  • 名称: validation
  • 字节数: 1557888
  • 样本数: 40

数据集大小

• 下载大小: 2335934565
• 总大小: 10970062716

配置信息

• 配置名称: default
  • 数据文件路径:
    • 训练集: data/train-*
    • 验证集: data/validation-*