gokulsrinivasagan/processed_book_corpus-ld

该数据集包含多个特征，包括input_ids、attention_mask、special_tokens_mask和lda_lables，这些特征主要用于自然语言处理任务。数据集分为训练集和验证集，训练集包含2,277,342个样本，验证集包含120,706个样本。数据集的总大小为7,597,016,064字节，下载大小为2,288,319,300字节。

This dataset includes several features such as input_ids, attention_mask, special_tokens_mask, and lda_lables, which are primarily used for natural language processing tasks. The dataset is divided into a training set and a validation set, with the training set containing 2,277,342 samples and the validation set containing 120,706 samples. The total size of the dataset is 7,597,016,064 bytes, with a download size of 2,288,319,300 bytes.