RichNachos/processed-georgian-corpus

该数据集包含用于自然语言处理任务的特征，如input_ids、token_type_ids、attention_mask和special_tokens_mask，这些特征通常与BERT等预训练模型的使用相关。数据集包含一个训练分割，共有6,126,524个示例，总大小为22,055,486,400字节。This dataset includes features for natural language processing tasks, such as input_ids, token_type_ids, attention_mask, and special_tokens_mask, which are typically associated with the use of pre-trained models like BERT. The dataset contains a training split with a total of 6,126,524 examples and a total size of 22,055,486,400 bytes.